-- Logs begin at Mon 2022-09-12 23:12:53 UTC, end at Tue 2022-09-13 00:10:26 UTC. -- Sep 12 23:37:27.989913 dv-cinder-820027-26-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 12 23:37:28.005657 dv-cinder-820027-26-smb devstack@keystone.service[87832]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 12 23:37:28.008747 dv-cinder-820027-26-smb devstack@keystone.service[87832]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 12 23:37:28 2022] *** Sep 12 23:37:28.008747 dv-cinder-820027-26-smb devstack@keystone.service[87832]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 12 23:37:28.008747 dv-cinder-820027-26-smb devstack@keystone.service[87832]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 12 23:37:28.008747 dv-cinder-820027-26-smb devstack@keystone.service[87832]: nodename: dv-cinder-820027-26-smb Sep 12 23:37:28.008747 dv-cinder-820027-26-smb devstack@keystone.service[87832]: machine: x86_64 Sep 12 23:37:28.008747 dv-cinder-820027-26-smb devstack@keystone.service[87832]: clock source: unix Sep 12 23:37:28.008747 dv-cinder-820027-26-smb devstack@keystone.service[87832]: pcre jit disabled Sep 12 23:37:28.008747 dv-cinder-820027-26-smb devstack@keystone.service[87832]: detected number of CPU cores: 4 Sep 12 23:37:28.008747 dv-cinder-820027-26-smb devstack@keystone.service[87832]: current working directory: / Sep 12 23:37:28.008747 dv-cinder-820027-26-smb devstack@keystone.service[87832]: detected binary path: /usr/bin/uwsgi-core Sep 12 23:37:28.008747 dv-cinder-820027-26-smb devstack@keystone.service[87832]: your processes number limit is 47680 Sep 12 23:37:28.008747 dv-cinder-820027-26-smb devstack@keystone.service[87832]: your memory page size is 4096 bytes Sep 12 23:37:28.010307 dv-cinder-820027-26-smb devstack@keystone.service[87832]: detected max file descriptor number: 2048 Sep 12 23:37:28.010307 dv-cinder-820027-26-smb devstack@keystone.service[87832]: lock engine: pthread robust mutexes Sep 12 23:37:28.010307 dv-cinder-820027-26-smb devstack@keystone.service[87832]: thunder lock: enabled Sep 12 23:37:28.010307 dv-cinder-820027-26-smb devstack@keystone.service[87832]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 12 23:37:28.010307 dv-cinder-820027-26-smb devstack@keystone.service[87832]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 12 23:37:28.054107 dv-cinder-820027-26-smb devstack@keystone.service[87832]: Python main interpreter initialized at 0x55ad58c049c0 Sep 12 23:37:28.054107 dv-cinder-820027-26-smb devstack@keystone.service[87832]: python threads support enabled Sep 12 23:37:28.054107 dv-cinder-820027-26-smb devstack@keystone.service[87832]: your server socket listen backlog is limited to 100 connections Sep 12 23:37:28.054107 dv-cinder-820027-26-smb devstack@keystone.service[87832]: your mercy for graceful operations on workers is 90 seconds Sep 12 23:37:28.054662 dv-cinder-820027-26-smb devstack@keystone.service[87832]: mapped 403077 bytes (393 KB) for 2 cores Sep 12 23:37:28.054662 dv-cinder-820027-26-smb devstack@keystone.service[87832]: *** Operational MODE: preforking *** Sep 12 23:37:28.054917 dv-cinder-820027-26-smb devstack@keystone.service[87832]: *** uWSGI is running in multiple interpreter mode *** Sep 12 23:37:28.054917 dv-cinder-820027-26-smb devstack@keystone.service[87832]: spawned uWSGI master process (pid: 87832) Sep 12 23:37:28.055191 dv-cinder-820027-26-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 12 23:37:28.060347 dv-cinder-820027-26-smb devstack@keystone.service[87832]: spawned uWSGI worker 1 (pid: 87847, cores: 1) Sep 12 23:37:28.060347 dv-cinder-820027-26-smb devstack@keystone.service[87832]: spawned uWSGI worker 2 (pid: 87848, cores: 1) Sep 12 23:37:28.060347 dv-cinder-820027-26-smb devstack@keystone.service[87832]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 12 23:37:32.426186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:37:32.426186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: from cryptography.utils import int_from_bytes Sep 12 23:37:32.426186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:37:32.426186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: from cryptography.utils import int_from_bytes Sep 12 23:37:32.476452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 23:37:32.476718 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 23:37:32.476866 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] command line args: [] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 23:37:32.477066 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 23:37:32.477262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ================================================================================ {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 23:37:32.477537 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] admin_token = **** {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.477788 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] config_dir = [] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.477979 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.478160 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] config_source = [] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.478343 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] debug = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.478545 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.478913 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.479092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.479348 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.479599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.479834 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] list_limit = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.480017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] log_config_append = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.480191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.480369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] log_dir = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.480550 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] log_file = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.480789 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.481041 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.481284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.481607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.481722 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.481904 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.482175 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.482404 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.482642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.482878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.483114 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.483352 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.483597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.483844 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.484126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.484631 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.484806 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] publish_errors = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.485043 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.485277 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.485485 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.485727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.485968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.486210 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] standard_threads = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.486443 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.486686 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.486886 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.487068 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] use_journal = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.487226 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] use_json = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.487406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] use_stderr = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.487566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] use_syslog = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.487802 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.488062 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.488303 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.488566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.488813 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.489066 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.489308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.489596 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.489836 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.490088 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.490336 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.490590 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.490825 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.491080 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.491321 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.491571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.491820 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.492061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.492319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.492577 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.492825 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.493066 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.493326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.493617 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.493874 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.494136 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.494373 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.494609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.494846 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.495087 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.495342 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.495594 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.495828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.496062 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.496312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.496560 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.496802 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.497055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.497289 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.497556 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.497796 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.498031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.498267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.498501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.498736 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.498976 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.499228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.499463 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.499705 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.499939 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.500180 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.500421 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.500673 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.500909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.501150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.501413 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.501657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.501899 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.502138 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.502374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.502706 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.502951 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.503194 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.503430 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.503694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.503937 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.504180 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.504419 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.504660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.504941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.505185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.505461 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.505713 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.505954 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.506195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.506435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.506686 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.506926 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.507168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.507414 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.507655 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.507908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.508148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.508384 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.508622 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.508861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.509101 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.509377 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.509607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.509865 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.510108 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.510349 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.510592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.510833 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.511069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.511310 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.511547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.511781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.512011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.512247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.512773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.513026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.513269 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.513549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.513795 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.514058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.514324 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.514573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.514810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] auth.external = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.515046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.515345 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.515579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.515817 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] auth.password = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.516056 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] auth.token = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.516300 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.516541 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.516788 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.517024 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.517272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.517552 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.517782 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.518019 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] credential.caching = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.518299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.518553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.518805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.519055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.519304 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.519542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.519793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.520047 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.520288 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.520545 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.520835 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.521086 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.521389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.521621 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.521878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.522119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] federation.caching = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.522359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.522609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.522858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.523089 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.523342 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.523580 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.523839 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.524077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.524338 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.524577 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.524828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.525069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] identity.caching = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.525318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.525596 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.525841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.526079 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.526329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.526564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.526805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.527059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.527315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.527773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.527773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.527995 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.528239 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.528488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.528736 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.529002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.529251 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.529564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.529809 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.530050 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.530285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.530522 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.530760 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.530997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.531242 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.531482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.531733 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.531970 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.532222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.532474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.532712 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.532960 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.533209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.533466 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.533707 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.533994 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.534241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.534481 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.534732 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.534973 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.535345 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.535600 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.535856 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.536096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.536331 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.536587 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.536842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.537084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.537522 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.537969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.538387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.538777 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.539049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.539288 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.539542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.539800 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.540057 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.540300 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.540536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.540775 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.541016 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.541258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.541517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.541768 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.542020 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.542272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.542522 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.542770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.543000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.543253 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.543493 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.543732 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.543970 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.544213 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.544463 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.544713 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.544952 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.545211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.545470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.545723 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.545963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.546202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.546442 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.546694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.546938 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.547174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.547414 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.547657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] resource.caching = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.547911 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.548161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.548401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.548652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.548910 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.549148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.549446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.549692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.549936 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.550176 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] role.caching = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.550425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] role.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.550656 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.550909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.551162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.551412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.551661 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.551910 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.552157 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.552406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.552659 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.552893 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.553145 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.553415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.553670 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.553920 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.554352 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.554591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.554846 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.555100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.555355 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.555599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.555838 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.556095 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.556348 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.556588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.556830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.557057 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.557293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.557575 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.557837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.558089 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.558332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.558571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.558807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.559046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] token.caching = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.559287 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.559538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.559776 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.560037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.560288 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.560527 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.560776 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.561017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.561268 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.561530 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.561777 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.562015 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.562266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.562543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.562780 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.563026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.563296 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.563556 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.connection = **** {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.564176 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.564425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.564667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.564910 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.565203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.565468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.565707 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.565942 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.566189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.566426 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.566671 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.566907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.567158 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.567396 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.567663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.567897 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.568141 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.568380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.568549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 23:37:32.598324 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.598554 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.598735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.607271 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.636239 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.636486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.692030 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.744117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.744378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.879441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:37:32.879441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: from cryptography.utils import int_from_bytes Sep 12 23:37:32.880106 dv-cinder-820027-26-smb devstack@keystone.service[87848]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:37:32.880106 dv-cinder-820027-26-smb devstack@keystone.service[87848]: from cryptography.utils import int_from_bytes Sep 12 23:37:32.907258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.907487 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.907715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.907937 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.908156 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.908375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.927679 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 23:37:32.927842 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 23:37:32.928057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] command line args: [] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 23:37:32.928328 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 23:37:32.928486 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ================================================================================ {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 23:37:32.928768 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] admin_token = **** {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.929017 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] config_dir = [] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.929180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.929378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] config_source = [] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.929547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] debug = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.929790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.930020 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.930211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.930595 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.930714 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.930910 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] list_limit = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.931131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] log_config_append = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.931308 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.931403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] log_dir = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.931580 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] log_file = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.931790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.932033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.932157 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.932287 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.932418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.932543 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.932686 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.932768 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.932842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.932922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.932996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.933078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.933152 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.933289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.933397 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.933556 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.933792 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.934020 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.934250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.934496 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.934738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.935010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.935512 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.935688 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] publish_errors = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.935916 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.936144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.936310 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.936550 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.936783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.937059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] standard_threads = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.937359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.937498 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.937674 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.937855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] use_journal = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.938022 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] use_json = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.938193 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] use_stderr = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.938365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] use_syslog = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.938595 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:37:32.939219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.939457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.939716 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.939975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.940234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.940473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.940722 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.940955 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.941202 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.941470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.941726 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.941958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.942257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.942466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.942729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.943015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.943195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.943450 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.943704 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.943953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.944187 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.944439 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.944703 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.944955 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.945117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.945298 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.945518 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.945681 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.945911 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.946147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.946396 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.946644 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.946873 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.947103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.947348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.947594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.947830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.948077 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.948308 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.948542 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.948786 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.949015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.949246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.949496 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.949729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.949966 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.950213 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.950443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.950683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.950912 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.951147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.951384 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.951633 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.951865 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.952102 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.952342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.952578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.952816 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.953052 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.953286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.953561 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.953798 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.954035 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.954266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.954525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.954763 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.954994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.955231 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.955471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.955847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.956087 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.956337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.956588 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.956823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.957058 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.957293 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.957566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.957810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.958041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.958202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.958288 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.958440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.958522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.958664 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.958748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.958886 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.958967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.959104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.959185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.959320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.959404 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.959540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:32.959648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.959841 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.960103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.960342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.960591 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.960831 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.961066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.961312 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.961567 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.961808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.962039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.962269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.962500 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.962730 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.962965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.963194 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.963434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.963668 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.963917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.964155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.964408 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.964665 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.964905 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.965137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] auth.external = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.965400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.965707 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.965934 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.966162 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] auth.password = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.966392 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] auth.token = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.966631 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.966866 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.967111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.967344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.967588 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.967835 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.968065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.968300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] credential.caching = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.968546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.968801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.969046 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.969299 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.969576 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.969819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.970063 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.970315 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.970551 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.970803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.971086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.971433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.971843 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.972167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.972507 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.972747 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] federation.caching = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.972989 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.973242 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.973522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.973763 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.974008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.974251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.974505 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.974742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.974998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.975236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.975493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.975728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] identity.caching = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.975976 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.976224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.976460 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.976698 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.976831 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:32.976937 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.977038 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 12 23:37:32.977143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.977409 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.977494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:32.977613 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 12 23:37:32.977694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.977889 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:32.977970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.978123 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.978205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:32.978354 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.978435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:32.978586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.978667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:32.978832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.979079 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.979325 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.979582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.979830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.980108 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.980345 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.980577 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.980807 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.981047 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.981270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.981529 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.981773 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.982008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.982255 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.982485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.982733 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.982986 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.983242 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.983488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.983734 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.983963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.984201 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.984432 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.984669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.984906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.985152 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.985420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.985661 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.985909 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.986157 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.986389 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.986619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.986918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.987180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.987415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.987651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.988066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.988300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.988403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:32.988543 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.988634 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:32.988803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.988885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:32.989036 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.989130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:32.989286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.989562 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.989811 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.990050 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.990282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.990519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.990755 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.990992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.991224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.991473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.991720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.991966 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.992214 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.992459 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.992691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.992934 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.993172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.993434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.993672 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.993910 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.994155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.994401 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.994638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.994892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.995122 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.995374 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.995610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.995846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.996083 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.996162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:32.996332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.996574 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.996805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.997043 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.997283 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] resource.caching = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.997563 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.997810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.998046 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.998294 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.998549 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.998783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.999011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:32.999102 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.999255 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.999335 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:32.999494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.999575 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:32.999731 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] role.caching = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:32.999842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:32.999977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] role.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.000131 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.000212 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.000399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.000480 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.000673 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.000756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.000918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.000998 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.001165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.001259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.001433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.001518 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.001682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.001792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.001927 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.002175 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.002407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.002719 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.002969 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.003216 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.003462 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.003895 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.004130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.004381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.004660 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.004877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.005129 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.005383 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.005643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.005896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.006136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.006367 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.006599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.006831 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.007083 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.007340 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.007584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.007821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.008064 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.008287 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.008525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] token.caching = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.008761 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.009004 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.009241 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.009523 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.009771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.010009 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.010251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.010493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.010738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.010975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.011214 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.011452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.011699 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.011987 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.012220 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.012460 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.012729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.012989 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.connection = **** {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.013238 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.013513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.013755 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.013998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.014234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.014472 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.014709 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.014945 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.015190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.015431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.015676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.015911 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.016158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.016394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.016639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.016868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.017127 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.017357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:37:33.017538 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87848) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 23:37:33.024605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.026137 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.026423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.031108 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.031395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.031682 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.038076 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.038364 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.042958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.043159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.043421 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.044244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.044546 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.044829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.045096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.045428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.045693 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.045968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.046243 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.051901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.061588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.061880 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.066192 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.069361 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.069672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.071059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.071277 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.074478 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.077108 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.080363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.080701 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.081004 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.081290 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.081668 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.081954 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.097703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.098004 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.098278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.098545 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.105356 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.107320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.108848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.109151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.109612 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.111806 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.112161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.112457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.112746 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.113135 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.124635 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.124932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.125216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.125529 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.125917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.126204 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.126505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.141778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.144597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.144730 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.144800 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.147567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.149005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.150490 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.150755 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.151184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.157510 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.159008 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.161939 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.162335 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.162603 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.162903 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.170644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.170935 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.171230 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.178286 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.178590 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.178878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.179158 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.179453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.179719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.180025 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.180295 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.180570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.180843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.181125 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.181520 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.182021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.182336 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.217374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ad58c049c0 pid: 87847 (default app) Sep 12 23:37:33.221425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f69105-b0cd-4097-9235-23801fa3b373 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:33.221705 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f69105-b0cd-4097-9235-23801fa3b373 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:33.221991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f69105-b0cd-4097-9235-23801fa3b373 None None] PATH_INFO: `/v3` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:33.226452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Mon Sep 12 23:37:33 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:37:33.277712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.277945 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.278147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.278343 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.278594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.278799 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.291471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.291672 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.291923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.292147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.292361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.292553 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.292789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.300719 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.303849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.304079 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.304304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.304519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.304709 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.304954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.305162 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87848) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 12 23:37:33.316085 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.316393 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 12 23:37:33.316712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.316860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 12 23:37:33.317162 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.317308 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.317806 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.318002 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.332975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.332975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.332975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.332975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.335613 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.339030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.339030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.339186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.339487 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.339778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.340041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.340338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.340583 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.340860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.341133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.341641 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.364797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.366346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.366636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.371407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.371690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.371971 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.378525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.378815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.383205 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.383518 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.383823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.384094 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.384376 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.386855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.387146 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.387436 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.403507 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.403693 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.407513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.410679 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.410978 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.415248 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.418377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.421585 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.422059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.422417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.422823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.423117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.423401 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.439414 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.439712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.440007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.440280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.446937 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.448607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.450153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.450410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.453045 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.453332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.453641 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.453925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.454196 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.465428 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.465725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.466029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.466313 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.466597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.466866 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.467140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.482242 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.485236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.488184 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.489633 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.491076 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.491351 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.491650 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.498129 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.499579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.502402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.502722 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.502992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.503306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.511108 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.511403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.511684 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.518503 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87848) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 12 23:37:33.518790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.519076 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.519357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.519636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.519920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.520197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.520478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.520738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.521017 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.521292 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.521609 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.521862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.522136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87848) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 12 23:37:33.555527 dv-cinder-820027-26-smb devstack@keystone.service[87848]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ad58c049c0 pid: 87848 (default app) Sep 12 23:37:40.022631 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476945c0-b684-4f2d-bc78-b31e561a5b39 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:40.023201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476945c0-b684-4f2d-bc78-b31e561a5b39 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:40.023201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476945c0-b684-4f2d-bc78-b31e561a5b39 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:40.024500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:37:40.032222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426100f-f034-4a1c-8438-3f08586d8859 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:40.032793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426100f-f034-4a1c-8438-3f08586d8859 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:40.032793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426100f-f034-4a1c-8438-3f08586d8859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:40.102710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: INFO dbcounter [None req-4426100f-f034-4a1c-8438-3f08586d8859 None None] Registered counter for database keystone Sep 12 23:37:40.122261 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG oslo_db.sqlalchemy.engines [None req-4426100f-f034-4a1c-8438-3f08586d8859 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87848) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:37:40.129829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writer thread running {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:37:40.310597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG passlib.handlers.bcrypt [None req-4426100f-f034-4a1c-8438-3f08586d8859 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87848) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 12 23:37:40.310888 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG passlib.handlers.bcrypt [None req-4426100f-f034-4a1c-8438-3f08586d8859 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87848) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 12 23:37:40.369496 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-4426100f-f034-4a1c-8438-3f08586d8859 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:40.371127 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4426100f-f034-4a1c-8438-3f08586d8859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:40.507377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1/3] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:37:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 12 23:37:40.809235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476945c0-b684-4f2d-bc78-b31e561a5b39 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:40.881877 dv-cinder-820027-26-smb devstack@keystone.service[87847]: INFO dbcounter [None req-476945c0-b684-4f2d-bc78-b31e561a5b39 None None] Registered counter for database keystone Sep 12 23:37:40.905271 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG oslo_db.sqlalchemy.engines [None req-476945c0-b684-4f2d-bc78-b31e561a5b39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:37:40.912739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writer thread running {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:37:41.033720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476945c0-b684-4f2d-bc78-b31e561a5b39 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:41.038536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1608ad-272b-463e-8ee6-f2b1cbdb002a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:41.039177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1608ad-272b-463e-8ee6-f2b1cbdb002a admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:41.039452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1608ad-272b-463e-8ee6-f2b1cbdb002a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:41.039724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1608ad-272b-463e-8ee6-f2b1cbdb002a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:41.048525 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1608ad-272b-463e-8ee6-f2b1cbdb002a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:41.102783 dv-cinder-820027-26-smb devstack@keystone.service[87847]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6d1608ad-272b-463e-8ee6-f2b1cbdb002a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 12 23:37:41.103299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1608ad-272b-463e-8ee6-f2b1cbdb002a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:41.114544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 3/4] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Sep 12 23:37:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 12 23:37:41.121675 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426100f-f034-4a1c-8438-3f08586d8859 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:41.140171 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426100f-f034-4a1c-8438-3f08586d8859 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:41.146085 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c935d6-1604-41c6-9011-2f82de33064b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:41.147379 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c935d6-1604-41c6-9011-2f82de33064b admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:41.147677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c935d6-1604-41c6-9011-2f82de33064b admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:41.147958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c935d6-1604-41c6-9011-2f82de33064b admin admin] PATH_INFO: `/v3/projects/7f4013b4b7a749e88ad00a53390dd085` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:41.149615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c935d6-1604-41c6-9011-2f82de33064b admin admin] RBAC: Authorizing `identity:get_project(project_id=7f4013b4b7a749e88ad00a53390dd085)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:41.202078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: WARNING keystone.common.rbac_enforcer.enforcer [None req-28c935d6-1604-41c6-9011-2f82de33064b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 12 23:37:41.202394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c935d6-1604-41c6-9011-2f82de33064b admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:41.207416 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 2/5] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Sep 12 23:37:41 2022] GET /identity/v3/projects/7f4013b4b7a749e88ad00a53390dd085 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:37:43.315751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8b392-b346-4b7c-b513-eb518c2185a4 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:43.316357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8b392-b346-4b7c-b513-eb518c2185a4 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:43.316357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8b392-b346-4b7c-b513-eb518c2185a4 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:43.320607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 4/6] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:37:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:37:43.328149 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27018802-0cb3-41cd-bca5-2766cd4adcaf None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:43.328990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27018802-0cb3-41cd-bca5-2766cd4adcaf None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:43.328990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27018802-0cb3-41cd-bca5-2766cd4adcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:43.352020 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-27018802-0cb3-41cd-bca5-2766cd4adcaf None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:43.353729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-27018802-0cb3-41cd-bca5-2766cd4adcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:43.363566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 3/7] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:37:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 12 23:37:43.625927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8b392-b346-4b7c-b513-eb518c2185a4 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:43.640039 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8b392-b346-4b7c-b513-eb518c2185a4 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:43.644552 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f63b7-3297-4cf7-8b95-9f8c8760212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:43.645167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f63b7-3297-4cf7-8b95-9f8c8760212b admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:43.645470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f63b7-3297-4cf7-8b95-9f8c8760212b admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:43.645747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f63b7-3297-4cf7-8b95-9f8c8760212b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:43.654186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f63b7-3297-4cf7-8b95-9f8c8760212b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:43.655975 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f63b7-3297-4cf7-8b95-9f8c8760212b admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:43.665409 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 5/8] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Sep 12 23:37:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:37:43.671354 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27018802-0cb3-41cd-bca5-2766cd4adcaf None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:43.681153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27018802-0cb3-41cd-bca5-2766cd4adcaf None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:43.686862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65cc60-4246-4f43-b6bf-8ef42a0a7b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:43.687503 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65cc60-4246-4f43-b6bf-8ef42a0a7b2c admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:43.687778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65cc60-4246-4f43-b6bf-8ef42a0a7b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:43.688042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65cc60-4246-4f43-b6bf-8ef42a0a7b2c admin admin] PATH_INFO: `/v3/users/5b7b370e89cd4d279855f8c68c6540e2` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:43.689972 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65cc60-4246-4f43-b6bf-8ef42a0a7b2c admin admin] RBAC: Authorizing `identity:get_user(user_id=5b7b370e89cd4d279855f8c68c6540e2)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:43.691894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65cc60-4246-4f43-b6bf-8ef42a0a7b2c admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:43.693547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 4/9] 10.222.0.23 () {56 vars in 1198 bytes} [Mon Sep 12 23:37:43 2022] GET /identity/v3/users/5b7b370e89cd4d279855f8c68c6540e2 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:37:45.962361 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09acd8-157a-48f3-96dc-fbf703439631 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:45.963003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09acd8-157a-48f3-96dc-fbf703439631 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:45.963003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09acd8-157a-48f3-96dc-fbf703439631 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:45.964227 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:37:45.970027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df840b2c-84d7-42ed-b281-82f02dc91745 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:45.970501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df840b2c-84d7-42ed-b281-82f02dc91745 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:45.970601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df840b2c-84d7-42ed-b281-82f02dc91745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:45.971432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255e793-4577-4378-a973-29582bed0483 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:45.971939 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255e793-4577-4378-a973-29582bed0483 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:45.972428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255e793-4577-4378-a973-29582bed0483 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:45.974891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 7/11] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:37:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:37:45.983122 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d87cf4-7335-427d-96ce-36e086cd5ec6 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:45.983620 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d87cf4-7335-427d-96ce-36e086cd5ec6 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:45.984110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d87cf4-7335-427d-96ce-36e086cd5ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:45.989808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-df840b2c-84d7-42ed-b281-82f02dc91745 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:45.991014 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-df840b2c-84d7-42ed-b281-82f02dc91745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:46.058874 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG passlib.handlers.bcrypt [None req-d3d87cf4-7335-427d-96ce-36e086cd5ec6 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87847) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 12 23:37:46.059413 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG passlib.handlers.bcrypt [None req-d3d87cf4-7335-427d-96ce-36e086cd5ec6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87847) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 12 23:37:46.083423 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 5/12] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:37:46.110390 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-d3d87cf4-7335-427d-96ce-36e086cd5ec6 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:46.112037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d3d87cf4-7335-427d-96ce-36e086cd5ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:46.241599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 8/13] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:37:46.352462 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df840b2c-84d7-42ed-b281-82f02dc91745 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:46.382716 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:46.473652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df840b2c-84d7-42ed-b281-82f02dc91745 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:46.506282 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d87cf4-7335-427d-96ce-36e086cd5ec6 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:46.509271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a669d-40a3-48fc-b044-d195eb5a8d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:46.509983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a669d-40a3-48fc-b044-d195eb5a8d68 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:46.510263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a669d-40a3-48fc-b044-d195eb5a8d68 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:46.510535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a669d-40a3-48fc-b044-d195eb5a8d68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:46.523105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a669d-40a3-48fc-b044-d195eb5a8d68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:37:46.532099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-bc2a669d-40a3-48fc-b044-d195eb5a8d68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:37:46.532099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:37:46.532099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:37:46.532099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:37:46.532099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:37:46.532099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:37:46.532099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:37:46.532099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:37:46.532099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:37:46.532099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:37:46.532099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:37:46.532099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:37:46.532099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:37:46.532099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:37:46.532099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:37:46.532099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:37:46.533691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:37:46.533691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:37:46.533691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:37:46.533691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:37:46.533691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:37:46.533691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:37:46.533691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:37:46.533691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:37:46.533691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:37:46.533691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:37:46.533691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:37:46.533691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:37:46.533691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:37:46.533691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:37:46.533691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:37:46.533691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:37:46.534531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:37:46.534531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:37:46.534531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:37:46.534531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:37:46.534531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:37:46.534531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:37:46.534531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:37:46.534531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:37:46.534531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:37:46.534531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:37:46.534531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:37:46.534531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:37:46.534531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 6/14] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:37:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:37:46.539549 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a669d-40a3-48fc-b044-d195eb5a8d68 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:46.619089 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d87cf4-7335-427d-96ce-36e086cd5ec6 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:46.621670 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:46.631160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:46.654504 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a669d-40a3-48fc-b044-d195eb5a8d68 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:46.660242 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c71bc-f4d2-4671-be97-82680966f23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:46.661149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c71bc-f4d2-4671-be97-82680966f23d None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:46.661465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c71bc-f4d2-4671-be97-82680966f23d None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:46.661737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c71bc-f4d2-4671-be97-82680966f23d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:46.693513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da9709-1ed3-45d1-9c46-33f873dc3ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:46.694121 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da9709-1ed3-45d1-9c46-33f873dc3ded None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:46.694399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da9709-1ed3-45d1-9c46-33f873dc3ded None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:46.694671 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da9709-1ed3-45d1-9c46-33f873dc3ded None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:46.695347 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da9709-1ed3-45d1-9c46-33f873dc3ded None admin] RBAC: Adding query filter params (name=admin) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:37:46.695646 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da9709-1ed3-45d1-9c46-33f873dc3ded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:46.697445 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da9709-1ed3-45d1-9c46-33f873dc3ded None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:46.711882 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 7/15] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:37:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:37:46.717987 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da9709-1ed3-45d1-9c46-33f873dc3ded None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:46.753649 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c71bc-f4d2-4671-be97-82680966f23d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:46.756229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c71bc-f4d2-4671-be97-82680966f23d None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:46.851216 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da9709-1ed3-45d1-9c46-33f873dc3ded None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:46.893562 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae77691-e1a5-419e-8a10-2c0f8eaf6385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:46.894243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77691-e1a5-419e-8a10-2c0f8eaf6385 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:46.894521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77691-e1a5-419e-8a10-2c0f8eaf6385 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:46.894801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77691-e1a5-419e-8a10-2c0f8eaf6385 None admin] PATH_INFO: `/v3/users/5b7b370e89cd4d279855f8c68c6540e2` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:46.895924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 9/16] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:37:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 23:37:46.897501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae77691-e1a5-419e-8a10-2c0f8eaf6385 None admin] RBAC: Authorizing `identity:get_user(user_id=5b7b370e89cd4d279855f8c68c6540e2)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:46.897749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae77691-e1a5-419e-8a10-2c0f8eaf6385 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:46.899426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 8/17] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:37:46 2022] GET /identity/v3/users/5b7b370e89cd4d279855f8c68c6540e2 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:37:46.902022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c71bc-f4d2-4671-be97-82680966f23d None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:46.905444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae77691-e1a5-419e-8a10-2c0f8eaf6385 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:46.905666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:46.923497 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:47.027851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae77691-e1a5-419e-8a10-2c0f8eaf6385 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:47.032048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c71bc-f4d2-4671-be97-82680966f23d None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:47.070134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7bb98-0199-4dbf-9c98-a0435b547bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:47.071028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7bb98-0199-4dbf-9c98-a0435b547bf7 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:47.071421 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7bb98-0199-4dbf-9c98-a0435b547bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:47.071853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7bb98-0199-4dbf-9c98-a0435b547bf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:47.072216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7e3e1-8ea4-4c3f-b23f-0c22ec9b0087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:47.073098 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7e3e1-8ea4-4c3f-b23f-0c22ec9b0087 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:47.073407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7e3e1-8ea4-4c3f-b23f-0c22ec9b0087 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:47.073659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7bb98-0199-4dbf-9c98-a0435b547bf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:47.073798 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7e3e1-8ea4-4c3f-b23f-0c22ec9b0087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:47.076570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7bb98-0199-4dbf-9c98-a0435b547bf7 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:47.079439 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:37:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:37:47.088069 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7bb98-0199-4dbf-9c98-a0435b547bf7 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:47.096131 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7e3e1-8ea4-4c3f-b23f-0c22ec9b0087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:47.097797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7e3e1-8ea4-4c3f-b23f-0c22ec9b0087 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:47.117508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-0af7e3e1-8ea4-4c3f-b23f-0c22ec9b0087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:37:47.117508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:37:47.117508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:37:47.117508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:37:47.117508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:37:47.117508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:37:47.117508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:37:47.117508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:37:47.117508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:37:47.117508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:37:47.117508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:37:47.117508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:37:47.117508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:37:47.117508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:37:47.117508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:37:47.117508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:37:47.118412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:37:47.118412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:37:47.118412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:37:47.118412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:37:47.118412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:37:47.118412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:37:47.118412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:37:47.118412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:37:47.118412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:37:47.118412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:37:47.118412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:37:47.118412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:37:47.118412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:37:47.118412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:37:47.118412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:37:47.118412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:37:47.118412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:37:47.119199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:37:47.119199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:37:47.119199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:37:47.119199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:37:47.124994 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7e3e1-8ea4-4c3f-b23f-0c22ec9b0087 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:47.196634 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:47.197087 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:47.221982 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7bb98-0199-4dbf-9c98-a0435b547bf7 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:47.251466 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7e3e1-8ea4-4c3f-b23f-0c22ec9b0087 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:47.261518 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c68174-4a1b-404a-941a-6bd3aed23761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:47.262445 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c68174-4a1b-404a-941a-6bd3aed23761 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:47.262920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c68174-4a1b-404a-941a-6bd3aed23761 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:47.263253 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c68174-4a1b-404a-941a-6bd3aed23761 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:47.264300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c68174-4a1b-404a-941a-6bd3aed23761 None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.domain.id=default, user.id=5b7b370e89cd4d279855f8c68c6540e2) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:37:47.264742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c68174-4a1b-404a-941a-6bd3aed23761 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:47.266493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c68174-4a1b-404a-941a-6bd3aed23761 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:47.275894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Sep 12 23:37:47 2022] GET /identity/v3/role_assignments?user.id=5b7b370e89cd4d279855f8c68c6540e2&scope.domain.id=default&role.id=440092230f024959a90e846ab29c6367 => generated 233 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:37:47.289779 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486bdb8-e633-455d-ab8e-74b7ec099013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:47.290421 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486bdb8-e633-455d-ab8e-74b7ec099013 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:47.290702 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486bdb8-e633-455d-ab8e-74b7ec099013 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:47.290973 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486bdb8-e633-455d-ab8e-74b7ec099013 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:47.291675 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486bdb8-e633-455d-ab8e-74b7ec099013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:37:47.291973 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486bdb8-e633-455d-ab8e-74b7ec099013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:47.293497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486bdb8-e633-455d-ab8e-74b7ec099013 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:47.315664 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 11/21] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:37:50.022286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560891fc-dd05-48c6-a9b0-fe47824e54ae None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:50.022996 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560891fc-dd05-48c6-a9b0-fe47824e54ae None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:50.022996 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560891fc-dd05-48c6-a9b0-fe47824e54ae None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:50.024475 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:37:50.033192 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12227e7f-333e-4142-87d5-698511cf0096 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:50.033949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12227e7f-333e-4142-87d5-698511cf0096 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:50.034239 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12227e7f-333e-4142-87d5-698511cf0096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:50.086923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-12227e7f-333e-4142-87d5-698511cf0096 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:50.088969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-12227e7f-333e-4142-87d5-698511cf0096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:50.253037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:37:51.232117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560891fc-dd05-48c6-a9b0-fe47824e54ae None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:51.419960 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03138032-b4a8-4a3c-ab78-b0f1e79ec1e7 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:51.421483 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03138032-b4a8-4a3c-ab78-b0f1e79ec1e7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:51.422325 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03138032-b4a8-4a3c-ab78-b0f1e79ec1e7 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:51.425800 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:37:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:37:51.440153 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4204e53-fdec-4230-850b-3e2926febe05 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:51.440923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4204e53-fdec-4230-850b-3e2926febe05 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:51.441664 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4204e53-fdec-4230-850b-3e2926febe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:51.483972 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560891fc-dd05-48c6-a9b0-fe47824e54ae None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:51.503257 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-a4204e53-fdec-4230-850b-3e2926febe05 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:51.506063 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a4204e53-fdec-4230-850b-3e2926febe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:51.617386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7d8cd-3d33-4060-89e1-9b814dfa7dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:51.617386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7d8cd-3d33-4060-89e1-9b814dfa7dbf None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:51.617386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7d8cd-3d33-4060-89e1-9b814dfa7dbf None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:51.617386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7d8cd-3d33-4060-89e1-9b814dfa7dbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:51.649484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7d8cd-3d33-4060-89e1-9b814dfa7dbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:37:51.673380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-e8c7d8cd-3d33-4060-89e1-9b814dfa7dbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:37:51.673380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:37:51.673380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:37:51.673380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:37:51.673380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:37:51.673380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:37:51.673380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:37:51.673380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:37:51.673380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:37:51.673380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:37:51.673380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:37:51.673380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:37:51.673380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:37:51.673380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:37:51.673380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:37:51.673380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:37:51.675103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:37:51.675103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:37:51.675103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:37:51.675103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:37:51.675103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:37:51.675103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:37:51.675103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:37:51.675103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:37:51.675103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:37:51.675103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:37:51.675103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:37:51.675103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:37:51.675103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:37:51.675103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:37:51.675103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:37:51.675103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:37:51.676566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:37:51.676566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:37:51.676566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:37:51.676566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:37:51.676566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:37:51.676566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:37:51.676566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:37:51.676566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:37:51.676566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:37:51.676566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:37:51.676566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:37:51.676566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:37:51.676566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 12/25] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:37:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:37:51.684537 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7d8cd-3d33-4060-89e1-9b814dfa7dbf None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:51.686098 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:51.703752 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:51.778536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 14/26] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:37:51.789125 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6789d9-5274-4c32-b88a-a6c5d34d1363 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:51.789621 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6789d9-5274-4c32-b88a-a6c5d34d1363 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:51.790106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6789d9-5274-4c32-b88a-a6c5d34d1363 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:51.792599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 15/27] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:37:51 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:37:51.808879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd4ae5-9bfa-46e3-9a48-9d64a5c31430 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:51.809334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd4ae5-9bfa-46e3-9a48-9d64a5c31430 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:51.809841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd4ae5-9bfa-46e3-9a48-9d64a5c31430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:51.897485 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-5ecd4ae5-9bfa-46e3-9a48-9d64a5c31430 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:51.899605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5ecd4ae5-9bfa-46e3-9a48-9d64a5c31430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:52.063814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7d8cd-3d33-4060-89e1-9b814dfa7dbf None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:52.155570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 16/28] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:37:52.157000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bafb5-7b10-4a5c-a9b2-e949374b79e2 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:52.157293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bafb5-7b10-4a5c-a9b2-e949374b79e2 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:52.157596 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bafb5-7b10-4a5c-a9b2-e949374b79e2 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:52.159745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 17/29] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:37:52.171071 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a87a0e-ee29-483b-b7dd-25cce1aeb6b5 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:52.171498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a87a0e-ee29-483b-b7dd-25cce1aeb6b5 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:52.171635 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a87a0e-ee29-483b-b7dd-25cce1aeb6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:52.208786 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb5e1f-eb67-420d-bbbc-35f7a0603831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:52.209512 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb5e1f-eb67-420d-bbbc-35f7a0603831 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:52.209791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb5e1f-eb67-420d-bbbc-35f7a0603831 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:52.210062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb5e1f-eb67-420d-bbbc-35f7a0603831 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:52.211562 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb5e1f-eb67-420d-bbbc-35f7a0603831 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:37:52.211871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb5e1f-eb67-420d-bbbc-35f7a0603831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:52.213358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb5e1f-eb67-420d-bbbc-35f7a0603831 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:52.226947 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-25a87a0e-ee29-483b-b7dd-25cce1aeb6b5 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:52.230274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-25a87a0e-ee29-483b-b7dd-25cce1aeb6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:52.243546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 13/30] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:37:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 561 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:37:52.254485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb5e1f-eb67-420d-bbbc-35f7a0603831 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:52.415670 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:52.439910 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 18/31] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:37:52.485744 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a87a0e-ee29-483b-b7dd-25cce1aeb6b5 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:52.492219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb5e1f-eb67-420d-bbbc-35f7a0603831 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:52.546078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:52.570384 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d4a88-3f8e-4be4-ac88-3036419fe800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:52.571052 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d4a88-3f8e-4be4-ac88-3036419fe800 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:52.571336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d4a88-3f8e-4be4-ac88-3036419fe800 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:52.571586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d4a88-3f8e-4be4-ac88-3036419fe800 None admin] PATH_INFO: `/v3/users/5b7b370e89cd4d279855f8c68c6540e2` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:52.572879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d4a88-3f8e-4be4-ac88-3036419fe800 None admin] RBAC: Authorizing `identity:get_user(user_id=5b7b370e89cd4d279855f8c68c6540e2)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:52.574468 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d4a88-3f8e-4be4-ac88-3036419fe800 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:52.576243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 14/32] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:37:52 2022] GET /identity/v3/users/5b7b370e89cd4d279855f8c68c6540e2 => generated 247 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:37:52.577101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d4a88-3f8e-4be4-ac88-3036419fe800 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:52.635780 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a87a0e-ee29-483b-b7dd-25cce1aeb6b5 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:52.678821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb004f-63d9-42b2-a9d4-1672eaed9e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:52.679384 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb004f-63d9-42b2-a9d4-1672eaed9e22 None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:52.679665 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb004f-63d9-42b2-a9d4-1672eaed9e22 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:52.679938 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb004f-63d9-42b2-a9d4-1672eaed9e22 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:52.680685 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb004f-63d9-42b2-a9d4-1672eaed9e22 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:52.682368 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb004f-63d9-42b2-a9d4-1672eaed9e22 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:52.753805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d4a88-3f8e-4be4-ac88-3036419fe800 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:52.812157 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19119c-d1fb-4632-aa9c-f4da1d0be019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:52.813154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19119c-d1fb-4632-aa9c-f4da1d0be019 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:52.813963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19119c-d1fb-4632-aa9c-f4da1d0be019 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:52.814360 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19119c-d1fb-4632-aa9c-f4da1d0be019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:52.829740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:52.833061 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19119c-d1fb-4632-aa9c-f4da1d0be019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:52.837442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19119c-d1fb-4632-aa9c-f4da1d0be019 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:52.875964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-5f19119c-d1fb-4632-aa9c-f4da1d0be019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:37:52.875964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:37:52.875964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:37:52.875964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:37:52.875964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:37:52.875964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:37:52.875964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:37:52.875964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:37:52.875964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:37:52.875964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:37:52.875964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:37:52.875964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:37:52.875964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:37:52.875964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:37:52.875964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:37:52.875964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:37:52.876985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:37:52.876985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:37:52.876985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:37:52.876985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:37:52.876985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:37:52.876985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:37:52.876985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:37:52.876985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:37:52.876985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:37:52.876985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:37:52.876985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:37:52.876985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:37:52.876985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:37:52.876985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:37:52.876985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:37:52.876985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:37:52.876985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:37:52.877954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:37:52.877954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:37:52.877954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:37:52.879636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 15/33] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:37:52.880658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19119c-d1fb-4632-aa9c-f4da1d0be019 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:52.943840 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 19/34] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Sep 12 23:37:52 2022] POST /identity/v3/roles => generated 219 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:37:52.945543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb004f-63d9-42b2-a9d4-1672eaed9e22 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:53.089356 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19119c-d1fb-4632-aa9c-f4da1d0be019 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:53.119201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:53.130048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb004f-63d9-42b2-a9d4-1672eaed9e22 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:53.137711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d82eeb-bda2-449d-8712-2d78fb7e1c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:53.138375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d82eeb-bda2-449d-8712-2d78fb7e1c19 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:53.138659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d82eeb-bda2-449d-8712-2d78fb7e1c19 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:53.138929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d82eeb-bda2-449d-8712-2d78fb7e1c19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:53.140234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d82eeb-bda2-449d-8712-2d78fb7e1c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:53.142896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d82eeb-bda2-449d-8712-2d78fb7e1c19 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:53.145387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 16/35] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:37:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:37:53.146256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d82eeb-bda2-449d-8712-2d78fb7e1c19 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:53.179818 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1acb9-b225-4c75-b0ea-b2e0be6431ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:53.180470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1acb9-b225-4c75-b0ea-b2e0be6431ab None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:53.180751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1acb9-b225-4c75-b0ea-b2e0be6431ab None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:53.181019 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1acb9-b225-4c75-b0ea-b2e0be6431ab None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:53.181741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1acb9-b225-4c75-b0ea-b2e0be6431ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:37:53.182049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1acb9-b225-4c75-b0ea-b2e0be6431ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:53.183653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1acb9-b225-4c75-b0ea-b2e0be6431ab None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:53.204088 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 20/36] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:37:53.204088 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9024fa-fa2d-45cd-83e1-7718a8583e87 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:53.204088 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9024fa-fa2d-45cd-83e1-7718a8583e87 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:53.204088 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9024fa-fa2d-45cd-83e1-7718a8583e87 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:53.204088 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 21/37] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:37:53.204088 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6f9f6-3b41-4cbf-a6f1-b4b26367c6d8 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:53.204088 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6f9f6-3b41-4cbf-a6f1-b4b26367c6d8 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:53.204603 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6f9f6-3b41-4cbf-a6f1-b4b26367c6d8 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:53.204603 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 22/38] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:37:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:37:53.205791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6f9f6-3b41-4cbf-a6f1-b4b26367c6d8 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:53.229608 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:53.281731 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d82eeb-bda2-449d-8712-2d78fb7e1c19 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:53.316912 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601efa32-89eb-4ce2-9e92-573f1b6fc163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:53.317563 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601efa32-89eb-4ce2-9e92-573f1b6fc163 None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:53.317844 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601efa32-89eb-4ce2-9e92-573f1b6fc163 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:53.318503 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601efa32-89eb-4ce2-9e92-573f1b6fc163 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:53.318800 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601efa32-89eb-4ce2-9e92-573f1b6fc163 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:53.320212 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601efa32-89eb-4ce2-9e92-573f1b6fc163 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:53.332981 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6f9f6-3b41-4cbf-a6f1-b4b26367c6d8 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:53.368879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c425d-8211-46fd-ad6f-6f0812d1a3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:53.369649 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c425d-8211-46fd-ad6f-6f0812d1a3cf None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:53.369934 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c425d-8211-46fd-ad6f-6f0812d1a3cf None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:53.370216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c425d-8211-46fd-ad6f-6f0812d1a3cf None admin] PATH_INFO: `/v3/domains/default/users/5b7b370e89cd4d279855f8c68c6540e2/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:53.372787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c425d-8211-46fd-ad6f-6f0812d1a3cf None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5b7b370e89cd4d279855f8c68c6540e2, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:53.374293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c425d-8211-46fd-ad6f-6f0812d1a3cf None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:53.390047 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 23/39] 10.222.0.23 () {58 vars in 1361 bytes} [Mon Sep 12 23:37:53 2022] PUT /identity/v3/domains/default/users/5b7b370e89cd4d279855f8c68c6540e2/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:37:53.390945 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c425d-8211-46fd-ad6f-6f0812d1a3cf None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:53.415349 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:53.445412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 17/40] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Sep 12 23:37:53 2022] POST /identity/v3/roles => generated 225 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:53.445412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c774dd5-0c77-45a9-afb2-6c28bf32d8fa None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:53.445412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c774dd5-0c77-45a9-afb2-6c28bf32d8fa None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:53.445412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c774dd5-0c77-45a9-afb2-6c28bf32d8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:53.554933 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c425d-8211-46fd-ad6f-6f0812d1a3cf None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:53.584290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-3c774dd5-0c77-45a9-afb2-6c28bf32d8fa None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:53.586046 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-3c774dd5-0c77-45a9-afb2-6c28bf32d8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:53.603967 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594298cf-967c-4c97-be9c-5abb4bac3814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:53.605042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594298cf-967c-4c97-be9c-5abb4bac3814 None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:53.605526 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594298cf-967c-4c97-be9c-5abb4bac3814 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:53.606092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594298cf-967c-4c97-be9c-5abb4bac3814 None admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:53.606972 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594298cf-967c-4c97-be9c-5abb4bac3814 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:53.608477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594298cf-967c-4c97-be9c-5abb4bac3814 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:53.653327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 24/41] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 23:37:53 2022] POST /identity/v3/projects => generated 301 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:53.654637 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca1d5a-2077-4568-b4a8-ffa80dcb097e None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:53.654927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca1d5a-2077-4568-b4a8-ffa80dcb097e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:53.655256 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca1d5a-2077-4568-b4a8-ffa80dcb097e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:53.676452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-91ca1d5a-2077-4568-b4a8-ffa80dcb097e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:53.678058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-91ca1d5a-2077-4568-b4a8-ffa80dcb097e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:53.700108 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 18/42] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:37:53.776399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:53.782434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 25/43] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:37:54.015763 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c774dd5-0c77-45a9-afb2-6c28bf32d8fa None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:54.066367 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:54.068933 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca1d5a-2077-4568-b4a8-ffa80dcb097e None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:54.128620 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c774dd5-0c77-45a9-afb2-6c28bf32d8fa None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:54.167457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf2cf0-2178-4aa2-9b57-8949085c822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:54.168092 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf2cf0-2178-4aa2-9b57-8949085c822e None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:54.168370 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf2cf0-2178-4aa2-9b57-8949085c822e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:54.168646 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf2cf0-2178-4aa2-9b57-8949085c822e None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:54.169326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf2cf0-2178-4aa2-9b57-8949085c822e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:54.170899 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf2cf0-2178-4aa2-9b57-8949085c822e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:54.179025 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca1d5a-2077-4568-b4a8-ffa80dcb097e None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:54.189165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 19/44] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Sep 12 23:37:54 2022] POST /identity/v3/roles => generated 223 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:54.233324 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60285e58-a7c9-40ea-a56a-724ded2e1bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:54.234017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60285e58-a7c9-40ea-a56a-724ded2e1bb1 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:54.234307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60285e58-a7c9-40ea-a56a-724ded2e1bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:54.234579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60285e58-a7c9-40ea-a56a-724ded2e1bb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:54.236198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60285e58-a7c9-40ea-a56a-724ded2e1bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:54.238361 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60285e58-a7c9-40ea-a56a-724ded2e1bb1 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:54.240341 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 26/45] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:37:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:37:54.246038 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf2cf0-2178-4aa2-9b57-8949085c822e None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:54.368032 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf2cf0-2178-4aa2-9b57-8949085c822e None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:54.370979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:54.413127 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac24956-0d7e-4ae8-b58b-91b808d92e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:54.413806 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac24956-0d7e-4ae8-b58b-91b808d92e5f None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:54.414089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac24956-0d7e-4ae8-b58b-91b808d92e5f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:54.414363 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac24956-0d7e-4ae8-b58b-91b808d92e5f None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:54.415062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac24956-0d7e-4ae8-b58b-91b808d92e5f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:54.416561 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac24956-0d7e-4ae8-b58b-91b808d92e5f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:54.450835 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 20/46] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 23:37:54 2022] POST /identity/v3/projects => generated 312 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:55.645234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64149bdc-2736-412b-bf21-e542bff50953 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:55.645845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64149bdc-2736-412b-bf21-e542bff50953 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:55.646256 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64149bdc-2736-412b-bf21-e542bff50953 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:55.649093 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 27/47] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:37:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:37:55.654878 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2d3d2-fb12-4343-ba92-1f404fa6cbc4 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:55.655336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2d3d2-fb12-4343-ba92-1f404fa6cbc4 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:55.655420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2d3d2-fb12-4343-ba92-1f404fa6cbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:55.676410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-2fa2d3d2-fb12-4343-ba92-1f404fa6cbc4 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:55.677648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-2fa2d3d2-fb12-4343-ba92-1f404fa6cbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:55.754272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 21/48] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:37:56.021759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64149bdc-2736-412b-bf21-e542bff50953 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:56.099967 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:56.142837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64149bdc-2736-412b-bf21-e542bff50953 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:56.184781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c08ef1-4882-4259-9def-9c19cd34e23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:56.185475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c08ef1-4882-4259-9def-9c19cd34e23f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:56.185759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c08ef1-4882-4259-9def-9c19cd34e23f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:56.186034 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c08ef1-4882-4259-9def-9c19cd34e23f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:56.199323 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c08ef1-4882-4259-9def-9c19cd34e23f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:37:56.205968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-88c08ef1-4882-4259-9def-9c19cd34e23f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:37:56.205968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:37:56.205968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:37:56.205968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:37:56.205968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:37:56.205968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:37:56.205968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:37:56.205968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:37:56.205968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:37:56.205968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:37:56.205968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:37:56.205968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:37:56.205968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:37:56.205968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:37:56.205968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:37:56.205968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:37:56.206980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:37:56.206980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:37:56.206980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:37:56.206980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:37:56.206980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:37:56.206980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:37:56.206980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:37:56.206980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:37:56.206980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:37:56.206980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:37:56.206980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:37:56.206980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:37:56.206980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:37:56.206980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:37:56.206980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:37:56.206980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:37:56.207715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:37:56.207715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:37:56.207715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:37:56.207715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:37:56.207715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:37:56.207715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:37:56.207715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:37:56.207715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:37:56.207715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:37:56.207715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:37:56.207715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:37:56.207715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:37:56.207715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 28/49] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:37:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:37:56.213375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2d3d2-fb12-4343-ba92-1f404fa6cbc4 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:56.309776 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:56.328757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2d3d2-fb12-4343-ba92-1f404fa6cbc4 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:56.367752 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9f12a-0bef-476a-90a2-dee8867dc697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:56.368394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9f12a-0bef-476a-90a2-dee8867dc697 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:56.368681 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9f12a-0bef-476a-90a2-dee8867dc697 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:56.368958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9f12a-0bef-476a-90a2-dee8867dc697 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:56.369685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9f12a-0bef-476a-90a2-dee8867dc697 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:37:56.369994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9f12a-0bef-476a-90a2-dee8867dc697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:56.371500 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9f12a-0bef-476a-90a2-dee8867dc697 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:56.381853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 22/50] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:37:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:37:56.388017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c08ef1-4882-4259-9def-9c19cd34e23f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:56.610184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c08ef1-4882-4259-9def-9c19cd34e23f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:56.638618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:56.638904 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de8c51-c632-4bab-9ce9-4b35167b1f1e None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:56.639192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de8c51-c632-4bab-9ce9-4b35167b1f1e None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:56.639461 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de8c51-c632-4bab-9ce9-4b35167b1f1e None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:56.640828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 23/51] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:37:56.646322 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8b75f-2eec-49e0-aa29-7b42930dd525 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:56.647132 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8b75f-2eec-49e0-aa29-7b42930dd525 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:56.647405 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8b75f-2eec-49e0-aa29-7b42930dd525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:56.649399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ca7ee-5e07-4014-b58f-f63f144e88d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:56.650072 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ca7ee-5e07-4014-b58f-f63f144e88d4 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:56.650357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ca7ee-5e07-4014-b58f-f63f144e88d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:56.650635 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ca7ee-5e07-4014-b58f-f63f144e88d4 None admin] PATH_INFO: `/v3/users/5b7b370e89cd4d279855f8c68c6540e2` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:56.651830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ca7ee-5e07-4014-b58f-f63f144e88d4 None admin] RBAC: Authorizing `identity:get_user(user_id=5b7b370e89cd4d279855f8c68c6540e2)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:56.653313 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ca7ee-5e07-4014-b58f-f63f144e88d4 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:56.654984 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 29/52] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:37:56 2022] GET /identity/v3/users/5b7b370e89cd4d279855f8c68c6540e2 => generated 247 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:37:56.660588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ca7ee-5e07-4014-b58f-f63f144e88d4 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:56.668775 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-31a8b75f-2eec-49e0-aa29-7b42930dd525 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:56.669992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-31a8b75f-2eec-49e0-aa29-7b42930dd525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:56.739144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 24/53] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:37:56.764724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ca7ee-5e07-4014-b58f-f63f144e88d4 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:56.799488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231e0e7-124c-4d6e-a99e-b77c6d5d0dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:56.800148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231e0e7-124c-4d6e-a99e-b77c6d5d0dac None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:56.800430 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231e0e7-124c-4d6e-a99e-b77c6d5d0dac None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:56.800710 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231e0e7-124c-4d6e-a99e-b77c6d5d0dac None admin] PATH_INFO: `/v3/domains/default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:56.801927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231e0e7-124c-4d6e-a99e-b77c6d5d0dac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:56.803377 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231e0e7-124c-4d6e-a99e-b77c6d5d0dac None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:56.805365 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 30/54] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:37:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:37:56.811112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8b75f-2eec-49e0-aa29-7b42930dd525 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:56.889809 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:56.913693 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8b75f-2eec-49e0-aa29-7b42930dd525 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:56.951631 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4a283-f572-4861-b10d-094eb60c8b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:56.952299 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4a283-f572-4861-b10d-094eb60c8b4e None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:56.952581 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4a283-f572-4861-b10d-094eb60c8b4e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:56.952855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4a283-f572-4861-b10d-094eb60c8b4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:56.953659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4a283-f572-4861-b10d-094eb60c8b4e None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.domain.id=default, user.id=5b7b370e89cd4d279855f8c68c6540e2) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:37:56.953983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4a283-f572-4861-b10d-094eb60c8b4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:56.955515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4a283-f572-4861-b10d-094eb60c8b4e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:56.961594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 25/55] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Sep 12 23:37:56 2022] GET /identity/v3/role_assignments?user.id=5b7b370e89cd4d279855f8c68c6540e2&scope.domain.id=default&role.id=440092230f024959a90e846ab29c6367 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:37:57.012822 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231e0e7-124c-4d6e-a99e-b77c6d5d0dac None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:57.085838 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:57.130546 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231e0e7-124c-4d6e-a99e-b77c6d5d0dac None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:57.166369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4542d3-a087-48eb-9671-ceb139522c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:57.166940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4542d3-a087-48eb-9671-ceb139522c49 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:57.167224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4542d3-a087-48eb-9671-ceb139522c49 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:57.167497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4542d3-a087-48eb-9671-ceb139522c49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:57.168656 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4542d3-a087-48eb-9671-ceb139522c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:57.170133 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4542d3-a087-48eb-9671-ceb139522c49 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:57.171897 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 31/56] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:37:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:37:57.177697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4a283-f572-4861-b10d-094eb60c8b4e None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:57.288498 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4a283-f572-4861-b10d-094eb60c8b4e None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:37:57.327694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0ae83-7335-4eb2-a72d-a1b932acaf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:37:57.328312 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0ae83-7335-4eb2-a72d-a1b932acaf2a None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:57.328597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0ae83-7335-4eb2-a72d-a1b932acaf2a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:57.328866 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0ae83-7335-4eb2-a72d-a1b932acaf2a None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:57.329561 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0ae83-7335-4eb2-a72d-a1b932acaf2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:37:57.331059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0ae83-7335-4eb2-a72d-a1b932acaf2a None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:37:57.346646 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:37:57.361098 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 26/57] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Sep 12 23:37:57 2022] POST /identity/v3/projects => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:37:59.508788 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca232c-e224-4641-bfa9-f59cd88c88c4 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:59.509362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca232c-e224-4641-bfa9-f59cd88c88c4 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:59.509362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca232c-e224-4641-bfa9-f59cd88c88c4 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:59.510733 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 32/58] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:37:59.517314 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44302c-1e39-4a77-b696-13064f8c7f2f None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:37:59.517768 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44302c-1e39-4a77-b696-13064f8c7f2f None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:37:59.517938 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44302c-1e39-4a77-b696-13064f8c7f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:37:59.537840 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-6e44302c-1e39-4a77-b696-13064f8c7f2f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:37:59.539029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6e44302c-1e39-4a77-b696-13064f8c7f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:37:59.612999 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 27/59] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:37:59.876967 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca232c-e224-4641-bfa9-f59cd88c88c4 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:37:59.988278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca232c-e224-4641-bfa9-f59cd88c88c4 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:00.017784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:00.024395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ea0ba-0eef-43f8-a727-83d81d87d360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:00.025050 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ea0ba-0eef-43f8-a727-83d81d87d360 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:00.025328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ea0ba-0eef-43f8-a727-83d81d87d360 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:00.025635 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ea0ba-0eef-43f8-a727-83d81d87d360 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:00.026791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ea0ba-0eef-43f8-a727-83d81d87d360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:00.028247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ea0ba-0eef-43f8-a727-83d81d87d360 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:00.029902 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 33/60] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:37:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:00.035944 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44302c-1e39-4a77-b696-13064f8c7f2f None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:00.159395 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44302c-1e39-4a77-b696-13064f8c7f2f None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:00.200122 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:00.215603 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530fa7e-6aae-45fc-8113-f5c4abfc0fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:00.216245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530fa7e-6aae-45fc-8113-f5c4abfc0fcd None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:00.216532 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530fa7e-6aae-45fc-8113-f5c4abfc0fcd None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:00.216811 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530fa7e-6aae-45fc-8113-f5c4abfc0fcd None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:00.217536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530fa7e-6aae-45fc-8113-f5c4abfc0fcd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:00.219047 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530fa7e-6aae-45fc-8113-f5c4abfc0fcd None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:00.250260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 28/61] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:38:00 2022] POST /identity/v3/users => generated 275 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:03.871964 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e299a-a0f9-4d2d-a679-8d9becca3bdd None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:03.873574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e299a-a0f9-4d2d-a679-8d9becca3bdd None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:03.874338 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e299a-a0f9-4d2d-a679-8d9becca3bdd None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:03.877373 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 34/62] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:03.887995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237add94-212f-40e4-b039-977e1dab6f58 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:03.888757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237add94-212f-40e4-b039-977e1dab6f58 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:03.888757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237add94-212f-40e4-b039-977e1dab6f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:03.933095 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-237add94-212f-40e4-b039-977e1dab6f58 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:03.937381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-237add94-212f-40e4-b039-977e1dab6f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:04.028849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 29/63] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:04.352670 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e299a-a0f9-4d2d-a679-8d9becca3bdd None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:04.539415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e299a-a0f9-4d2d-a679-8d9becca3bdd None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:04.585102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf03e5-cfe4-4563-b8db-846d04245a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:04.586131 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf03e5-cfe4-4563-b8db-846d04245a79 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:04.586590 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf03e5-cfe4-4563-b8db-846d04245a79 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:04.587030 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf03e5-cfe4-4563-b8db-846d04245a79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:04.608071 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf03e5-cfe4-4563-b8db-846d04245a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:04.613615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-2bdf03e5-cfe4-4563-b8db-846d04245a79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:04.613615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:04.613615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:04.613615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:04.613615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:04.613615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:04.613615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:04.613615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:04.613615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:04.613615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:04.613615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:04.613615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:04.613615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:04.613615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:04.613615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:04.613615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:04.614570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:04.614570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:04.614570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:04.614570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:04.614570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:04.614570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:04.614570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:04.614570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:04.614570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:04.614570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:04.614570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:04.614570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:04.614570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:04.614570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:04.614570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:04.614570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:04.615411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:04.615411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:04.615411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:04.615411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:04.615411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:04.615411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:04.615411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:04.615411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:04.615411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:04.615411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:04.615411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:04.615411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:38:04.617874 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 35/64] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:04.624441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237add94-212f-40e4-b039-977e1dab6f58 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:04.701564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe0522-8a07-4be1-a8e1-29bb4dafefd7 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:04.702204 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe0522-8a07-4be1-a8e1-29bb4dafefd7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:04.702696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe0522-8a07-4be1-a8e1-29bb4dafefd7 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:04.704564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 36/65] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:04.710820 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cab10-d04a-43a1-8f62-7a3e95bd1cd9 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:04.711423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cab10-d04a-43a1-8f62-7a3e95bd1cd9 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:04.711890 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cab10-d04a-43a1-8f62-7a3e95bd1cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:04.747700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-e41cab10-d04a-43a1-8f62-7a3e95bd1cd9 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:04.748767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-e41cab10-d04a-43a1-8f62-7a3e95bd1cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:04.814675 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:04.837804 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237add94-212f-40e4-b039-977e1dab6f58 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:04.838255 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 37/66] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:38:04.839938 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff0396-5363-407a-a0f4-06ee8ff5677d None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:04.840490 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff0396-5363-407a-a0f4-06ee8ff5677d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:04.841258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff0396-5363-407a-a0f4-06ee8ff5677d None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:04.843915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 38/67] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:04.855885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b8e4-591e-4158-9eb6-589e9336e79f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:04.856388 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b8e4-591e-4158-9eb6-589e9336e79f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:04.856868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b8e4-591e-4158-9eb6-589e9336e79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:04.868926 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:04.922938 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-73f2b8e4-591e-4158-9eb6-589e9336e79f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:04.925018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-73f2b8e4-591e-4158-9eb6-589e9336e79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:04.950212 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99417d5-6f0b-45c5-b40e-f6ebe0dca8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:04.951523 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99417d5-6f0b-45c5-b40e-f6ebe0dca8c2 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:04.951946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99417d5-6f0b-45c5-b40e-f6ebe0dca8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:04.952387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99417d5-6f0b-45c5-b40e-f6ebe0dca8c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:04.953281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99417d5-6f0b-45c5-b40e-f6ebe0dca8c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:04.953806 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99417d5-6f0b-45c5-b40e-f6ebe0dca8c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:04.955508 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99417d5-6f0b-45c5-b40e-f6ebe0dca8c2 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:04.964985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 30/68] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:04.966704 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bace1e-8408-4f37-8b83-be42191ca261 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:04.967140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bace1e-8408-4f37-8b83-be42191ca261 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:04.967597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bace1e-8408-4f37-8b83-be42191ca261 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:04.969050 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 31/69] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:04.974894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97e2dd-2465-4df5-9577-05fc12f25d07 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:04.975402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97e2dd-2465-4df5-9577-05fc12f25d07 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:04.975847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97e2dd-2465-4df5-9577-05fc12f25d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:05.002065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-ee97e2dd-2465-4df5-9577-05fc12f25d07 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:05.004673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ee97e2dd-2465-4df5-9577-05fc12f25d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:05.040350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 39/70] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:05.049452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2b8e4-591e-4158-9eb6-589e9336e79f None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:05.113163 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 32/71] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:05.115198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fa88a-a639-430e-85cc-fd3f5d9e177a None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:05.115774 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fa88a-a639-430e-85cc-fd3f5d9e177a None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:05.116260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fa88a-a639-430e-85cc-fd3f5d9e177a None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:05.118321 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 33/72] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:05.119658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fa88a-a639-430e-85cc-fd3f5d9e177a None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:05.171157 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2b8e4-591e-4158-9eb6-589e9336e79f None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:05.195879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:05.211255 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc5929-e215-4bab-9ee1-221b957cb7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:05.211916 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc5929-e215-4bab-9ee1-221b957cb7b6 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:05.212225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc5929-e215-4bab-9ee1-221b957cb7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:05.212463 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc5929-e215-4bab-9ee1-221b957cb7b6 None admin] PATH_INFO: `/v3/users/9b84663de808427898fa66e8b8174931` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:05.231147 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc5929-e215-4bab-9ee1-221b957cb7b6 None admin] RBAC: Authorizing `identity:get_user(user_id=9b84663de808427898fa66e8b8174931)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:05.232805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc5929-e215-4bab-9ee1-221b957cb7b6 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:05.235038 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 40/73] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:05 2022] GET /identity/v3/users/9b84663de808427898fa66e8b8174931 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:05.236483 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a982f-d8b4-47f9-8ff5-39d5f60656dd None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:05.236774 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a982f-d8b4-47f9-8ff5-39d5f60656dd None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:05.237053 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a982f-d8b4-47f9-8ff5-39d5f60656dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:05.258234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-9b2a982f-d8b4-47f9-8ff5-39d5f60656dd None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:05.259461 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9b2a982f-d8b4-47f9-8ff5-39d5f60656dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:05.331366 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fa88a-a639-430e-85cc-fd3f5d9e177a None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:05.334163 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:05.344537 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 41/74] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:05.345613 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a982f-d8b4-47f9-8ff5-39d5f60656dd None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:05.391489 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05854aed-f27e-4dfc-9eb9-360a24d2d7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:05.392227 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05854aed-f27e-4dfc-9eb9-360a24d2d7bc None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:05.392766 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05854aed-f27e-4dfc-9eb9-360a24d2d7bc None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:05.393123 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05854aed-f27e-4dfc-9eb9-360a24d2d7bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:05.421288 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05854aed-f27e-4dfc-9eb9-360a24d2d7bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:05.426471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-05854aed-f27e-4dfc-9eb9-360a24d2d7bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:38:05.426471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:05.426471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:05.426471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:05.426471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:05.426471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:05.426471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:05.426471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:05.426471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:05.426471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:05.426471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:05.426471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:05.426471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:05.426471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:05.426471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:05.426471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:05.427358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:05.427358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:05.427358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:05.427358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:05.427358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:05.427358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:05.427358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:05.427358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:05.427358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:05.427358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:05.427358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:05.427358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:05.427358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:05.427358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:05.427358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:05.427358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:05.433690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:05.433690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:05.433690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:05.433690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:05.433690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:05.433690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:05.433690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:05.433690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:05.433690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:05.433690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:05.433690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:38:05.433690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:05.433690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 34/75] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:05.433690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05854aed-f27e-4dfc-9eb9-360a24d2d7bc None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:05.505780 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a982f-d8b4-47f9-8ff5-39d5f60656dd None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:05.515438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:05.550901 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1d193-e757-452d-98d0-bc20df1f034b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:05.551378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05854aed-f27e-4dfc-9eb9-360a24d2d7bc None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:05.552138 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1d193-e757-452d-98d0-bc20df1f034b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:05.552612 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1d193-e757-452d-98d0-bc20df1f034b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:05.553095 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1d193-e757-452d-98d0-bc20df1f034b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:05.590494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f465a-d1b3-4039-a93e-e7da5d6c193c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:05.591178 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f465a-d1b3-4039-a93e-e7da5d6c193c None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:05.591506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f465a-d1b3-4039-a93e-e7da5d6c193c None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:05.591799 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f465a-d1b3-4039-a93e-e7da5d6c193c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:05.603827 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f465a-d1b3-4039-a93e-e7da5d6c193c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:05.609112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-c32f465a-d1b3-4039-a93e-e7da5d6c193c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:05.609112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:05.609112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:05.609112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:05.609112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:05.609112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:05.609112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:05.609112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:05.609112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:05.609112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:05.609112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:05.609112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:05.609112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:05.609112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:05.609112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:05.609112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:05.610030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:05.610030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:05.610030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:05.610030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:05.610030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:05.610030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:05.610030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:05.610030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:05.610030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:05.610030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:05.610030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:05.610030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:05.610030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:05.610030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:05.610030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:05.610030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:05.615939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:05.615939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:05.615939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:05.615939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:05.615939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:05.615939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:05.615939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:05.615939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:05.615939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:05.615939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:05.615939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:05.615939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:05.615939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 35/76] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:05.615939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f465a-d1b3-4039-a93e-e7da5d6c193c None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:05.639493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:05.651018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1d193-e757-452d-98d0-bc20df1f034b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:05.652444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1d193-e757-452d-98d0-bc20df1f034b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:05.732349 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f465a-d1b3-4039-a93e-e7da5d6c193c None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:05.769583 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67954978-bce9-4b22-9dea-90bf1e9a00ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:05.770204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67954978-bce9-4b22-9dea-90bf1e9a00ba None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:05.770481 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67954978-bce9-4b22-9dea-90bf1e9a00ba None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:05.770765 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67954978-bce9-4b22-9dea-90bf1e9a00ba None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:05.771445 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67954978-bce9-4b22-9dea-90bf1e9a00ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:05.771748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67954978-bce9-4b22-9dea-90bf1e9a00ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:05.773168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67954978-bce9-4b22-9dea-90bf1e9a00ba None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:05.774151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 42/77] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:05.779602 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1d193-e757-452d-98d0-bc20df1f034b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:05.787806 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 36/78] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:05.788679 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67954978-bce9-4b22-9dea-90bf1e9a00ba None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:05.790431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:05.907729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:05.914646 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1d193-e757-452d-98d0-bc20df1f034b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:05.935173 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67954978-bce9-4b22-9dea-90bf1e9a00ba None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:05.958061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805d5e8-8032-47b6-8d17-03cf65d8baa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:05.958719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805d5e8-8032-47b6-8d17-03cf65d8baa5 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:05.958997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805d5e8-8032-47b6-8d17-03cf65d8baa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:05.959360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805d5e8-8032-47b6-8d17-03cf65d8baa5 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:05.960473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805d5e8-8032-47b6-8d17-03cf65d8baa5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:05.960991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805d5e8-8032-47b6-8d17-03cf65d8baa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:05.962940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805d5e8-8032-47b6-8d17-03cf65d8baa5 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:05.974328 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1579c-0e05-4eaa-a70e-2cc8e2c3e8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:05.975012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1579c-0e05-4eaa-a70e-2cc8e2c3e8a2 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:05.975294 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1579c-0e05-4eaa-a70e-2cc8e2c3e8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:05.975574 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1579c-0e05-4eaa-a70e-2cc8e2c3e8a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:05.984467 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 43/79] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:05.985727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805d5e8-8032-47b6-8d17-03cf65d8baa5 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:05.991320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1579c-0e05-4eaa-a70e-2cc8e2c3e8a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:05.997204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-3ba1579c-0e05-4eaa-a70e-2cc8e2c3e8a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:38:05.997204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:05.997204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:05.997204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:05.997204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:05.997204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:05.997204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:05.997204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:05.997204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:05.997204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:05.997204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:05.997204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:05.997204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:05.997204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:05.997204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:05.997204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:05.998492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:05.998492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:05.998492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:05.998492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:05.998492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:05.998492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:05.998492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:05.998492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:05.998492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:05.998492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:05.998492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:05.998492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:05.998492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:05.998492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:05.998492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:05.998492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:05.999725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:05.999725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:05.999725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:05.999725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:05.999725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:05.999725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:05.999725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:05.999725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:05.999725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:05.999725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:05.999725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:38:05.999725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:05.999725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 37/80] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:38:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:05.999725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1579c-0e05-4eaa-a70e-2cc8e2c3e8a2 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:06.100200 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:06.134894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1579c-0e05-4eaa-a70e-2cc8e2c3e8a2 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:06.148287 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805d5e8-8032-47b6-8d17-03cf65d8baa5 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:06.189714 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32135b-ab8a-436c-a315-fa3347a0149d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:06.190412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32135b-ab8a-436c-a315-fa3347a0149d None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:06.190751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32135b-ab8a-436c-a315-fa3347a0149d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:06.191083 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32135b-ab8a-436c-a315-fa3347a0149d None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:06.191171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135722d-8208-4685-ac43-06b95b1277c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:06.192130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135722d-8208-4685-ac43-06b95b1277c0 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:06.192494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32135b-ab8a-436c-a315-fa3347a0149d None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:06.192583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135722d-8208-4685-ac43-06b95b1277c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:06.193026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135722d-8208-4685-ac43-06b95b1277c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:06.194269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32135b-ab8a-436c-a315-fa3347a0149d None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:06.194963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135722d-8208-4685-ac43-06b95b1277c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:06.196198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 38/81] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:05 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:06.197586 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135722d-8208-4685-ac43-06b95b1277c0 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:06.197691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32135b-ab8a-436c-a315-fa3347a0149d None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:06.205138 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 44/82] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:38:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:06.205138 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135722d-8208-4685-ac43-06b95b1277c0 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:06.218140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:06.329114 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135722d-8208-4685-ac43-06b95b1277c0 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:06.348490 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32135b-ab8a-436c-a315-fa3347a0149d None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:06.379911 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9166635-2c05-4046-bbd7-73690ba887d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:06.380786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9166635-2c05-4046-bbd7-73690ba887d3 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:06.381153 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9166635-2c05-4046-bbd7-73690ba887d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:06.381637 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9166635-2c05-4046-bbd7-73690ba887d3 None admin] PATH_INFO: `/v3/users/9b84663de808427898fa66e8b8174931` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:06.383138 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9166635-2c05-4046-bbd7-73690ba887d3 None admin] RBAC: Authorizing `identity:get_user(user_id=9b84663de808427898fa66e8b8174931)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:06.384904 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9166635-2c05-4046-bbd7-73690ba887d3 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:06.386980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 45/83] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:06 2022] GET /identity/v3/users/9b84663de808427898fa66e8b8174931 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:06.388080 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9166635-2c05-4046-bbd7-73690ba887d3 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:06.392476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:06.404264 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcf263-fb39-4533-96fa-8a7f130f9aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:06.405255 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcf263-fb39-4533-96fa-8a7f130f9aaa None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:06.405751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcf263-fb39-4533-96fa-8a7f130f9aaa None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:06.407145 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcf263-fb39-4533-96fa-8a7f130f9aaa None admin] PATH_INFO: `/v3/users/5b7b370e89cd4d279855f8c68c6540e2` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:06.408259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fcf263-fb39-4533-96fa-8a7f130f9aaa None admin] RBAC: Authorizing `identity:get_user(user_id=5b7b370e89cd4d279855f8c68c6540e2)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:06.410441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fcf263-fb39-4533-96fa-8a7f130f9aaa None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:06.412579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 39/84] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:06 2022] GET /identity/v3/users/5b7b370e89cd4d279855f8c68c6540e2 => generated 247 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:06.414317 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcf263-fb39-4533-96fa-8a7f130f9aaa None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:06.530133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:06.537832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9166635-2c05-4046-bbd7-73690ba887d3 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:06.565555 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcf263-fb39-4533-96fa-8a7f130f9aaa None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:06.579391 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24987769-3546-48dc-b4b9-167611a41ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:06.580439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24987769-3546-48dc-b4b9-167611a41ff7 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:06.580911 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24987769-3546-48dc-b4b9-167611a41ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:06.581377 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24987769-3546-48dc-b4b9-167611a41ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:06.582631 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24987769-3546-48dc-b4b9-167611a41ff7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:06.583110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24987769-3546-48dc-b4b9-167611a41ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:06.585579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24987769-3546-48dc-b4b9-167611a41ff7 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:06.600647 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 46/85] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:38:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:06.602188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24987769-3546-48dc-b4b9-167611a41ff7 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:06.603750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede42373-9d09-4284-9e6f-627995871b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:06.604380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede42373-9d09-4284-9e6f-627995871b5e None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:06.604656 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede42373-9d09-4284-9e6f-627995871b5e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:06.604921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede42373-9d09-4284-9e6f-627995871b5e None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:06.605619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede42373-9d09-4284-9e6f-627995871b5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:06.607297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede42373-9d09-4284-9e6f-627995871b5e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:06.633321 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 40/86] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:38:06 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:06.634258 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede42373-9d09-4284-9e6f-627995871b5e None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:06.737619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:06.781841 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede42373-9d09-4284-9e6f-627995871b5e None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:06.791120 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24987769-3546-48dc-b4b9-167611a41ff7 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:06.829019 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e0530-db2b-46e3-b95b-3b0bcff1c953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:06.829782 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e0530-db2b-46e3-b95b-3b0bcff1c953 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:06.830067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e0530-db2b-46e3-b95b-3b0bcff1c953 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:06.830339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e0530-db2b-46e3-b95b-3b0bcff1c953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:06.834585 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:06.856966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce7685-f0aa-4996-9988-9792102d9552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:06.857648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce7685-f0aa-4996-9988-9792102d9552 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:06.857933 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce7685-f0aa-4996-9988-9792102d9552 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:06.858214 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce7685-f0aa-4996-9988-9792102d9552 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:06.859580 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce7685-f0aa-4996-9988-9792102d9552 None admin] RBAC: Adding query filter params (role.id=c770dd0c3bc540c3a48b0393d192b17a, scope.project.id=ab929f16a6c349389781c723ea5d01a3, user.id=9b84663de808427898fa66e8b8174931) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:06.859580 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce7685-f0aa-4996-9988-9792102d9552 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:06.861102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce7685-f0aa-4996-9988-9792102d9552 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:06.872460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 47/87] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:06 2022] GET /identity/v3/role_assignments?user.id=9b84663de808427898fa66e8b8174931&scope.project.id=ab929f16a6c349389781c723ea5d01a3&role.id=c770dd0c3bc540c3a48b0393d192b17a => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:06.873395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce7685-f0aa-4996-9988-9792102d9552 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:06.946991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e0530-db2b-46e3-b95b-3b0bcff1c953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:06.948728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e0530-db2b-46e3-b95b-3b0bcff1c953 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:07.057182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce7685-f0aa-4996-9988-9792102d9552 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:07.123857 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:07.144226 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2d151-d1e4-47c5-9549-a7a1d544858b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:07.145272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2d151-d1e4-47c5-9549-a7a1d544858b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:07.145771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2d151-d1e4-47c5-9549-a7a1d544858b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:07.146224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2d151-d1e4-47c5-9549-a7a1d544858b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:07.170737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 41/88] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:07.172377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e0530-db2b-46e3-b95b-3b0bcff1c953 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:07.248597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:07.303612 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2d151-d1e4-47c5-9549-a7a1d544858b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:07.306798 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2d151-d1e4-47c5-9549-a7a1d544858b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:07.356367 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e0530-db2b-46e3-b95b-3b0bcff1c953 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:07.416032 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fef86-86e0-4bc9-838d-04c7ef60e37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:07.417218 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fef86-86e0-4bc9-838d-04c7ef60e37b None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:07.421160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fef86-86e0-4bc9-838d-04c7ef60e37b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:07.421160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fef86-86e0-4bc9-838d-04c7ef60e37b None admin] PATH_INFO: `/v3/users/9b84663de808427898fa66e8b8174931` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:07.425446 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fef86-86e0-4bc9-838d-04c7ef60e37b None admin] RBAC: Authorizing `identity:get_user(user_id=9b84663de808427898fa66e8b8174931)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:07.426114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fef86-86e0-4bc9-838d-04c7ef60e37b None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:07.447721 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 42/89] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:07 2022] GET /identity/v3/users/9b84663de808427898fa66e8b8174931 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:07.447721 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fef86-86e0-4bc9-838d-04c7ef60e37b None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:07.567928 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 48/90] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:07.568825 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2d151-d1e4-47c5-9549-a7a1d544858b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:07.622771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:07.665954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fef86-86e0-4bc9-838d-04c7ef60e37b None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:07.677753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:07.710044 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74b64b-9e92-4614-859a-f406e2758e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:07.710700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74b64b-9e92-4614-859a-f406e2758e1a None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:07.710982 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74b64b-9e92-4614-859a-f406e2758e1a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:07.711431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74b64b-9e92-4614-859a-f406e2758e1a None admin] PATH_INFO: `/v3/projects/1270f05926f7448997238f13050bd699` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:07.712635 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74b64b-9e92-4614-859a-f406e2758e1a None admin] RBAC: Authorizing `identity:get_project(project_id=1270f05926f7448997238f13050bd699)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:07.715107 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74b64b-9e92-4614-859a-f406e2758e1a None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:07.717191 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 43/91] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:07 2022] GET /identity/v3/projects/1270f05926f7448997238f13050bd699 => generated 312 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:07.718040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74b64b-9e92-4614-859a-f406e2758e1a None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:07.779958 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2d151-d1e4-47c5-9549-a7a1d544858b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:07.839805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6ee7e-c6d5-400e-b785-0e8c47e4e86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:07.840610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6ee7e-c6d5-400e-b785-0e8c47e4e86e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:07.840892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6ee7e-c6d5-400e-b785-0e8c47e4e86e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:07.841163 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6ee7e-c6d5-400e-b785-0e8c47e4e86e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:07.985706 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74b64b-9e92-4614-859a-f406e2758e1a None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:08.027085 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd038c-c38b-4014-a460-73296cd09d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:08.028010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd038c-c38b-4014-a460-73296cd09d5b None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:08.028427 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd038c-c38b-4014-a460-73296cd09d5b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:08.028897 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd038c-c38b-4014-a460-73296cd09d5b None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:08.030341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd038c-c38b-4014-a460-73296cd09d5b None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:08.030455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6ee7e-c6d5-400e-b785-0e8c47e4e86e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:08.031942 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6ee7e-c6d5-400e-b785-0e8c47e4e86e None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:08.032252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd038c-c38b-4014-a460-73296cd09d5b None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:08.034486 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 44/92] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:07 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:08.035462 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd038c-c38b-4014-a460-73296cd09d5b None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:08.088607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:08.124966 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:08.213529 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd038c-c38b-4014-a460-73296cd09d5b None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:08.214649 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 49/93] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:08.215789 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6ee7e-c6d5-400e-b785-0e8c47e4e86e None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:08.253494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883a821-2d72-42e2-810e-937d94effabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:08.253494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883a821-2d72-42e2-810e-937d94effabe None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:08.253494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883a821-2d72-42e2-810e-937d94effabe None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:08.253494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883a821-2d72-42e2-810e-937d94effabe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:08.253912 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883a821-2d72-42e2-810e-937d94effabe None admin] RBAC: Adding query filter params (role.id=c770dd0c3bc540c3a48b0393d192b17a, scope.project.id=1270f05926f7448997238f13050bd699, user.id=9b84663de808427898fa66e8b8174931) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:08.253912 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883a821-2d72-42e2-810e-937d94effabe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:08.253912 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883a821-2d72-42e2-810e-937d94effabe None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:08.256430 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 45/94] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:08 2022] GET /identity/v3/role_assignments?user.id=9b84663de808427898fa66e8b8174931&scope.project.id=1270f05926f7448997238f13050bd699&role.id=c770dd0c3bc540c3a48b0393d192b17a => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:08.257088 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883a821-2d72-42e2-810e-937d94effabe None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:08.389822 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6ee7e-c6d5-400e-b785-0e8c47e4e86e None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:08.436776 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:08.444926 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc5ca8-37c2-4888-b54b-c6a520196a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:08.445587 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc5ca8-37c2-4888-b54b-c6a520196a1a None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:08.445871 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc5ca8-37c2-4888-b54b-c6a520196a1a None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:08.446137 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc5ca8-37c2-4888-b54b-c6a520196a1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:08.446885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc5ca8-37c2-4888-b54b-c6a520196a1a None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.project.id=ab929f16a6c349389781c723ea5d01a3, user.id=5b7b370e89cd4d279855f8c68c6540e2) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:08.447192 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc5ca8-37c2-4888-b54b-c6a520196a1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:08.448727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc5ca8-37c2-4888-b54b-c6a520196a1a None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:08.455943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 50/95] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:08 2022] GET /identity/v3/role_assignments?user.id=5b7b370e89cd4d279855f8c68c6540e2&scope.project.id=ab929f16a6c349389781c723ea5d01a3&role.id=440092230f024959a90e846ab29c6367 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:08.518794 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883a821-2d72-42e2-810e-937d94effabe None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:08.522081 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:08.560286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c89fe-3dc0-4300-92e2-c9197f676f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:08.560980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c89fe-3dc0-4300-92e2-c9197f676f72 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:08.561266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c89fe-3dc0-4300-92e2-c9197f676f72 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:08.561575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c89fe-3dc0-4300-92e2-c9197f676f72 None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:08.563270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c89fe-3dc0-4300-92e2-c9197f676f72 None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:08.564907 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c89fe-3dc0-4300-92e2-c9197f676f72 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:08.566778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 46/96] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:08 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:08.573620 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc5ca8-37c2-4888-b54b-c6a520196a1a None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:08.719204 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc5ca8-37c2-4888-b54b-c6a520196a1a None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:08.758876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb120c-9d64-4a4d-867a-c0efa3e4b7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:08.759515 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb120c-9d64-4a4d-867a-c0efa3e4b7e7 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:08.759795 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb120c-9d64-4a4d-867a-c0efa3e4b7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:08.760069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb120c-9d64-4a4d-867a-c0efa3e4b7e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:08.760810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb120c-9d64-4a4d-867a-c0efa3e4b7e7 None admin] RBAC: Adding query filter params (role.id=e4d659212810456798a60c1902537d7d, scope.project.id=ab929f16a6c349389781c723ea5d01a3, user.id=9b84663de808427898fa66e8b8174931) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:08.761117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb120c-9d64-4a4d-867a-c0efa3e4b7e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:08.762656 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb120c-9d64-4a4d-867a-c0efa3e4b7e7 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:08.773565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 51/97] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:08 2022] GET /identity/v3/role_assignments?user.id=9b84663de808427898fa66e8b8174931&scope.project.id=ab929f16a6c349389781c723ea5d01a3&role.id=e4d659212810456798a60c1902537d7d => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:09.899261 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1c260-4932-46d4-8dbb-8f53d9ee0a1a None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:09.899798 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1c260-4932-46d4-8dbb-8f53d9ee0a1a None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:09.900081 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1c260-4932-46d4-8dbb-8f53d9ee0a1a None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:09.901818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 47/98] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:09.907721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e1387-88fe-421e-8776-d04a0c15472f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:09.908723 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e1387-88fe-421e-8776-d04a0c15472f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:09.909191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e1387-88fe-421e-8776-d04a0c15472f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:09.933006 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-ca5e1387-88fe-421e-8776-d04a0c15472f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:09.934635 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ca5e1387-88fe-421e-8776-d04a0c15472f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:10.015755 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:10.033806 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 52/99] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:10.567572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1c260-4932-46d4-8dbb-8f53d9ee0a1a None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:10.668939 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68e388-1b2b-4253-a116-9199839db6a1 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:10.669640 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68e388-1b2b-4253-a116-9199839db6a1 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:10.670139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68e388-1b2b-4253-a116-9199839db6a1 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:10.672142 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 53/100] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:10.678313 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e976867-30d4-4ef5-884b-ef0653bd644a None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:10.679393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e976867-30d4-4ef5-884b-ef0653bd644a None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:10.680145 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e976867-30d4-4ef5-884b-ef0653bd644a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:10.708680 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1c260-4932-46d4-8dbb-8f53d9ee0a1a None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:10.718539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-4e976867-30d4-4ef5-884b-ef0653bd644a None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:10.720128 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4e976867-30d4-4ef5-884b-ef0653bd644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:10.750914 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b6d8d-8cac-4ba1-9e36-5544dd95adec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:10.751978 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b6d8d-8cac-4ba1-9e36-5544dd95adec None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:10.752404 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b6d8d-8cac-4ba1-9e36-5544dd95adec None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:10.752815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b6d8d-8cac-4ba1-9e36-5544dd95adec None admin] PATH_INFO: `/v3/roles/member` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:10.771035 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b6d8d-8cac-4ba1-9e36-5544dd95adec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:10.776525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-c96b6d8d-8cac-4ba1-9e36-5544dd95adec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:10.776525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:10.776525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:10.776525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:10.776525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:10.776525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:10.776525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:10.776525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:10.776525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:10.776525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:10.776525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:10.776525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:10.776525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:10.776525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:10.776525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:10.776525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:10.777961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:10.777961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:10.777961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:10.777961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:10.777961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:10.777961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:10.777961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:10.777961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:10.777961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:10.777961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:10.777961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:10.777961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:10.777961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:10.777961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:10.777961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:10.777961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:10.778740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:10.778740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:10.778740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:10.778740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:10.778740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:10.778740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:10.778740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:10.778740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:10.778740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:10.778740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:10.778740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:10.778740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:10.778740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 48/101] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:10.786263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b6d8d-8cac-4ba1-9e36-5544dd95adec None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:10.853763 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:10.874357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 54/102] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:38:10.988584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b6d8d-8cac-4ba1-9e36-5544dd95adec None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:11.008905 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ec90a-9d06-49cd-a37a-4bb75fb35e55 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.009452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ec90a-9d06-49cd-a37a-4bb75fb35e55 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.009526 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ec90a-9d06-49cd-a37a-4bb75fb35e55 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.011053 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 55/103] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:38:11.017832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10279491-4d55-4de6-a93a-669417e6b968 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.018458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10279491-4d55-4de6-a93a-669417e6b968 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.018919 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10279491-4d55-4de6-a93a-669417e6b968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.042788 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-10279491-4d55-4de6-a93a-669417e6b968 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:11.044421 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-10279491-4d55-4de6-a93a-669417e6b968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:11.064624 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bffddf-0682-4613-95f1-84e8cf971c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:11.065703 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bffddf-0682-4613-95f1-84e8cf971c3a None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.066184 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bffddf-0682-4613-95f1-84e8cf971c3a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.066671 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bffddf-0682-4613-95f1-84e8cf971c3a None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.067939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bffddf-0682-4613-95f1-84e8cf971c3a None admin] RBAC: Adding query filter params (name=member) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:11.068446 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bffddf-0682-4613-95f1-84e8cf971c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:11.071226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bffddf-0682-4613-95f1-84e8cf971c3a None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:11.099589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 49/104] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:11.106015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bffddf-0682-4613-95f1-84e8cf971c3a None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:11.134699 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 56/105] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:38:11.354601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:11.369990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bffddf-0682-4613-95f1-84e8cf971c3a None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:11.433636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10279491-4d55-4de6-a93a-669417e6b968 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:11.448441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12bdd3-7cfe-4606-9c95-db3713640c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:11.449875 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12bdd3-7cfe-4606-9c95-db3713640c74 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.450672 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12bdd3-7cfe-4606-9c95-db3713640c74 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.451461 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12bdd3-7cfe-4606-9c95-db3713640c74 None admin] PATH_INFO: `/v3/users/9b84663de808427898fa66e8b8174931` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.453825 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12bdd3-7cfe-4606-9c95-db3713640c74 None admin] RBAC: Authorizing `identity:get_user(user_id=9b84663de808427898fa66e8b8174931)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:11.457149 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12bdd3-7cfe-4606-9c95-db3713640c74 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:11.460969 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 50/106] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:11 2022] GET /identity/v3/users/9b84663de808427898fa66e8b8174931 => generated 275 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:11.462775 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12bdd3-7cfe-4606-9c95-db3713640c74 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:11.508498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:11.610256 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10279491-4d55-4de6-a93a-669417e6b968 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:11.612836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12bdd3-7cfe-4606-9c95-db3713640c74 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:11.657698 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661ddb4-4ce8-4a84-bebc-3bdd8bcaa1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:11.658412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661ddb4-4ce8-4a84-bebc-3bdd8bcaa1cc None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.658684 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661ddb4-4ce8-4a84-bebc-3bdd8bcaa1cc None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.658961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661ddb4-4ce8-4a84-bebc-3bdd8bcaa1cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.673156 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661ddb4-4ce8-4a84-bebc-3bdd8bcaa1cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:11.675221 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54502eca-a7c3-4945-bf9e-defc9f900a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:11.676554 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54502eca-a7c3-4945-bf9e-defc9f900a2d None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.677261 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54502eca-a7c3-4945-bf9e-defc9f900a2d None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.677938 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54502eca-a7c3-4945-bf9e-defc9f900a2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.678723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-3661ddb4-4ce8-4a84-bebc-3bdd8bcaa1cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:11.678723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:11.678723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:11.678723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:11.678723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:11.678723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:11.678723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:11.678723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:11.678723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:11.678723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:11.678723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:11.678723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:11.678723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:11.678723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:11.678723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:11.678723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:11.680339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:11.680339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:11.680339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:11.680339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:11.680339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:11.680339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:11.680339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:11.680339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:11.680339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:11.680339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:11.680339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:11.680339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:11.680339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:11.680339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:11.680339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:11.680339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:11.681980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:11.681980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:11.681980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:11.681980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:11.681980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:11.681980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:11.681980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:11.681980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:11.681980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:11.681980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:11.681980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:11.681980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:11.681980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 51/107] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:11.681980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661ddb4-4ce8-4a84-bebc-3bdd8bcaa1cc None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:11.685508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54502eca-a7c3-4945-bf9e-defc9f900a2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:11.689508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54502eca-a7c3-4945-bf9e-defc9f900a2d None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:11.692916 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 57/108] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:38:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:11.695388 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebeaf9-8a00-437c-9772-751abaa594de None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.696134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebeaf9-8a00-437c-9772-751abaa594de None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.696765 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebeaf9-8a00-437c-9772-751abaa594de None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.699837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 58/109] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:11.701501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebeaf9-8a00-437c-9772-751abaa594de None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:11.720774 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:11.862529 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebeaf9-8a00-437c-9772-751abaa594de None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:11.867477 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661ddb4-4ce8-4a84-bebc-3bdd8bcaa1cc None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:11.884297 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:11.907171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2c211-c1d0-447d-8d32-4d4ad9d363e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:11.907848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2c211-c1d0-447d-8d32-4d4ad9d363e4 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.908134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2c211-c1d0-447d-8d32-4d4ad9d363e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.908438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2c211-c1d0-447d-8d32-4d4ad9d363e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.909092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2c211-c1d0-447d-8d32-4d4ad9d363e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:11.909428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2c211-c1d0-447d-8d32-4d4ad9d363e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:11.910831 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2c211-c1d0-447d-8d32-4d4ad9d363e4 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:11.920547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 59/110] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:11.921143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2c211-c1d0-447d-8d32-4d4ad9d363e4 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:11.933075 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6edf6-2679-4252-ae20-85f2b6eaa9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:11.934457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6edf6-2679-4252-ae20-85f2b6eaa9fa None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.935770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6edf6-2679-4252-ae20-85f2b6eaa9fa None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.936412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6edf6-2679-4252-ae20-85f2b6eaa9fa None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.940279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6edf6-2679-4252-ae20-85f2b6eaa9fa None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:11.944225 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6edf6-2679-4252-ae20-85f2b6eaa9fa None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:11.948026 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 52/111] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:11 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:11.950390 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40f467-5fc1-478a-888f-d99f2afd0e40 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:11.950683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40f467-5fc1-478a-888f-d99f2afd0e40 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:11.950946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40f467-5fc1-478a-888f-d99f2afd0e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:11.974663 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-6c40f467-5fc1-478a-888f-d99f2afd0e40 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:11.976066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6c40f467-5fc1-478a-888f-d99f2afd0e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:12.040969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2c211-c1d0-447d-8d32-4d4ad9d363e4 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:12.085709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8373363-9195-4a7e-9d7e-6908459cca7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:12.086179 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 53/112] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:12.087591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8373363-9195-4a7e-9d7e-6908459cca7e None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:12.088058 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5771a9-7b9e-482f-84dc-bff87efa172d None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:12.088479 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5771a9-7b9e-482f-84dc-bff87efa172d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:12.088885 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5771a9-7b9e-482f-84dc-bff87efa172d None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:12.089273 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8373363-9195-4a7e-9d7e-6908459cca7e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:12.090127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8373363-9195-4a7e-9d7e-6908459cca7e None admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:12.097936 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 54/113] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:12.097936 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5771a9-7b9e-482f-84dc-bff87efa172d None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:12.099049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8373363-9195-4a7e-9d7e-6908459cca7e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:12.101399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8373363-9195-4a7e-9d7e-6908459cca7e None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:12.141691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:12.154751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 60/114] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 23:38:11 2022] POST /identity/v3/projects => generated 302 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:12.157257 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8373363-9195-4a7e-9d7e-6908459cca7e None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:12.224278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:12.375126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8373363-9195-4a7e-9d7e-6908459cca7e None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:12.394747 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5771a9-7b9e-482f-84dc-bff87efa172d None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:12.449575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c9ede-8369-414b-8bfd-39ee61bad50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:12.450252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c9ede-8369-414b-8bfd-39ee61bad50a None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:12.450551 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c9ede-8369-414b-8bfd-39ee61bad50a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:12.450804 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c9ede-8369-414b-8bfd-39ee61bad50a None admin] PATH_INFO: `/v3/users/be7d33fcd6b64026af066492ebb488a8` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:12.456551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a402f0-74d8-4d85-a8d5-009d4a6709f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:12.457372 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a402f0-74d8-4d85-a8d5-009d4a6709f8 None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:12.457657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a402f0-74d8-4d85-a8d5-009d4a6709f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:12.459477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a402f0-74d8-4d85-a8d5-009d4a6709f8 None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3/users/9b84663de808427898fa66e8b8174931/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:12.464300 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a402f0-74d8-4d85-a8d5-009d4a6709f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab929f16a6c349389781c723ea5d01a3, user_id=9b84663de808427898fa66e8b8174931, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:12.464300 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a402f0-74d8-4d85-a8d5-009d4a6709f8 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:12.481751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c9ede-8369-414b-8bfd-39ee61bad50a None admin] RBAC: Authorizing `identity:get_user(user_id=be7d33fcd6b64026af066492ebb488a8)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:12.484571 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c9ede-8369-414b-8bfd-39ee61bad50a None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:12.488071 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 55/115] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:12 2022] GET /identity/v3/users/be7d33fcd6b64026af066492ebb488a8 => generated 289 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:12.488229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 61/116] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:38:12 2022] PUT /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3/users/9b84663de808427898fa66e8b8174931/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:12.489060 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a402f0-74d8-4d85-a8d5-009d4a6709f8 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:12.490719 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a277ff5-7e56-4b56-84d2-5d1d68d2fa7d None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:12.491207 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a277ff5-7e56-4b56-84d2-5d1d68d2fa7d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:12.491691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a277ff5-7e56-4b56-84d2-5d1d68d2fa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:12.529803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-3a277ff5-7e56-4b56-84d2-5d1d68d2fa7d None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:12.531753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-3a277ff5-7e56-4b56-84d2-5d1d68d2fa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:12.618419 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:12.644538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a402f0-74d8-4d85-a8d5-009d4a6709f8 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:12.705685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 56/117] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:12.707263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a277ff5-7e56-4b56-84d2-5d1d68d2fa7d None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:12.734058 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:12.749637 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcc032-c824-4be5-991d-f4cbf1ba72fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:12.750319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcc032-c824-4be5-991d-f4cbf1ba72fc None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:12.750603 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcc032-c824-4be5-991d-f4cbf1ba72fc None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:12.750911 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcc032-c824-4be5-991d-f4cbf1ba72fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:12.764212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcc032-c824-4be5-991d-f4cbf1ba72fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:12.770583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-7cbcc032-c824-4be5-991d-f4cbf1ba72fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:38:12.770583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:12.770583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:12.770583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:12.770583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:12.770583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:12.770583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:12.770583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:12.770583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:12.770583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:12.770583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:12.770583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:12.770583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:12.770583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:12.770583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:12.770583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:12.771524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:12.771524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:12.771524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:12.771524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:12.771524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:12.771524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:12.771524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:12.771524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:12.771524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:12.771524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:12.771524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:12.771524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:12.771524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:12.771524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:12.771524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:12.771524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:12.772753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:12.772753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:12.772753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:12.772753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:12.772753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:12.772753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:12.772753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:12.772753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:12.772753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:12.772753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:12.772753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:38:12.772753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:38:12.772753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 62/118] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:38:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:12.779007 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcc032-c824-4be5-991d-f4cbf1ba72fc None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:12.897176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a277ff5-7e56-4b56-84d2-5d1d68d2fa7d None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:12.915880 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcc032-c824-4be5-991d-f4cbf1ba72fc None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:12.939759 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6a8b3-d44f-4d0d-b71e-e156f96dd46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:12.940802 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6a8b3-d44f-4d0d-b71e-e156f96dd46b None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:12.941277 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6a8b3-d44f-4d0d-b71e-e156f96dd46b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:12.941778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6a8b3-d44f-4d0d-b71e-e156f96dd46b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:12.967626 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa076eda-8825-4066-9d48-af016ea11188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:12.970305 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa076eda-8825-4066-9d48-af016ea11188 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:12.970617 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa076eda-8825-4066-9d48-af016ea11188 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:12.970943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa076eda-8825-4066-9d48-af016ea11188 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:12.971988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa076eda-8825-4066-9d48-af016ea11188 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:12.972794 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa076eda-8825-4066-9d48-af016ea11188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:12.974530 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa076eda-8825-4066-9d48-af016ea11188 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:12.987114 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 63/119] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:12.997101 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa076eda-8825-4066-9d48-af016ea11188 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:13.022767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:13.068474 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6a8b3-d44f-4d0d-b71e-e156f96dd46b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:13.070029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6a8b3-d44f-4d0d-b71e-e156f96dd46b None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:13.091278 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:13.219742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa076eda-8825-4066-9d48-af016ea11188 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:13.283160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 57/120] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:13.287021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6a8b3-d44f-4d0d-b71e-e156f96dd46b None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:13.305357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a85a26-1d8e-4188-959d-c660e0748a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:13.306409 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a85a26-1d8e-4188-959d-c660e0748a62 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:13.306849 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a85a26-1d8e-4188-959d-c660e0748a62 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:13.307273 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a85a26-1d8e-4188-959d-c660e0748a62 None admin] PATH_INFO: `/v3/users/5b7b370e89cd4d279855f8c68c6540e2` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:13.310258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a85a26-1d8e-4188-959d-c660e0748a62 None admin] RBAC: Authorizing `identity:get_user(user_id=5b7b370e89cd4d279855f8c68c6540e2)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:13.312462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a85a26-1d8e-4188-959d-c660e0748a62 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:13.314927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 64/121] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:12 2022] GET /identity/v3/users/5b7b370e89cd4d279855f8c68c6540e2 => generated 247 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:13.315990 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a85a26-1d8e-4188-959d-c660e0748a62 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:13.491923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:13.508603 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6a8b3-d44f-4d0d-b71e-e156f96dd46b None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:13.520864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:13.532990 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a85a26-1d8e-4188-959d-c660e0748a62 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:13.552305 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eea18e-d4c1-4ab0-8bd5-3a192ee81cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:13.552968 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eea18e-d4c1-4ab0-8bd5-3a192ee81cf5 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:13.553256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eea18e-d4c1-4ab0-8bd5-3a192ee81cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:13.553585 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eea18e-d4c1-4ab0-8bd5-3a192ee81cf5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:13.566645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eea18e-d4c1-4ab0-8bd5-3a192ee81cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:13.571783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-d9eea18e-d4c1-4ab0-8bd5-3a192ee81cf5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:13.571783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:13.571783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:13.571783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:13.571783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:13.571783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:13.571783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:13.571783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:13.571783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:13.571783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:13.571783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:13.571783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:13.571783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:13.571783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:13.571783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:13.571783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:13.572823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:13.572823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:13.572823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:13.572823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:13.572823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:13.572823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:13.572823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:13.572823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:13.572823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:13.572823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:13.572823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:13.572823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:13.572823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:13.572823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:13.572823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:13.572823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:13.573697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:13.573697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:13.573697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:13.573697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:13.573697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:13.573697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:13.573697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:13.573697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:13.573697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:13.573697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:13.573697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:13.573697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:13.579357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 58/122] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:13.579357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eea18e-d4c1-4ab0-8bd5-3a192ee81cf5 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:13.596397 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9ce2e-19fc-46ba-9602-d45167799fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:13.597449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9ce2e-19fc-46ba-9602-d45167799fd5 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:13.597961 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9ce2e-19fc-46ba-9602-d45167799fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:13.598388 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9ce2e-19fc-46ba-9602-d45167799fd5 None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:13.599828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9ce2e-19fc-46ba-9602-d45167799fd5 None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:13.601539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9ce2e-19fc-46ba-9602-d45167799fd5 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:13.603604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 65/123] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:13 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:13.610359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5607156-0836-41db-b62b-39884ab8a480 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:13.611005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5607156-0836-41db-b62b-39884ab8a480 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:13.611449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5607156-0836-41db-b62b-39884ab8a480 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:13.613144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 66/124] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:13.614276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5607156-0836-41db-b62b-39884ab8a480 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:13.702949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eea18e-d4c1-4ab0-8bd5-3a192ee81cf5 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:13.735415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5607156-0836-41db-b62b-39884ab8a480 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:13.743504 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaee50-1076-42a8-8a1f-52cc9d42584d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:13.744160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaee50-1076-42a8-8a1f-52cc9d42584d None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:13.744445 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaee50-1076-42a8-8a1f-52cc9d42584d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:13.744718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaee50-1076-42a8-8a1f-52cc9d42584d None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:13.746091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaee50-1076-42a8-8a1f-52cc9d42584d None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:13.747680 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaee50-1076-42a8-8a1f-52cc9d42584d None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:13.754665 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 59/125] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:13 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:13.755758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaee50-1076-42a8-8a1f-52cc9d42584d None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:13.781274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237138ef-3fdf-49af-8b92-68bf3b39a071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:13.782326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237138ef-3fdf-49af-8b92-68bf3b39a071 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:13.782961 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237138ef-3fdf-49af-8b92-68bf3b39a071 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:13.783449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237138ef-3fdf-49af-8b92-68bf3b39a071 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:13.784423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237138ef-3fdf-49af-8b92-68bf3b39a071 None admin] RBAC: Adding query filter params (name=member) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:13.784946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237138ef-3fdf-49af-8b92-68bf3b39a071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:13.786656 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237138ef-3fdf-49af-8b92-68bf3b39a071 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:13.796868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 67/126] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:13.798694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54babb-a2df-461e-bb68-786b932bad46 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:13.799248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54babb-a2df-461e-bb68-786b932bad46 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:13.799721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54babb-a2df-461e-bb68-786b932bad46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:13.804641 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:13.822816 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-0b54babb-a2df-461e-bb68-786b932bad46 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:13.824458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0b54babb-a2df-461e-bb68-786b932bad46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:13.828086 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:13.884441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaee50-1076-42a8-8a1f-52cc9d42584d None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:13.905303 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 68/127] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:13.907124 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54babb-a2df-461e-bb68-786b932bad46 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:13.924791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bc63f-e1dc-4258-a21e-c268fe4c59b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:13.925540 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bc63f-e1dc-4258-a21e-c268fe4c59b3 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:13.925823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bc63f-e1dc-4258-a21e-c268fe4c59b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:13.926148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2bc63f-e1dc-4258-a21e-c268fe4c59b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:13.926924 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bc63f-e1dc-4258-a21e-c268fe4c59b3 None admin] RBAC: Adding query filter params (role.id=1f24a90c6e1a4534b0a55f86ccc0ee7f, scope.project.id=ab929f16a6c349389781c723ea5d01a3, user.id=be7d33fcd6b64026af066492ebb488a8) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:13.927202 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bc63f-e1dc-4258-a21e-c268fe4c59b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:13.928764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2bc63f-e1dc-4258-a21e-c268fe4c59b3 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:13.936095 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 60/128] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:13 2022] GET /identity/v3/role_assignments?user.id=be7d33fcd6b64026af066492ebb488a8&scope.project.id=ab929f16a6c349389781c723ea5d01a3&role.id=1f24a90c6e1a4534b0a55f86ccc0ee7f => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:13.943399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bc63f-e1dc-4258-a21e-c268fe4c59b3 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:14.197154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54babb-a2df-461e-bb68-786b932bad46 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:14.224517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:14.232854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2bc63f-e1dc-4258-a21e-c268fe4c59b3 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:14.293104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00947740-cc00-4f05-bf2a-bc35f2d3370c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:14.294011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00947740-cc00-4f05-bf2a-bc35f2d3370c None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:14.294522 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00947740-cc00-4f05-bf2a-bc35f2d3370c None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:14.295030 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00947740-cc00-4f05-bf2a-bc35f2d3370c None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3/users/5b7b370e89cd4d279855f8c68c6540e2/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:14.295873 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f34e2-7cce-45ea-80c4-69cc665480da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:14.296531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f34e2-7cce-45ea-80c4-69cc665480da None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:14.296808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f34e2-7cce-45ea-80c4-69cc665480da None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:14.297080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f34e2-7cce-45ea-80c4-69cc665480da None admin] PATH_INFO: `/v3/users/9b84663de808427898fa66e8b8174931` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:14.298381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f34e2-7cce-45ea-80c4-69cc665480da None admin] RBAC: Authorizing `identity:get_user(user_id=9b84663de808427898fa66e8b8174931)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:14.299872 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f34e2-7cce-45ea-80c4-69cc665480da None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:14.300368 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00947740-cc00-4f05-bf2a-bc35f2d3370c None admin] RBAC: Authorizing `identity:create_grant(project_id=ab929f16a6c349389781c723ea5d01a3, user_id=5b7b370e89cd4d279855f8c68c6540e2, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:14.302721 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 61/129] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:13 2022] GET /identity/v3/users/9b84663de808427898fa66e8b8174931 => generated 275 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:14.302842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00947740-cc00-4f05-bf2a-bc35f2d3370c None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:14.308978 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f34e2-7cce-45ea-80c4-69cc665480da None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:14.338637 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:14.359014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 69/130] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:38:13 2022] PUT /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3/users/5b7b370e89cd4d279855f8c68c6540e2/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:14.466919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f34e2-7cce-45ea-80c4-69cc665480da None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:14.505933 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecef950-5452-49a9-8de2-d15ce57cd221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:14.506639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecef950-5452-49a9-8de2-d15ce57cd221 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:14.506919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecef950-5452-49a9-8de2-d15ce57cd221 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:14.507191 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecef950-5452-49a9-8de2-d15ce57cd221 None admin] PATH_INFO: `/v3/projects/1270f05926f7448997238f13050bd699` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:14.508358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecef950-5452-49a9-8de2-d15ce57cd221 None admin] RBAC: Authorizing `identity:get_project(project_id=1270f05926f7448997238f13050bd699)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:14.509863 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecef950-5452-49a9-8de2-d15ce57cd221 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:14.511565 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 62/131] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:14 2022] GET /identity/v3/projects/1270f05926f7448997238f13050bd699 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:14.522911 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00947740-cc00-4f05-bf2a-bc35f2d3370c None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:14.647821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecef950-5452-49a9-8de2-d15ce57cd221 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:14.714269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:14.753429 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00947740-cc00-4f05-bf2a-bc35f2d3370c None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:14.828099 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbb215-e958-491f-b705-303895b24b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:14.829265 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbb215-e958-491f-b705-303895b24b76 None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:14.830002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbb215-e958-491f-b705-303895b24b76 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:14.830497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbb215-e958-491f-b705-303895b24b76 None admin] PATH_INFO: `/v3/projects/1270f05926f7448997238f13050bd699/users/9b84663de808427898fa66e8b8174931/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:14.834706 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbb215-e958-491f-b705-303895b24b76 None admin] RBAC: Authorizing `identity:create_grant(project_id=1270f05926f7448997238f13050bd699, user_id=9b84663de808427898fa66e8b8174931, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:14.837403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbb215-e958-491f-b705-303895b24b76 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:14.838893 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecef950-5452-49a9-8de2-d15ce57cd221 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:14.880901 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 70/132] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:38:14 2022] PUT /identity/v3/projects/1270f05926f7448997238f13050bd699/users/9b84663de808427898fa66e8b8174931/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:14.902364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9bf0e-8027-419e-ac17-174889cff066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:14.903063 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9bf0e-8027-419e-ac17-174889cff066 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:14.903346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9bf0e-8027-419e-ac17-174889cff066 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:14.903617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9bf0e-8027-419e-ac17-174889cff066 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:14.926591 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9bf0e-8027-419e-ac17-174889cff066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:14.932190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-50e9bf0e-8027-419e-ac17-174889cff066 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:38:14.932190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:14.932190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:14.932190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:14.932190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:14.932190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:14.932190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:14.932190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:14.932190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:14.932190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:14.932190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:14.932190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:14.932190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:14.932190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:14.932190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:14.932190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:14.933130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:14.933130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:14.933130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:14.933130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:14.933130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:14.933130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:14.933130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:14.933130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:14.933130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:14.933130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:14.933130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:14.933130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:14.933130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:14.933130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:14.933130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:14.933130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:14.933950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:14.933950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:14.933950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:14.933950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:14.933950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:14.933950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:14.933950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:14.933950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:14.933950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:14.933950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:14.933950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:38:14.933950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:14.933950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 63/133] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:38:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:14.942643 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbb215-e958-491f-b705-303895b24b76 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:15.074028 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:15.134439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbb215-e958-491f-b705-303895b24b76 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:15.177299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec2752-164a-4776-b01f-c099a7bbe89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:15.177972 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec2752-164a-4776-b01f-c099a7bbe89e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:15.178254 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec2752-164a-4776-b01f-c099a7bbe89e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:15.178528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec2752-164a-4776-b01f-c099a7bbe89e None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:15.179310 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec2752-164a-4776-b01f-c099a7bbe89e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:15.179620 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec2752-164a-4776-b01f-c099a7bbe89e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:15.181100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec2752-164a-4776-b01f-c099a7bbe89e None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:15.191869 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 71/134] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:38:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:15.197859 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9bf0e-8027-419e-ac17-174889cff066 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:15.334786 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:15.338965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9bf0e-8027-419e-ac17-174889cff066 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:15.385688 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6883fe-ee5e-4d9e-b580-fcd266c5336e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:15.386530 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6883fe-ee5e-4d9e-b580-fcd266c5336e None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:15.386862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6883fe-ee5e-4d9e-b580-fcd266c5336e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:15.387137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6883fe-ee5e-4d9e-b580-fcd266c5336e None admin] PATH_INFO: `/v3/users/9b84663de808427898fa66e8b8174931` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:15.388513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6883fe-ee5e-4d9e-b580-fcd266c5336e None admin] RBAC: Authorizing `identity:get_user(user_id=9b84663de808427898fa66e8b8174931)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:15.390121 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6883fe-ee5e-4d9e-b580-fcd266c5336e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:15.392598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 64/135] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:15 2022] GET /identity/v3/users/9b84663de808427898fa66e8b8174931 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:15.398429 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec2752-164a-4776-b01f-c099a7bbe89e None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:15.551735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec2752-164a-4776-b01f-c099a7bbe89e None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:15.579506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b196a5d-fd36-4a80-a24b-18ab3228a4a8 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:15.579907 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b196a5d-fd36-4a80-a24b-18ab3228a4a8 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:15.580137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b196a5d-fd36-4a80-a24b-18ab3228a4a8 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:15.581670 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 65/136] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:38:15.593922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae7fad-9d3f-45b8-819d-79cc328cb034 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:15.593922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae7fad-9d3f-45b8-819d-79cc328cb034 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:15.594145 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:15.594217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae7fad-9d3f-45b8-819d-79cc328cb034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:15.622627 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-a4ae7fad-9d3f-45b8-819d-79cc328cb034 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:15.624044 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a4ae7fad-9d3f-45b8-819d-79cc328cb034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:15.626360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376194a-6775-49d8-9d75-d635e2653cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:15.627446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376194a-6775-49d8-9d75-d635e2653cfa None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:15.627947 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376194a-6775-49d8-9d75-d635e2653cfa None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:15.628444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376194a-6775-49d8-9d75-d635e2653cfa None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:15.634334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376194a-6775-49d8-9d75-d635e2653cfa None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:15.636230 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376194a-6775-49d8-9d75-d635e2653cfa None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:15.638304 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 72/137] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:15 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:15.644602 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376194a-6775-49d8-9d75-d635e2653cfa None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:15.717403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 66/138] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:15.833427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376194a-6775-49d8-9d75-d635e2653cfa None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:15.914395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34469a92-fab7-44ab-918d-600e7b3cfe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:15.916007 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34469a92-fab7-44ab-918d-600e7b3cfe51 None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:15.916793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34469a92-fab7-44ab-918d-600e7b3cfe51 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:15.917552 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34469a92-fab7-44ab-918d-600e7b3cfe51 None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3/users/9b84663de808427898fa66e8b8174931/roles/e4d659212810456798a60c1902537d7d` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:15.924695 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34469a92-fab7-44ab-918d-600e7b3cfe51 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab929f16a6c349389781c723ea5d01a3, user_id=9b84663de808427898fa66e8b8174931, role_id=e4d659212810456798a60c1902537d7d)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:15.927842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34469a92-fab7-44ab-918d-600e7b3cfe51 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:15.967361 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 73/139] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:38:15 2022] PUT /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3/users/9b84663de808427898fa66e8b8174931/roles/e4d659212810456798a60c1902537d7d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:16.082104 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae7fad-9d3f-45b8-819d-79cc328cb034 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:16.202058 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:16.205609 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae7fad-9d3f-45b8-819d-79cc328cb034 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:16.249277 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7193ec1-b4a0-4c5b-83e5-a17242e23e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:16.249984 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7193ec1-b4a0-4c5b-83e5-a17242e23e22 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:16.250263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7193ec1-b4a0-4c5b-83e5-a17242e23e22 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:16.250536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7193ec1-b4a0-4c5b-83e5-a17242e23e22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:16.251851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7193ec1-b4a0-4c5b-83e5-a17242e23e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:16.253454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7193ec1-b4a0-4c5b-83e5-a17242e23e22 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:16.255457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 67/140] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:38:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:16.261721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34469a92-fab7-44ab-918d-600e7b3cfe51 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:16.322753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:16.383330 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34469a92-fab7-44ab-918d-600e7b3cfe51 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:16.424794 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6af97-69e5-4d17-916d-e334c44b5c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:16.425832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6af97-69e5-4d17-916d-e334c44b5c44 None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:16.425832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6af97-69e5-4d17-916d-e334c44b5c44 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:16.426052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6af97-69e5-4d17-916d-e334c44b5c44 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:16.426740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6af97-69e5-4d17-916d-e334c44b5c44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:16.428284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6af97-69e5-4d17-916d-e334c44b5c44 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:16.465632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 74/141] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:38:16 2022] POST /identity/v3/users => generated 283 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:16.853628 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa25dd9-99b9-4aeb-8b43-ca40c55225fd None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:16.854413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa25dd9-99b9-4aeb-8b43-ca40c55225fd None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:16.854413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa25dd9-99b9-4aeb-8b43-ca40c55225fd None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:16.857013 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 68/142] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:16.867815 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa0549-a1c9-45ba-b678-041514093bd0 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:16.868219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa0549-a1c9-45ba-b678-041514093bd0 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:16.868588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa0549-a1c9-45ba-b678-041514093bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:16.902558 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-adaa0549-a1c9-45ba-b678-041514093bd0 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:16.903932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-adaa0549-a1c9-45ba-b678-041514093bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:16.983684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 75/143] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:17.319774 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa25dd9-99b9-4aeb-8b43-ca40c55225fd None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:17.437555 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa25dd9-99b9-4aeb-8b43-ca40c55225fd None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:17.489226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf841a-6438-478c-b351-c296bc91dfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:17.489226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf841a-6438-478c-b351-c296bc91dfbc None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:17.489780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf841a-6438-478c-b351-c296bc91dfbc None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:17.490167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf841a-6438-478c-b351-c296bc91dfbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:17.505545 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf841a-6438-478c-b351-c296bc91dfbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:17.511027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-8edf841a-6438-478c-b351-c296bc91dfbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:17.511027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:17.511027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:17.511027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:17.511027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:17.511027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:17.511027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:17.511027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:17.511027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:17.511027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:17.511027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:17.511027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:17.511027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:17.511027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:17.511027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:17.511027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:17.512084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:17.512084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:17.512084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:17.512084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:17.512084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:17.512084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:17.512084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:17.512084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:17.512084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:17.512084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:17.512084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:17.512084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:17.512084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:17.512084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:17.512084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:17.512084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:17.513091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:17.513091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:17.513091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:17.513091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:17.513091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:17.513091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:17.513091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:17.513091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:17.513091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:17.513091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:17.513091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:17.513091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:17.515104 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 69/144] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:17.521778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa0549-a1c9-45ba-b678-041514093bd0 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:17.561897 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:17.645617 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa0549-a1c9-45ba-b678-041514093bd0 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:17.700906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ccb92-b1e9-48ca-9d4b-a730ce38f607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:17.702567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ccb92-b1e9-48ca-9d4b-a730ce38f607 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:17.702850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ccb92-b1e9-48ca-9d4b-a730ce38f607 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:17.703116 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ccb92-b1e9-48ca-9d4b-a730ce38f607 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:17.703814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ccb92-b1e9-48ca-9d4b-a730ce38f607 None admin] RBAC: Adding query filter params (name=member) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:17.704113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ccb92-b1e9-48ca-9d4b-a730ce38f607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:17.707594 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ccb92-b1e9-48ca-9d4b-a730ce38f607 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:17.725378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 76/145] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:17.733043 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf841a-6438-478c-b351-c296bc91dfbc None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:17.782026 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:17.886786 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf841a-6438-478c-b351-c296bc91dfbc None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:17.947592 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187faff-d81b-4900-aff9-1a8ab3d406af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:17.948211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187faff-d81b-4900-aff9-1a8ab3d406af None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:17.948485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187faff-d81b-4900-aff9-1a8ab3d406af None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:17.953399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187faff-d81b-4900-aff9-1a8ab3d406af None admin] PATH_INFO: `/v3/users/9b84663de808427898fa66e8b8174931` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:17.953399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187faff-d81b-4900-aff9-1a8ab3d406af None admin] RBAC: Authorizing `identity:get_user(user_id=9b84663de808427898fa66e8b8174931)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:17.953399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187faff-d81b-4900-aff9-1a8ab3d406af None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:17.955386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 70/146] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:17 2022] GET /identity/v3/users/9b84663de808427898fa66e8b8174931 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:17.962858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ccb92-b1e9-48ca-9d4b-a730ce38f607 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:18.152305 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ccb92-b1e9-48ca-9d4b-a730ce38f607 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:18.175606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:18.210514 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72825a8-0704-4fa9-a0a5-68a201bfb710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:18.211061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72825a8-0704-4fa9-a0a5-68a201bfb710 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:18.211334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72825a8-0704-4fa9-a0a5-68a201bfb710 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:18.211602 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72825a8-0704-4fa9-a0a5-68a201bfb710 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:18.302289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99987789-2ee7-49b2-a970-04df9e97d071 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:18.302709 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99987789-2ee7-49b2-a970-04df9e97d071 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:18.302871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99987789-2ee7-49b2-a970-04df9e97d071 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:18.304184 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 71/147] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:38:18.308847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72825a8-0704-4fa9-a0a5-68a201bfb710 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:18.310398 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72825a8-0704-4fa9-a0a5-68a201bfb710 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:18.315518 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8eb2c-cace-4e93-9072-c766218c22af None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:18.315828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8eb2c-cace-4e93-9072-c766218c22af None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:18.316068 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8eb2c-cace-4e93-9072-c766218c22af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:18.348607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-5bb8eb2c-cace-4e93-9072-c766218c22af None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:18.349846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5bb8eb2c-cace-4e93-9072-c766218c22af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:18.445512 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 72/148] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:38:18.503298 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 77/149] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:18.504208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:18.509525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8eb2c-cace-4e93-9072-c766218c22af None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:18.534020 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:18.619828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8eb2c-cace-4e93-9072-c766218c22af None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:18.659597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dd786-3b31-43e4-872e-9d3a5e39baae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:18.660259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dd786-3b31-43e4-872e-9d3a5e39baae None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:18.660529 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dd786-3b31-43e4-872e-9d3a5e39baae None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:18.660782 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dd786-3b31-43e4-872e-9d3a5e39baae None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:18.662093 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3dd786-3b31-43e4-872e-9d3a5e39baae None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:18.663641 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3dd786-3b31-43e4-872e-9d3a5e39baae None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:18.669565 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 73/150] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:18 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:18.671787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72825a8-0704-4fa9-a0a5-68a201bfb710 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:18.782346 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72825a8-0704-4fa9-a0a5-68a201bfb710 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:18.821255 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c11101-9279-4058-a2cf-73cbc58b44ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:18.821919 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c11101-9279-4058-a2cf-73cbc58b44ad None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:18.822252 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c11101-9279-4058-a2cf-73cbc58b44ad None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:18.822523 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c11101-9279-4058-a2cf-73cbc58b44ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:18.823319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c11101-9279-4058-a2cf-73cbc58b44ad None admin] RBAC: Adding query filter params (role.id=c770dd0c3bc540c3a48b0393d192b17a, scope.project.id=ab929f16a6c349389781c723ea5d01a3, user.id=9b84663de808427898fa66e8b8174931) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:18.823633 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c11101-9279-4058-a2cf-73cbc58b44ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:18.825103 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c11101-9279-4058-a2cf-73cbc58b44ad None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:18.832113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 78/151] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:18 2022] GET /identity/v3/role_assignments?user.id=9b84663de808427898fa66e8b8174931&scope.project.id=ab929f16a6c349389781c723ea5d01a3&role.id=c770dd0c3bc540c3a48b0393d192b17a => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:19.035486 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dd786-3b31-43e4-872e-9d3a5e39baae None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:19.174698 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:19.189368 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dd786-3b31-43e4-872e-9d3a5e39baae None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:19.251544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54372e03-7097-498c-a2ec-5672bc58dc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:19.252257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54372e03-7097-498c-a2ec-5672bc58dc48 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:19.252533 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54372e03-7097-498c-a2ec-5672bc58dc48 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:19.252795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54372e03-7097-498c-a2ec-5672bc58dc48 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:19.266370 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54372e03-7097-498c-a2ec-5672bc58dc48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:19.271534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-54372e03-7097-498c-a2ec-5672bc58dc48 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:19.271534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:19.271534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:19.271534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:19.271534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:19.271534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:19.271534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:19.271534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:19.271534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:19.271534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:19.271534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:19.271534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:19.271534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:19.271534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:19.271534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:19.271534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:19.273219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:19.273219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:19.273219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:19.273219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:19.273219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:19.273219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:19.273219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:19.273219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:19.273219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:19.273219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:19.273219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:19.273219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:19.273219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:19.273219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:19.273219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:19.273219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:19.274732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:19.274732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:19.274732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:19.274732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:19.274732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:19.274732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:19.274732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:19.274732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:19.274732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:19.274732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:19.274732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:19.274732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:19.274732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 74/152] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:19.281847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c11101-9279-4058-a2cf-73cbc58b44ad None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:19.376257 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:19.409166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d989758-f327-4c5e-a95f-c40c84972898 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:19.409494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d989758-f327-4c5e-a95f-c40c84972898 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:19.409739 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d989758-f327-4c5e-a95f-c40c84972898 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:19.412211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 75/153] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:19.426872 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c11101-9279-4058-a2cf-73cbc58b44ad None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:19.429922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d6011-4765-45bb-806c-34fb76e93d2a None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:19.430199 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d6011-4765-45bb-806c-34fb76e93d2a None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:19.430462 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d6011-4765-45bb-806c-34fb76e93d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:19.458033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-eb9d6011-4765-45bb-806c-34fb76e93d2a None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:19.459639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-eb9d6011-4765-45bb-806c-34fb76e93d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:19.485644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcc7a7-7552-4ae7-8463-1e4878c68663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:19.486498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcc7a7-7552-4ae7-8463-1e4878c68663 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:19.486778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcc7a7-7552-4ae7-8463-1e4878c68663 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:19.487051 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcc7a7-7552-4ae7-8463-1e4878c68663 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:19.487736 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcc7a7-7552-4ae7-8463-1e4878c68663 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:19.488034 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcc7a7-7552-4ae7-8463-1e4878c68663 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:19.490165 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fcc7a7-7552-4ae7-8463-1e4878c68663 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:19.499841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 79/154] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:19.506430 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcc7a7-7552-4ae7-8463-1e4878c68663 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:19.619095 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 76/155] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:19.628210 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcc7a7-7552-4ae7-8463-1e4878c68663 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:19.656660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:19.668814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7c7ad-ab12-4282-9714-1171814293f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:19.669528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7c7ad-ab12-4282-9714-1171814293f8 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:19.669810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7c7ad-ab12-4282-9714-1171814293f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:19.670084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7c7ad-ab12-4282-9714-1171814293f8 None admin] PATH_INFO: `/v3/users/be7d33fcd6b64026af066492ebb488a8` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:19.671451 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7c7ad-ab12-4282-9714-1171814293f8 None admin] RBAC: Authorizing `identity:get_user(user_id=be7d33fcd6b64026af066492ebb488a8)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:19.673010 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7c7ad-ab12-4282-9714-1171814293f8 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:19.677832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 80/156] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:19 2022] GET /identity/v3/users/be7d33fcd6b64026af066492ebb488a8 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:19.681408 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d6011-4765-45bb-806c-34fb76e93d2a None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:19.814295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:19.834931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b5d36-52f4-45bb-ade9-bd902e71c566 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:19.835325 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b5d36-52f4-45bb-ade9-bd902e71c566 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:19.835460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b5d36-52f4-45bb-ade9-bd902e71c566 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:19.838001 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 81/157] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:19.853851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf7412-dba6-46dc-876a-98482175f7a4 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:19.854143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d6011-4765-45bb-806c-34fb76e93d2a None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:19.854280 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf7412-dba6-46dc-876a-98482175f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:19.854389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf7412-dba6-46dc-876a-98482175f7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:19.891486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-7ddf7412-dba6-46dc-876a-98482175f7a4 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:19.892706 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-7ddf7412-dba6-46dc-876a-98482175f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:19.923489 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d4c99-31e5-4b80-b77f-93ea50404cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:19.924160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d4c99-31e5-4b80-b77f-93ea50404cd0 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:19.924441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d4c99-31e5-4b80-b77f-93ea50404cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:19.924698 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d4c99-31e5-4b80-b77f-93ea50404cd0 None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:19.925955 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d4c99-31e5-4b80-b77f-93ea50404cd0 None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:19.927594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d4c99-31e5-4b80-b77f-93ea50404cd0 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:19.929360 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 77/158] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:19 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:19.956217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d4c99-31e5-4b80-b77f-93ea50404cd0 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:20.017821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 82/159] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:20.164402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d4c99-31e5-4b80-b77f-93ea50404cd0 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:20.223208 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ed799-b8c9-4187-87d9-4a8d10a55572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:20.223920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ed799-b8c9-4187-87d9-4a8d10a55572 None admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:20.224198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ed799-b8c9-4187-87d9-4a8d10a55572 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:20.224471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ed799-b8c9-4187-87d9-4a8d10a55572 None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3/users/be7d33fcd6b64026af066492ebb488a8/roles/1f24a90c6e1a4534b0a55f86ccc0ee7f` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:20.226546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ed799-b8c9-4187-87d9-4a8d10a55572 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab929f16a6c349389781c723ea5d01a3, user_id=be7d33fcd6b64026af066492ebb488a8, role_id=1f24a90c6e1a4534b0a55f86ccc0ee7f)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:20.228054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ed799-b8c9-4187-87d9-4a8d10a55572 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:20.255147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 78/160] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:38:19 2022] PUT /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3/users/be7d33fcd6b64026af066492ebb488a8/roles/1f24a90c6e1a4534b0a55f86ccc0ee7f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:20.641727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf7412-dba6-46dc-876a-98482175f7a4 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:20.703630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ed799-b8c9-4187-87d9-4a8d10a55572 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:20.719151 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:20.883319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf7412-dba6-46dc-876a-98482175f7a4 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:20.898436 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ed799-b8c9-4187-87d9-4a8d10a55572 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:20.932915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:20.960900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78292ed5-728a-4255-a63a-eac9a70b6544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:20.961953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78292ed5-728a-4255-a63a-eac9a70b6544 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:20.963576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78292ed5-728a-4255-a63a-eac9a70b6544 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:20.964154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78292ed5-728a-4255-a63a-eac9a70b6544 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:20.976021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12cdf1-4794-4093-b927-b5e286057f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:20.977061 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12cdf1-4794-4093-b927-b5e286057f30 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:20.977552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12cdf1-4794-4093-b927-b5e286057f30 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:20.978015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12cdf1-4794-4093-b927-b5e286057f30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:20.990538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78292ed5-728a-4255-a63a-eac9a70b6544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:20.996188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-78292ed5-728a-4255-a63a-eac9a70b6544 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:20.996188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:20.996188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:20.996188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:20.996188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:20.996188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:20.996188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:20.996188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:20.996188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:20.996188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:20.996188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:20.996188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:20.996188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:20.996188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:20.996188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:20.996188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:20.997139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:20.997139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:20.997139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:20.997139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:20.997139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:20.997139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:20.997139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:20.997139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:20.997139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:20.997139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:20.997139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:20.997139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:20.997139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:20.997139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:20.997139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:20.997139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:20.998002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:20.998002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:20.998002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:20.998002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:20.998002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:20.998002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:20.998002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:20.998002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:20.998002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:20.998002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:20.998002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:20.998002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:38:21.005238 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12cdf1-4794-4093-b927-b5e286057f30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:21.006929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 83/161] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:21.013690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-1c12cdf1-4794-4093-b927-b5e286057f30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:38:21.013690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:21.013690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:21.013690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:21.013690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:21.013690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:21.013690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:21.013690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:21.013690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:21.013690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:21.013690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:21.013690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:21.013690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:21.013690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:21.013690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:21.013690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:21.014992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:21.014992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:21.014992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:21.014992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:21.014992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:21.014992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:21.014992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:21.014992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:21.014992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:21.014992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:21.014992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:21.014992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:21.014992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:21.014992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:21.014992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:21.014992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:21.015760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:21.015760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:21.015760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:21.015760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:21.015760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:21.015760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:21.015760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:21.015760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:21.015760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:21.015760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:21.015760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:38:21.015760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:21.017883 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78292ed5-728a-4255-a63a-eac9a70b6544 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:21.022658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 79/162] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:38:21.031925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12cdf1-4794-4093-b927-b5e286057f30 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:21.173036 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:21.198309 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78292ed5-728a-4255-a63a-eac9a70b6544 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:21.247663 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12cdf1-4794-4093-b927-b5e286057f30 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:21.272768 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b45ad2-8c72-4063-ac7e-ad65b4b35555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:21.274037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b45ad2-8c72-4063-ac7e-ad65b4b35555 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:21.274514 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b45ad2-8c72-4063-ac7e-ad65b4b35555 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:21.274970 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b45ad2-8c72-4063-ac7e-ad65b4b35555 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:21.275873 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b45ad2-8c72-4063-ac7e-ad65b4b35555 None admin] RBAC: Adding query filter params (name=member) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:21.276385 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b45ad2-8c72-4063-ac7e-ad65b4b35555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:21.283076 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b45ad2-8c72-4063-ac7e-ad65b4b35555 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:21.296606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 84/163] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:21.298523 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541c565-4244-4876-a235-cc4103fac245 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:21.299346 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541c565-4244-4876-a235-cc4103fac245 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:21.300036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541c565-4244-4876-a235-cc4103fac245 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:21.301944 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 85/164] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:21.307779 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541c565-4244-4876-a235-cc4103fac245 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:21.342470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20dd52f-b9ea-47f5-ae60-542df6fe25b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:21.343116 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dd52f-b9ea-47f5-ae60-542df6fe25b7 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:21.343407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dd52f-b9ea-47f5-ae60-542df6fe25b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:21.343671 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dd52f-b9ea-47f5-ae60-542df6fe25b7 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:21.344365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20dd52f-b9ea-47f5-ae60-542df6fe25b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:21.344666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20dd52f-b9ea-47f5-ae60-542df6fe25b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:21.346233 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20dd52f-b9ea-47f5-ae60-542df6fe25b7 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:21.371665 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 80/165] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:21.372773 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c5e53-4c23-4dbe-b418-b0ec92c18263 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:21.373018 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c5e53-4c23-4dbe-b418-b0ec92c18263 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:21.373379 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c5e53-4c23-4dbe-b418-b0ec92c18263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:21.418126 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-684c5e53-4c23-4dbe-b418-b0ec92c18263 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:21.419326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-684c5e53-4c23-4dbe-b418-b0ec92c18263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:21.445853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:21.580033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 81/166] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:21.581075 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c5e53-4c23-4dbe-b418-b0ec92c18263 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:21.644356 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541c565-4244-4876-a235-cc4103fac245 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:21.715335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:21.746949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e484dbb-15af-4f91-9810-3a986a5c001b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:21.748013 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e484dbb-15af-4f91-9810-3a986a5c001b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:21.753318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e484dbb-15af-4f91-9810-3a986a5c001b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:21.753960 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e484dbb-15af-4f91-9810-3a986a5c001b None admin] PATH_INFO: `/v3/users/9b84663de808427898fa66e8b8174931` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:21.755659 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e484dbb-15af-4f91-9810-3a986a5c001b None admin] RBAC: Authorizing `identity:get_user(user_id=9b84663de808427898fa66e8b8174931)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:21.757654 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e484dbb-15af-4f91-9810-3a986a5c001b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:21.759625 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 86/167] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:21 2022] GET /identity/v3/users/9b84663de808427898fa66e8b8174931 => generated 275 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:21.769919 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e484dbb-15af-4f91-9810-3a986a5c001b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:21.824943 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c5e53-4c23-4dbe-b418-b0ec92c18263 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:21.905495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3758f9-17a1-45ad-82fe-cb80408d1b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:21.906293 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3758f9-17a1-45ad-82fe-cb80408d1b5c None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:21.906635 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3758f9-17a1-45ad-82fe-cb80408d1b5c None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:21.906906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3758f9-17a1-45ad-82fe-cb80408d1b5c None admin] PATH_INFO: `/v3/users/5b7b370e89cd4d279855f8c68c6540e2` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:21.910192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3758f9-17a1-45ad-82fe-cb80408d1b5c None admin] RBAC: Authorizing `identity:get_user(user_id=5b7b370e89cd4d279855f8c68c6540e2)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:21.911702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3758f9-17a1-45ad-82fe-cb80408d1b5c None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:21.913650 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 82/168] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:21 2022] GET /identity/v3/users/5b7b370e89cd4d279855f8c68c6540e2 => generated 247 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:21.924444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3758f9-17a1-45ad-82fe-cb80408d1b5c None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:21.957153 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e484dbb-15af-4f91-9810-3a986a5c001b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:21.985819 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:22.041418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83dda9-7238-4075-8830-17b6e6ed5764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:22.041418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83dda9-7238-4075-8830-17b6e6ed5764 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:22.041418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83dda9-7238-4075-8830-17b6e6ed5764 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:22.041418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83dda9-7238-4075-8830-17b6e6ed5764 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:22.148475 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3758f9-17a1-45ad-82fe-cb80408d1b5c None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:22.174384 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83dda9-7238-4075-8830-17b6e6ed5764 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:22.176059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83dda9-7238-4075-8830-17b6e6ed5764 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:22.216314 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:22.241964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238acac5-b603-41ce-82da-6fe5246bbc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:22.242944 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238acac5-b603-41ce-82da-6fe5246bbc16 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:22.243363 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238acac5-b603-41ce-82da-6fe5246bbc16 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:22.243786 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238acac5-b603-41ce-82da-6fe5246bbc16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:22.306769 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 87/169] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 23:38:22.314725 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83dda9-7238-4075-8830-17b6e6ed5764 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:22.334000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:22.410022 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238acac5-b603-41ce-82da-6fe5246bbc16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:22.411811 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238acac5-b603-41ce-82da-6fe5246bbc16 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:22.434557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83dda9-7238-4075-8830-17b6e6ed5764 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:22.509703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be211d68-851e-4c46-8df5-a5aa0ab00e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:22.510520 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be211d68-851e-4c46-8df5-a5aa0ab00e88 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:22.510900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be211d68-851e-4c46-8df5-a5aa0ab00e88 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:22.511271 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be211d68-851e-4c46-8df5-a5aa0ab00e88 None admin] PATH_INFO: `/v3/projects/1270f05926f7448997238f13050bd699` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:22.512605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be211d68-851e-4c46-8df5-a5aa0ab00e88 None admin] RBAC: Authorizing `identity:get_project(project_id=1270f05926f7448997238f13050bd699)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:22.514222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be211d68-851e-4c46-8df5-a5aa0ab00e88 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:22.516417 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 88/170] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:22 2022] GET /identity/v3/projects/1270f05926f7448997238f13050bd699 => generated 312 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:22.517844 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be211d68-851e-4c46-8df5-a5aa0ab00e88 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:22.659295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 83/171] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:22.661272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238acac5-b603-41ce-82da-6fe5246bbc16 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:22.668200 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:22.697933 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:22.741202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be211d68-851e-4c46-8df5-a5aa0ab00e88 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:22.808718 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1847c-cba9-4fef-bee9-c9cf05e49cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:22.810077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1847c-cba9-4fef-bee9-c9cf05e49cc0 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:22.815160 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1847c-cba9-4fef-bee9-c9cf05e49cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:22.815627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1847c-cba9-4fef-bee9-c9cf05e49cc0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:22.841486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1847c-cba9-4fef-bee9-c9cf05e49cc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:22.852359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-dcb1847c-cba9-4fef-bee9-c9cf05e49cc0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:38:22.852359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:22.852359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:22.852359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:22.852359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:22.852359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:22.852359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:22.852359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:22.852359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:22.852359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:22.852359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:22.852359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:22.852359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:22.852359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:22.852359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:22.852359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:22.853407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:22.853407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:22.853407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:22.853407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:22.853407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:22.853407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:22.853407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:22.853407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:22.853407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:22.853407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:22.853407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:22.853407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:22.853407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:22.853407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:22.853407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:22.853407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:22.854170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:22.854170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:22.854170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:22.854170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:22.854170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:22.854170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:22.854170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:22.854170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:22.854170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:22.854170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:22.854170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:38:22.854170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:38:22.864436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 89/172] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:38:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:22.866072 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1847c-cba9-4fef-bee9-c9cf05e49cc0 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:22.912985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238acac5-b603-41ce-82da-6fe5246bbc16 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:23.046674 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb9db8-8a07-497d-927d-dc842969760f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:23.047720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9db8-8a07-497d-927d-dc842969760f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.048281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9db8-8a07-497d-927d-dc842969760f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.048766 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb9db8-8a07-497d-927d-dc842969760f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.050116 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb9db8-8a07-497d-927d-dc842969760f None admin] RBAC: Adding query filter params (role.id=c770dd0c3bc540c3a48b0393d192b17a, scope.project.id=1270f05926f7448997238f13050bd699, user.id=9b84663de808427898fa66e8b8174931) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:23.050649 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb9db8-8a07-497d-927d-dc842969760f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:23.053473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb9db8-8a07-497d-927d-dc842969760f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:23.067519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 84/173] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:22 2022] GET /identity/v3/role_assignments?user.id=9b84663de808427898fa66e8b8174931&scope.project.id=1270f05926f7448997238f13050bd699&role.id=c770dd0c3bc540c3a48b0393d192b17a => generated 608 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:23.069207 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59906c7-f664-4ba7-9f31-35089a6995b7 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.069768 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59906c7-f664-4ba7-9f31-35089a6995b7 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.070230 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59906c7-f664-4ba7-9f31-35089a6995b7 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.071829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 85/174] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:23.077742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59906c7-f664-4ba7-9f31-35089a6995b7 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:23.136337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1847c-cba9-4fef-bee9-c9cf05e49cc0 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:23.217801 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f277401-0b17-4cc7-82ab-d17f299d9e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:23.220443 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f277401-0b17-4cc7-82ab-d17f299d9e56 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.222996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f277401-0b17-4cc7-82ab-d17f299d9e56 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.223595 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f277401-0b17-4cc7-82ab-d17f299d9e56 None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.225237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f277401-0b17-4cc7-82ab-d17f299d9e56 None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:23.227198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f277401-0b17-4cc7-82ab-d17f299d9e56 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:23.230480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 90/175] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:22 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:23.233139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fffac6-e38b-4492-b45b-153eb70b8165 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.240167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fffac6-e38b-4492-b45b-153eb70b8165 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.240821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fffac6-e38b-4492-b45b-153eb70b8165 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.243006 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 91/176] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:23 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:23.245268 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677d62-657b-43a1-a8c0-91a1a0253c0c None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.251675 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677d62-657b-43a1-a8c0-91a1a0253c0c None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.253888 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677d62-657b-43a1-a8c0-91a1a0253c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.257503 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:23.282999 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59906c7-f664-4ba7-9f31-35089a6995b7 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:23.312976 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-48677d62-657b-43a1-a8c0-91a1a0253c0c None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:23.315249 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-48677d62-657b-43a1-a8c0-91a1a0253c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:23.321855 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:23.404435 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1204350-e70a-4b5b-9c4a-2899c39d2091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:23.404435 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1204350-e70a-4b5b-9c4a-2899c39d2091 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.406604 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1204350-e70a-4b5b-9c4a-2899c39d2091 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.407393 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1204350-e70a-4b5b-9c4a-2899c39d2091 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.409715 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1204350-e70a-4b5b-9c4a-2899c39d2091 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:23.409715 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1204350-e70a-4b5b-9c4a-2899c39d2091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:23.411899 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1204350-e70a-4b5b-9c4a-2899c39d2091 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:23.434312 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 86/177] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:38:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:23.441381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1204350-e70a-4b5b-9c4a-2899c39d2091 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:23.507392 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 92/178] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:23.511539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe282f-5a75-487e-a496-e655b78b49eb None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.512415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe282f-5a75-487e-a496-e655b78b49eb None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.513104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe282f-5a75-487e-a496-e655b78b49eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.546194 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-67fe282f-5a75-487e-a496-e655b78b49eb None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:23.549293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-67fe282f-5a75-487e-a496-e655b78b49eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:23.637730 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1204350-e70a-4b5b-9c4a-2899c39d2091 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:23.692165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb63c4-73ec-4418-ae8d-3bb1b6a1bb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:23.693156 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb63c4-73ec-4418-ae8d-3bb1b6a1bb3f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.694011 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb63c4-73ec-4418-ae8d-3bb1b6a1bb3f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.694438 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb63c4-73ec-4418-ae8d-3bb1b6a1bb3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.695927 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb63c4-73ec-4418-ae8d-3bb1b6a1bb3f None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.project.id=ab929f16a6c349389781c723ea5d01a3, user.id=5b7b370e89cd4d279855f8c68c6540e2) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:23.696413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb63c4-73ec-4418-ae8d-3bb1b6a1bb3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:23.698110 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb63c4-73ec-4418-ae8d-3bb1b6a1bb3f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:23.706681 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 87/179] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:23 2022] GET /identity/v3/role_assignments?user.id=5b7b370e89cd4d279855f8c68c6540e2&scope.project.id=ab929f16a6c349389781c723ea5d01a3&role.id=440092230f024959a90e846ab29c6367 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:23.708152 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb63c4-73ec-4418-ae8d-3bb1b6a1bb3f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:23.732055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 93/180] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:23.733846 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be720a1-7c8b-48d8-bd43-9d7337bb15c3 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.734335 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be720a1-7c8b-48d8-bd43-9d7337bb15c3 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.734759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be720a1-7c8b-48d8-bd43-9d7337bb15c3 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.736944 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 94/181] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:23.745188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb38db1-14d8-4541-9fe4-e0d247758017 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.745733 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb38db1-14d8-4541-9fe4-e0d247758017 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.746221 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb38db1-14d8-4541-9fe4-e0d247758017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.748308 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:23.784955 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-6fb38db1-14d8-4541-9fe4-e0d247758017 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:23.786297 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6fb38db1-14d8-4541-9fe4-e0d247758017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:23.938427 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb63c4-73ec-4418-ae8d-3bb1b6a1bb3f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:23.949874 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:23.963100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 95/182] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:23.964199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94372e-fd8f-4c83-8604-188129365126 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.964565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94372e-fd8f-4c83-8604-188129365126 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.964788 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94372e-fd8f-4c83-8604-188129365126 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:23.968129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 96/183] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:23.974166 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5dc7f-06f6-4e57-b286-418ca206baae None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:23.974790 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5dc7f-06f6-4e57-b286-418ca206baae None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:23.975292 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5dc7f-06f6-4e57-b286-418ca206baae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:24.025110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-d9e5dc7f-06f6-4e57-b286-418ca206baae None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:24.027425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d9e5dc7f-06f6-4e57-b286-418ca206baae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:24.052272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f2a9c-f66d-42ce-b762-9f365992d71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:24.052929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f2a9c-f66d-42ce-b762-9f365992d71c None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:24.053196 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f2a9c-f66d-42ce-b762-9f365992d71c None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:24.053548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f2a9c-f66d-42ce-b762-9f365992d71c None admin] PATH_INFO: `/v3/users/9b84663de808427898fa66e8b8174931` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:24.054876 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f2a9c-f66d-42ce-b762-9f365992d71c None admin] RBAC: Authorizing `identity:get_user(user_id=9b84663de808427898fa66e8b8174931)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:24.056393 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f2a9c-f66d-42ce-b762-9f365992d71c None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:24.058159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 88/184] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:23 2022] GET /identity/v3/users/9b84663de808427898fa66e8b8174931 => generated 275 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:24.059074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f2a9c-f66d-42ce-b762-9f365992d71c None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:24.118070 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 97/185] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:38:24.119389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5dc7f-06f6-4e57-b286-418ca206baae None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:24.243558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:24.276252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f2a9c-f66d-42ce-b762-9f365992d71c None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:24.344996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5dc7f-06f6-4e57-b286-418ca206baae None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:24.350821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6df46-8494-4145-8994-9ac954ea1b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:24.351634 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6df46-8494-4145-8994-9ac954ea1b66 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:24.351963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6df46-8494-4145-8994-9ac954ea1b66 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:24.352230 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6df46-8494-4145-8994-9ac954ea1b66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:24.367664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6df46-8494-4145-8994-9ac954ea1b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:24.374300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-bda6df46-8494-4145-8994-9ac954ea1b66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:38:24.374300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:24.374300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:24.374300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:24.374300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:24.374300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:24.374300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:24.374300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:24.374300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:24.374300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:24.374300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:24.374300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:24.374300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:24.374300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:24.374300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:24.374300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:24.375204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:24.375204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:24.375204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:24.375204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:24.375204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:24.375204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:24.375204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:24.375204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:24.375204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:24.375204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:24.375204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:24.375204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:24.375204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:24.375204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:24.375204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:24.375204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:24.375977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:24.375977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:24.375977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:24.375977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:24.375977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:24.375977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:24.375977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:24.375977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:24.375977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:24.375977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:24.375977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:38:24.375977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:24.376651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 89/186] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:38:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:24.378539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6df46-8494-4145-8994-9ac954ea1b66 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:24.396501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:24.408793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251111d-2a80-4817-b564-0b6873473048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:24.409526 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251111d-2a80-4817-b564-0b6873473048 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:24.409803 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251111d-2a80-4817-b564-0b6873473048 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:24.410070 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251111d-2a80-4817-b564-0b6873473048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:24.497474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251111d-2a80-4817-b564-0b6873473048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:24.499234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251111d-2a80-4817-b564-0b6873473048 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:24.502154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6df46-8494-4145-8994-9ac954ea1b66 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:24.539998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d6c7f-5c56-4fdc-8d2a-2225c9b91891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:24.540812 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d6c7f-5c56-4fdc-8d2a-2225c9b91891 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:24.541179 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d6c7f-5c56-4fdc-8d2a-2225c9b91891 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:24.541644 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d6c7f-5c56-4fdc-8d2a-2225c9b91891 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:24.557865 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d6c7f-5c56-4fdc-8d2a-2225c9b91891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:24.567851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-303d6c7f-5c56-4fdc-8d2a-2225c9b91891 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:38:24.567851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:24.567851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:24.567851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:24.567851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:24.567851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:24.567851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:24.567851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:24.567851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:24.567851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:24.567851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:24.567851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:24.567851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:24.567851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:24.567851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:24.567851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:24.568901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:24.568901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:24.568901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:24.568901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:24.568901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:24.568901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:24.568901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:24.568901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:24.568901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:24.568901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:24.568901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:24.568901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:24.568901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:24.568901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:24.568901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:24.568901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:24.569702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:24.569702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:24.569702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:24.569702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:24.569702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:24.569702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:24.569702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:24.569702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:24.569702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:24.569702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:24.569702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:38:24.569702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:24.570307 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 90/187] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:38:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:24.571516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d6c7f-5c56-4fdc-8d2a-2225c9b91891 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:24.578357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:24.628945 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 98/188] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:24.629877 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251111d-2a80-4817-b564-0b6873473048 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:24.661847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:24.727214 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d6c7f-5c56-4fdc-8d2a-2225c9b91891 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:24.753505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251111d-2a80-4817-b564-0b6873473048 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:24.766942 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b45316-76f1-4c1c-ab60-8bd83f904dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:24.767590 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b45316-76f1-4c1c-ab60-8bd83f904dae None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:24.767862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b45316-76f1-4c1c-ab60-8bd83f904dae None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:24.768127 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b45316-76f1-4c1c-ab60-8bd83f904dae None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:24.768799 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b45316-76f1-4c1c-ab60-8bd83f904dae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:24.769099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b45316-76f1-4c1c-ab60-8bd83f904dae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:24.770917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b45316-76f1-4c1c-ab60-8bd83f904dae None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:24.779247 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 91/189] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:38:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:24.784788 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b45316-76f1-4c1c-ab60-8bd83f904dae None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:24.808532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48974a53-db17-4059-8d34-dfc34c21e745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:24.809663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48974a53-db17-4059-8d34-dfc34c21e745 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:24.810136 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48974a53-db17-4059-8d34-dfc34c21e745 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:24.810600 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48974a53-db17-4059-8d34-dfc34c21e745 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:24.812938 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48974a53-db17-4059-8d34-dfc34c21e745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:24.815744 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48974a53-db17-4059-8d34-dfc34c21e745 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:24.821423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 99/190] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:38:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:24.821423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48974a53-db17-4059-8d34-dfc34c21e745 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:24.865092 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:24.922404 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b45316-76f1-4c1c-ab60-8bd83f904dae None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:24.958526 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:24.965634 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48974a53-db17-4059-8d34-dfc34c21e745 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:24.970811 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493d652-59ae-4976-afa2-bf2dfc9e929c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:24.971481 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493d652-59ae-4976-afa2-bf2dfc9e929c None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:24.971760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493d652-59ae-4976-afa2-bf2dfc9e929c None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:24.972026 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493d652-59ae-4976-afa2-bf2dfc9e929c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:24.984833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493d652-59ae-4976-afa2-bf2dfc9e929c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:24.990449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-e493d652-59ae-4976-afa2-bf2dfc9e929c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:24.990449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:24.990449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:24.990449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:24.990449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:24.990449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:24.990449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:24.990449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:24.990449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:24.990449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:24.990449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:24.990449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:24.990449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:24.990449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:24.990449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:24.990449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:24.993836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:24.993836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:24.993836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:24.993836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:24.993836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:24.993836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:24.993836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:24.993836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:24.993836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:24.993836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:24.993836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:24.993836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:24.993836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:24.993836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:24.993836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:24.993836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:24.995375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:24.995375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:24.995375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:24.995375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:24.995375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:24.995375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:24.995375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:24.995375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:24.995375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:24.995375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:24.995375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:24.995375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:24.995375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 92/191] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:24.995375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493d652-59ae-4976-afa2-bf2dfc9e929c None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:25.022637 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fc8f8-6bdb-4236-aabb-ef72567405cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:25.023498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fc8f8-6bdb-4236-aabb-ef72567405cb None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:25.023932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fc8f8-6bdb-4236-aabb-ef72567405cb None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:25.024371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fc8f8-6bdb-4236-aabb-ef72567405cb None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:25.025550 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fc8f8-6bdb-4236-aabb-ef72567405cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:25.026044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fc8f8-6bdb-4236-aabb-ef72567405cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:25.028486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fc8f8-6bdb-4236-aabb-ef72567405cb None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:25.048771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 100/192] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:25.048771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fc8f8-6bdb-4236-aabb-ef72567405cb None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:25.111568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493d652-59ae-4976-afa2-bf2dfc9e929c None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:25.139824 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:25.150550 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3fe4c-4f55-4f17-9793-03f0cc5f2689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:25.151198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3fe4c-4f55-4f17-9793-03f0cc5f2689 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:25.151480 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3fe4c-4f55-4f17-9793-03f0cc5f2689 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:25.151746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3fe4c-4f55-4f17-9793-03f0cc5f2689 None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:25.152945 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3fe4c-4f55-4f17-9793-03f0cc5f2689 None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:25.154518 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3fe4c-4f55-4f17-9793-03f0cc5f2689 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:25.156233 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 93/193] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:24 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:25.157011 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3fe4c-4f55-4f17-9793-03f0cc5f2689 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:25.167103 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fc8f8-6bdb-4236-aabb-ef72567405cb None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:25.206055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183da892-5cf8-46c4-a8b5-1ba5d1998de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:25.206719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183da892-5cf8-46c4-a8b5-1ba5d1998de3 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:25.207001 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183da892-5cf8-46c4-a8b5-1ba5d1998de3 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:25.207269 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183da892-5cf8-46c4-a8b5-1ba5d1998de3 None admin] PATH_INFO: `/v3/users/8e2fdae3a3cf4e13bd818a4e4b6d6a65` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:25.223982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183da892-5cf8-46c4-a8b5-1ba5d1998de3 None admin] RBAC: Authorizing `identity:get_user(user_id=8e2fdae3a3cf4e13bd818a4e4b6d6a65)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:25.225541 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183da892-5cf8-46c4-a8b5-1ba5d1998de3 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:25.227299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 101/194] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:25 2022] GET /identity/v3/users/8e2fdae3a3cf4e13bd818a4e4b6d6a65 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:25.228117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183da892-5cf8-46c4-a8b5-1ba5d1998de3 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:25.249375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:25.278961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3fe4c-4f55-4f17-9793-03f0cc5f2689 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:25.316447 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb1eb9-3b40-4fca-a600-59bf8596a39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:25.317076 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb1eb9-3b40-4fca-a600-59bf8596a39b None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:25.317389 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb1eb9-3b40-4fca-a600-59bf8596a39b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:25.317659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb1eb9-3b40-4fca-a600-59bf8596a39b None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:25.318326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb1eb9-3b40-4fca-a600-59bf8596a39b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:25.319830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb1eb9-3b40-4fca-a600-59bf8596a39b None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:25.343544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 94/195] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:38:25 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:25.344425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb1eb9-3b40-4fca-a600-59bf8596a39b None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:25.348180 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183da892-5cf8-46c4-a8b5-1ba5d1998de3 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:25.406619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da959fc-0b7c-4f98-a13f-3e06352276ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:25.407456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da959fc-0b7c-4f98-a13f-3e06352276ff None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:25.407965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da959fc-0b7c-4f98-a13f-3e06352276ff None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:25.408404 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da959fc-0b7c-4f98-a13f-3e06352276ff None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:25.409536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da959fc-0b7c-4f98-a13f-3e06352276ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:25.410143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da959fc-0b7c-4f98-a13f-3e06352276ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:25.412158 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da959fc-0b7c-4f98-a13f-3e06352276ff None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:25.415151 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:25.427088 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 102/196] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:25.428562 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da959fc-0b7c-4f98-a13f-3e06352276ff None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:25.488336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb1eb9-3b40-4fca-a600-59bf8596a39b None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:25.536185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973233f-70ed-49b5-bb5e-eb44f92d8805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:25.537082 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973233f-70ed-49b5-bb5e-eb44f92d8805 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:25.537627 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973233f-70ed-49b5-bb5e-eb44f92d8805 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:25.538073 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973233f-70ed-49b5-bb5e-eb44f92d8805 None admin] PATH_INFO: `/v3/users/8e2fdae3a3cf4e13bd818a4e4b6d6a65` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:25.539716 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973233f-70ed-49b5-bb5e-eb44f92d8805 None admin] RBAC: Authorizing `identity:get_user(user_id=8e2fdae3a3cf4e13bd818a4e4b6d6a65)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:25.541602 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973233f-70ed-49b5-bb5e-eb44f92d8805 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:25.541767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:25.544441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 95/197] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:25 2022] GET /identity/v3/users/8e2fdae3a3cf4e13bd818a4e4b6d6a65 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:25.547271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973233f-70ed-49b5-bb5e-eb44f92d8805 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:25.587813 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da959fc-0b7c-4f98-a13f-3e06352276ff None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:25.643449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705909b-ae16-4a58-869a-1e7ab05ac8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:25.644679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705909b-ae16-4a58-869a-1e7ab05ac8e0 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:25.644679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705909b-ae16-4a58-869a-1e7ab05ac8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:25.644679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705909b-ae16-4a58-869a-1e7ab05ac8e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:25.645472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705909b-ae16-4a58-869a-1e7ab05ac8e0 None admin] RBAC: Adding query filter params (role.id=e4d659212810456798a60c1902537d7d, scope.project.id=ab929f16a6c349389781c723ea5d01a3, user.id=9b84663de808427898fa66e8b8174931) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:25.645791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705909b-ae16-4a58-869a-1e7ab05ac8e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:25.647322 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705909b-ae16-4a58-869a-1e7ab05ac8e0 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:25.654858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 103/198] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:25 2022] GET /identity/v3/role_assignments?user.id=9b84663de808427898fa66e8b8174931&scope.project.id=ab929f16a6c349389781c723ea5d01a3&role.id=e4d659212810456798a60c1902537d7d => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:25.658361 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705909b-ae16-4a58-869a-1e7ab05ac8e0 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:25.713330 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973233f-70ed-49b5-bb5e-eb44f92d8805 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:25.750454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:25.777179 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a9d3b-85b0-4844-b647-df5fdc60af6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:25.777859 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a9d3b-85b0-4844-b647-df5fdc60af6c None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:25.778209 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a9d3b-85b0-4844-b647-df5fdc60af6c None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:25.778482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a9d3b-85b0-4844-b647-df5fdc60af6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:25.839402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705909b-ae16-4a58-869a-1e7ab05ac8e0 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:25.902806 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a9d3b-85b0-4844-b647-df5fdc60af6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:25.906020 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a9d3b-85b0-4844-b647-df5fdc60af6c None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:25.909507 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f21159-547d-4f6e-8577-f1569b7842f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:25.910582 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f21159-547d-4f6e-8577-f1569b7842f8 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:25.911039 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f21159-547d-4f6e-8577-f1569b7842f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:25.911494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f21159-547d-4f6e-8577-f1569b7842f8 None admin] PATH_INFO: `/v3/users/be7d33fcd6b64026af066492ebb488a8` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:25.914636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f21159-547d-4f6e-8577-f1569b7842f8 None admin] RBAC: Authorizing `identity:get_user(user_id=be7d33fcd6b64026af066492ebb488a8)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:25.917253 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f21159-547d-4f6e-8577-f1569b7842f8 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:25.920923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 104/199] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:25 2022] GET /identity/v3/users/be7d33fcd6b64026af066492ebb488a8 => generated 289 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:25.925470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f21159-547d-4f6e-8577-f1569b7842f8 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:25.949765 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:26.077841 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 96/200] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:26.079532 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a9d3b-85b0-4844-b647-df5fdc60af6c None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:26.125153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:26.129124 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f21159-547d-4f6e-8577-f1569b7842f8 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:26.201109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7763193-46a3-4d2b-a540-a75316c2d803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:26.202123 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7763193-46a3-4d2b-a540-a75316c2d803 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:26.202561 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7763193-46a3-4d2b-a540-a75316c2d803 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:26.203172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7763193-46a3-4d2b-a540-a75316c2d803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:26.289586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a9d3b-85b0-4844-b647-df5fdc60af6c None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:26.332095 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7763193-46a3-4d2b-a540-a75316c2d803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:26.334172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7763193-46a3-4d2b-a540-a75316c2d803 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:26.350002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:26.354103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857ef07-ae2b-4943-90dc-72f1031067b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:26.355202 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857ef07-ae2b-4943-90dc-72f1031067b0 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:26.355865 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857ef07-ae2b-4943-90dc-72f1031067b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:26.356337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857ef07-ae2b-4943-90dc-72f1031067b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:26.454951 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 105/201] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:26.456293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7763193-46a3-4d2b-a540-a75316c2d803 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:26.502481 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857ef07-ae2b-4943-90dc-72f1031067b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:26.504882 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857ef07-ae2b-4943-90dc-72f1031067b0 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:26.540180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:26.580534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7763193-46a3-4d2b-a540-a75316c2d803 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:26.594103 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:26.623741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8f69b-9b3d-41c4-8137-a4ebbddbea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:26.624772 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8f69b-9b3d-41c4-8137-a4ebbddbea18 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:26.625273 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8f69b-9b3d-41c4-8137-a4ebbddbea18 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:26.625843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8f69b-9b3d-41c4-8137-a4ebbddbea18 None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:26.627417 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8f69b-9b3d-41c4-8137-a4ebbddbea18 None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:26.629391 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8f69b-9b3d-41c4-8137-a4ebbddbea18 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:26.631607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 106/202] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:26 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:26.632772 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8f69b-9b3d-41c4-8137-a4ebbddbea18 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:26.718684 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 97/203] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:26.720285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857ef07-ae2b-4943-90dc-72f1031067b0 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:26.785734 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8f69b-9b3d-41c4-8137-a4ebbddbea18 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:26.829192 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cece607-8b72-4794-8cda-245f6d84b816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:26.830432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cece607-8b72-4794-8cda-245f6d84b816 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:26.831005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cece607-8b72-4794-8cda-245f6d84b816 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:26.831539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cece607-8b72-4794-8cda-245f6d84b816 None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:26.833263 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cece607-8b72-4794-8cda-245f6d84b816 None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:26.835025 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cece607-8b72-4794-8cda-245f6d84b816 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:26.837604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 107/204] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:26 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:26.838699 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cece607-8b72-4794-8cda-245f6d84b816 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:26.897011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:26.934691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857ef07-ae2b-4943-90dc-72f1031067b0 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:26.963432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cece607-8b72-4794-8cda-245f6d84b816 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:26.969151 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:27.003131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43291f6-5565-4e00-bfff-6de16d9ad187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:27.004446 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43291f6-5565-4e00-bfff-6de16d9ad187 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:27.005266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43291f6-5565-4e00-bfff-6de16d9ad187 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:27.006006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43291f6-5565-4e00-bfff-6de16d9ad187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:27.007001 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a55a5f-4080-4da0-b4bd-3c09e38fd359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:27.007579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43291f6-5565-4e00-bfff-6de16d9ad187 None admin] RBAC: Adding query filter params (role.id=e4d659212810456798a60c1902537d7d, scope.project.id=a281171d594749e4986718444da08d9e, user.id=8e2fdae3a3cf4e13bd818a4e4b6d6a65) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:27.007991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a55a5f-4080-4da0-b4bd-3c09e38fd359 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:27.008332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43291f6-5565-4e00-bfff-6de16d9ad187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:27.008587 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a55a5f-4080-4da0-b4bd-3c09e38fd359 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:27.008998 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a55a5f-4080-4da0-b4bd-3c09e38fd359 None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:27.010427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a55a5f-4080-4da0-b4bd-3c09e38fd359 None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:27.011571 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43291f6-5565-4e00-bfff-6de16d9ad187 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:27.012238 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a55a5f-4080-4da0-b4bd-3c09e38fd359 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:27.019416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 108/205] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:26 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:27.020819 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a55a5f-4080-4da0-b4bd-3c09e38fd359 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:27.023789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 98/206] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:26 2022] GET /identity/v3/role_assignments?user.id=8e2fdae3a3cf4e13bd818a4e4b6d6a65&scope.project.id=a281171d594749e4986718444da08d9e&role.id=e4d659212810456798a60c1902537d7d => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:27.026060 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43291f6-5565-4e00-bfff-6de16d9ad187 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:27.145997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a55a5f-4080-4da0-b4bd-3c09e38fd359 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:27.164912 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:27.190343 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82910951-f5ff-4354-bd84-1e3438914940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:27.191305 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82910951-f5ff-4354-bd84-1e3438914940 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:27.191739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82910951-f5ff-4354-bd84-1e3438914940 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:27.192303 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82910951-f5ff-4354-bd84-1e3438914940 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:27.193258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82910951-f5ff-4354-bd84-1e3438914940 None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.project.id=a281171d594749e4986718444da08d9e, user.id=8e2fdae3a3cf4e13bd818a4e4b6d6a65) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:27.193768 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82910951-f5ff-4354-bd84-1e3438914940 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:27.195487 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82910951-f5ff-4354-bd84-1e3438914940 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:27.202355 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 109/207] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:27 2022] GET /identity/v3/role_assignments?user.id=8e2fdae3a3cf4e13bd818a4e4b6d6a65&scope.project.id=a281171d594749e4986718444da08d9e&role.id=440092230f024959a90e846ab29c6367 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:27.244713 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43291f6-5565-4e00-bfff-6de16d9ad187 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:27.302244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759143f-8b94-4e21-b8b1-a41bb4ba8b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:27.303729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759143f-8b94-4e21-b8b1-a41bb4ba8b94 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:27.304214 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759143f-8b94-4e21-b8b1-a41bb4ba8b94 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:27.304828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759143f-8b94-4e21-b8b1-a41bb4ba8b94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:27.305854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759143f-8b94-4e21-b8b1-a41bb4ba8b94 None admin] RBAC: Adding query filter params (role.id=1f24a90c6e1a4534b0a55f86ccc0ee7f, scope.project.id=ab929f16a6c349389781c723ea5d01a3, user.id=be7d33fcd6b64026af066492ebb488a8) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:27.306375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759143f-8b94-4e21-b8b1-a41bb4ba8b94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:27.308173 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759143f-8b94-4e21-b8b1-a41bb4ba8b94 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:27.315880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 99/208] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:27 2022] GET /identity/v3/role_assignments?user.id=be7d33fcd6b64026af066492ebb488a8&scope.project.id=ab929f16a6c349389781c723ea5d01a3&role.id=1f24a90c6e1a4534b0a55f86ccc0ee7f => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:29.031659 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffac16-33d8-45e6-bf39-c647688ecf01 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:29.033105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffac16-33d8-45e6-bf39-c647688ecf01 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:29.033828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffac16-33d8-45e6-bf39-c647688ecf01 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:29.036424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 110/209] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:38:29.045252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa9e41-1b95-41de-ac21-86d9e9043a30 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:29.046634 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa9e41-1b95-41de-ac21-86d9e9043a30 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:29.047295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa9e41-1b95-41de-ac21-86d9e9043a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:29.078238 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-2caa9e41-1b95-41de-ac21-86d9e9043a30 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:29.080880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-2caa9e41-1b95-41de-ac21-86d9e9043a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:29.163104 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:29.210566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995a8f9-ccf0-4dcf-9e07-3d23a11e7a9e None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:29.211466 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995a8f9-ccf0-4dcf-9e07-3d23a11e7a9e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:29.212162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995a8f9-ccf0-4dcf-9e07-3d23a11e7a9e None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:29.212807 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 100/210] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:29.215112 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 111/211] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:29.224188 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba8cab-f3dc-4dca-84a1-e49554695d2c None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:29.225070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba8cab-f3dc-4dca-84a1-e49554695d2c None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:29.225833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba8cab-f3dc-4dca-84a1-e49554695d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:29.256150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-06ba8cab-f3dc-4dca-84a1-e49554695d2c None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:29.258649 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-06ba8cab-f3dc-4dca-84a1-e49554695d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:29.372088 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 101/212] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:29.424430 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bacad-a336-4d84-aa4e-18c0d7d4b2bd None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:29.424743 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bacad-a336-4d84-aa4e-18c0d7d4b2bd None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:29.424983 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bacad-a336-4d84-aa4e-18c0d7d4b2bd None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:29.426679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 112/213] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:29.433085 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753b559-d594-4da9-8f3d-96bda060dcd7 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:29.433414 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753b559-d594-4da9-8f3d-96bda060dcd7 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:29.433671 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753b559-d594-4da9-8f3d-96bda060dcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:29.453837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-b753b559-d594-4da9-8f3d-96bda060dcd7 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:29.455095 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-b753b559-d594-4da9-8f3d-96bda060dcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:29.541273 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bacad-a336-4d84-aa4e-18c0d7d4b2bd None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:29.565442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 102/214] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:29.662674 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bacad-a336-4d84-aa4e-18c0d7d4b2bd None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:29.701240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd865c-4f31-4dd6-8938-0f53244b350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:29.702938 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753b559-d594-4da9-8f3d-96bda060dcd7 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:29.703337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd865c-4f31-4dd6-8938-0f53244b350a None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:29.703905 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd865c-4f31-4dd6-8938-0f53244b350a None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:29.704480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd865c-4f31-4dd6-8938-0f53244b350a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:29.718502 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd865c-4f31-4dd6-8938-0f53244b350a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:29.724579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-cddd865c-4f31-4dd6-8938-0f53244b350a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:29.724579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:29.724579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:29.724579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:29.724579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:29.724579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:29.724579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:29.724579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:29.724579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:29.724579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:29.724579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:29.724579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:29.724579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:29.724579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:29.724579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:29.724579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:29.725574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:29.725574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:29.725574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:29.725574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:29.725574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:29.725574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:29.725574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:29.725574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:29.725574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:29.725574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:29.725574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:29.725574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:29.725574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:29.725574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:29.725574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:29.725574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:29.726358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:29.726358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:29.726358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:29.726358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:29.726358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:29.726358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:29.726358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:29.726358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:29.726358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:29.726358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:29.726358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:29.726358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:38:29.729195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 113/215] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:38:29.738455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd865c-4f31-4dd6-8938-0f53244b350a None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:29.785017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:29.801751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:29.826677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753b559-d594-4da9-8f3d-96bda060dcd7 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:29.852130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd865c-4f31-4dd6-8938-0f53244b350a None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:29.866605 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb98e02-85dc-4b23-8b55-8dcb7976938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:29.867259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb98e02-85dc-4b23-8b55-8dcb7976938f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:29.867528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb98e02-85dc-4b23-8b55-8dcb7976938f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:29.867918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb98e02-85dc-4b23-8b55-8dcb7976938f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:29.869060 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb98e02-85dc-4b23-8b55-8dcb7976938f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:29.870565 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb98e02-85dc-4b23-8b55-8dcb7976938f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:29.873809 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 103/216] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:38:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:29.873809 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb98e02-85dc-4b23-8b55-8dcb7976938f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:29.894956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cc749-c632-4ac5-aa05-325531073d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:29.895588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cc749-c632-4ac5-aa05-325531073d6b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:29.895956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cc749-c632-4ac5-aa05-325531073d6b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:29.896277 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cc749-c632-4ac5-aa05-325531073d6b None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:29.896956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cc749-c632-4ac5-aa05-325531073d6b None admin] RBAC: Adding query filter params (name=member) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:29.897268 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cc749-c632-4ac5-aa05-325531073d6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:29.898912 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cc749-c632-4ac5-aa05-325531073d6b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:29.909122 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 114/217] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:29.914845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cc749-c632-4ac5-aa05-325531073d6b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:29.992544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb98e02-85dc-4b23-8b55-8dcb7976938f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:29.995169 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:30.020681 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:30.024462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cc749-c632-4ac5-aa05-325531073d6b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.032066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd211db-b7a1-427d-ad05-274d7cbb4b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.032801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd211db-b7a1-427d-ad05-274d7cbb4b91 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.033094 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd211db-b7a1-427d-ad05-274d7cbb4b91 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.033391 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd211db-b7a1-427d-ad05-274d7cbb4b91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.046005 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd211db-b7a1-427d-ad05-274d7cbb4b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:30.052350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-edd211db-b7a1-427d-ad05-274d7cbb4b91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:38:30.052350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:30.052350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:30.052350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:30.052350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:30.052350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:30.052350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:30.052350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:30.052350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:30.052350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:30.052350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:30.052350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:30.052350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:30.052350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:30.052350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:30.052350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:30.053720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:30.053720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:30.053720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:30.053720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:30.053720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:30.053720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:30.053720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:30.053720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:30.053720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:30.053720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:30.053720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:30.053720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:30.053720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:30.053720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:30.053720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:30.053720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:30.055182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:30.055182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:30.055182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:30.055182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:30.055182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:30.055182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:30.055182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:30.055182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:30.055182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:30.055182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:30.055182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:38:30.055182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:30.055182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 104/218] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:38:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:30.055182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f4226-057e-46d9-9a2e-fbea535dc289 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.056509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f4226-057e-46d9-9a2e-fbea535dc289 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.056509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f4226-057e-46d9-9a2e-fbea535dc289 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.063089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 105/219] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:30.063089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f4226-057e-46d9-9a2e-fbea535dc289 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.080504 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25395edd-de04-4811-9ef8-caaa896a3bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.081335 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25395edd-de04-4811-9ef8-caaa896a3bbb None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.081697 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25395edd-de04-4811-9ef8-caaa896a3bbb None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.082066 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25395edd-de04-4811-9ef8-caaa896a3bbb None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.082953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25395edd-de04-4811-9ef8-caaa896a3bbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.084628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25395edd-de04-4811-9ef8-caaa896a3bbb None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.113310 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 115/220] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:38:29 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:30.114892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25395edd-de04-4811-9ef8-caaa896a3bbb None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.231822 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f4226-057e-46d9-9a2e-fbea535dc289 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.289295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505da58-cbbc-4841-923d-14a509f1455e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.290313 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505da58-cbbc-4841-923d-14a509f1455e None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.290753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505da58-cbbc-4841-923d-14a509f1455e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.291186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505da58-cbbc-4841-923d-14a509f1455e None admin] PATH_INFO: `/v3/users/74e2072e53104ebd92b2a7a54a6caf3c` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.314652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505da58-cbbc-4841-923d-14a509f1455e None admin] RBAC: Authorizing `identity:get_user(user_id=74e2072e53104ebd92b2a7a54a6caf3c)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.315096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25395edd-de04-4811-9ef8-caaa896a3bbb None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.317520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505da58-cbbc-4841-923d-14a509f1455e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.320271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 106/221] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:30 2022] GET /identity/v3/users/74e2072e53104ebd92b2a7a54a6caf3c => generated 297 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:30.320271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2994e-3c67-45f3-b19f-7fb8b9d70d1e None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.320271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2994e-3c67-45f3-b19f-7fb8b9d70d1e None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.320271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2994e-3c67-45f3-b19f-7fb8b9d70d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.351084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-5db2994e-3c67-45f3-b19f-7fb8b9d70d1e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:30.352898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5db2994e-3c67-45f3-b19f-7fb8b9d70d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:30.364578 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcb80e-6612-40e5-93c6-5490ccc669e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.365228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcb80e-6612-40e5-93c6-5490ccc669e7 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.365526 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcb80e-6612-40e5-93c6-5490ccc669e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.365781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcb80e-6612-40e5-93c6-5490ccc669e7 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.366480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcb80e-6612-40e5-93c6-5490ccc669e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:30.366901 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcb80e-6612-40e5-93c6-5490ccc669e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.368337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcb80e-6612-40e5-93c6-5490ccc669e7 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.378738 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 116/222] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:38:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:30.379532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcb80e-6612-40e5-93c6-5490ccc669e7 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.383819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:30.420345 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:30.459568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 107/223] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:30.460440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2994e-3c67-45f3-b19f-7fb8b9d70d1e None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.558794 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcb80e-6612-40e5-93c6-5490ccc669e7 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.606881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2994e-3c67-45f3-b19f-7fb8b9d70d1e None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.645320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083b2e4-fc60-4338-bea9-19ce4d1a0853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.647288 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b2e4-fc60-4338-bea9-19ce4d1a0853 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.648080 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b2e4-fc60-4338-bea9-19ce4d1a0853 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.648839 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b2e4-fc60-4338-bea9-19ce4d1a0853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.656241 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99a785-ebfe-44e4-8fa8-ee8198bc5468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.657104 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99a785-ebfe-44e4-8fa8-ee8198bc5468 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.657531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99a785-ebfe-44e4-8fa8-ee8198bc5468 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.657889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99a785-ebfe-44e4-8fa8-ee8198bc5468 None admin] PATH_INFO: `/v3/users/8e2fdae3a3cf4e13bd818a4e4b6d6a65` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.659190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99a785-ebfe-44e4-8fa8-ee8198bc5468 None admin] RBAC: Authorizing `identity:get_user(user_id=8e2fdae3a3cf4e13bd818a4e4b6d6a65)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.660677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99a785-ebfe-44e4-8fa8-ee8198bc5468 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.662559 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 108/224] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:30 2022] GET /identity/v3/users/8e2fdae3a3cf4e13bd818a4e4b6d6a65 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:30.669094 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99a785-ebfe-44e4-8fa8-ee8198bc5468 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.704174 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:30.779589 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083b2e4-fc60-4338-bea9-19ce4d1a0853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.782994 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083b2e4-fc60-4338-bea9-19ce4d1a0853 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.809027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99a785-ebfe-44e4-8fa8-ee8198bc5468 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:30.816816 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:30.875361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de2d95-0db7-49f7-b594-0c1a36825d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:30.876740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de2d95-0db7-49f7-b594-0c1a36825d34 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:30.877388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de2d95-0db7-49f7-b594-0c1a36825d34 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:30.878221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de2d95-0db7-49f7-b594-0c1a36825d34 None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:30.880731 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de2d95-0db7-49f7-b594-0c1a36825d34 None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:30.884447 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de2d95-0db7-49f7-b594-0c1a36825d34 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:30.887981 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 109/225] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:30 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:30.889772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de2d95-0db7-49f7-b594-0c1a36825d34 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:30.924125 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 117/226] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:30.925245 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083b2e4-fc60-4338-bea9-19ce4d1a0853 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:31.062252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:31.069354 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083b2e4-fc60-4338-bea9-19ce4d1a0853 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:31.085358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de2d95-0db7-49f7-b594-0c1a36825d34 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:31.100907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:31.125895 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b73c2-929a-4646-803f-732d230a39cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:31.126698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b73c2-929a-4646-803f-732d230a39cf None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:31.126983 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b73c2-929a-4646-803f-732d230a39cf None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:31.127264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b73c2-929a-4646-803f-732d230a39cf None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e/users/8e2fdae3a3cf4e13bd818a4e4b6d6a65/roles/e4d659212810456798a60c1902537d7d` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:31.129728 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b73c2-929a-4646-803f-732d230a39cf None admin] RBAC: Authorizing `identity:create_grant(project_id=a281171d594749e4986718444da08d9e, user_id=8e2fdae3a3cf4e13bd818a4e4b6d6a65, role_id=e4d659212810456798a60c1902537d7d)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:31.132139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b73c2-929a-4646-803f-732d230a39cf None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:31.152784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 118/227] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:38:30 2022] PUT /identity/v3/projects/a281171d594749e4986718444da08d9e/users/8e2fdae3a3cf4e13bd818a4e4b6d6a65/roles/e4d659212810456798a60c1902537d7d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:31.153806 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b73c2-929a-4646-803f-732d230a39cf None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:31.159554 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d962323-6fbb-448a-b349-1539816d54c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:31.160904 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d962323-6fbb-448a-b349-1539816d54c0 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:31.161679 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d962323-6fbb-448a-b349-1539816d54c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:31.162355 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d962323-6fbb-448a-b349-1539816d54c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:31.184411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d962323-6fbb-448a-b349-1539816d54c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:31.197700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-6d962323-6fbb-448a-b349-1539816d54c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:38:31.197700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:31.197700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:31.197700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:31.197700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:31.197700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:31.197700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:31.197700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:31.197700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:31.197700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:31.197700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:31.197700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:31.197700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:31.197700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:31.197700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:31.197700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:31.199970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:31.199970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:31.199970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:31.199970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:31.199970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:31.199970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:31.199970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:31.199970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:31.199970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:31.199970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:31.199970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:31.199970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:31.199970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:31.199970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:31.199970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:31.199970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:31.201485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:31.201485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:31.201485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:31.201485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:31.201485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:31.201485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:31.201485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:31.201485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:31.201485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:31.201485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:31.201485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:38:31.201485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:31.201485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 110/228] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:38:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:31.209994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d962323-6fbb-448a-b349-1539816d54c0 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:31.379160 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b73c2-929a-4646-803f-732d230a39cf None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:31.453158 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bbbdd-b676-4439-ae48-4bb55c1ac4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:31.454458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bbbdd-b676-4439-ae48-4bb55c1ac4f5 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:31.454892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bbbdd-b676-4439-ae48-4bb55c1ac4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:31.455369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bbbdd-b676-4439-ae48-4bb55c1ac4f5 None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:31.457882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bbbdd-b676-4439-ae48-4bb55c1ac4f5 None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:31.460660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bbbdd-b676-4439-ae48-4bb55c1ac4f5 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:31.464309 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 119/229] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:31 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:31.475434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bbbdd-b676-4439-ae48-4bb55c1ac4f5 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:31.506876 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d962323-6fbb-448a-b349-1539816d54c0 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:31.598391 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:31.618991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076d648-b531-4930-b3bd-a47792ddb3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:31.620552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076d648-b531-4930-b3bd-a47792ddb3ba None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:31.621267 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076d648-b531-4930-b3bd-a47792ddb3ba None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:31.621966 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076d648-b531-4930-b3bd-a47792ddb3ba None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:31.623527 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076d648-b531-4930-b3bd-a47792ddb3ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:31.624310 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076d648-b531-4930-b3bd-a47792ddb3ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:31.629329 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076d648-b531-4930-b3bd-a47792ddb3ba None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:31.646859 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 111/230] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:31.652801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076d648-b531-4930-b3bd-a47792ddb3ba None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:31.682584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:31.761375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bbbdd-b676-4439-ae48-4bb55c1ac4f5 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:31.828033 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ded24-1c9a-4df6-8fe0-9d2d47dfe0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:31.828678 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ded24-1c9a-4df6-8fe0-9d2d47dfe0a9 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:31.828956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ded24-1c9a-4df6-8fe0-9d2d47dfe0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:31.829227 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ded24-1c9a-4df6-8fe0-9d2d47dfe0a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:31.830143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ded24-1c9a-4df6-8fe0-9d2d47dfe0a9 None admin] RBAC: Adding query filter params (role.id=c770dd0c3bc540c3a48b0393d192b17a, scope.project.id=a281171d594749e4986718444da08d9e, user.id=74e2072e53104ebd92b2a7a54a6caf3c) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:31.830456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ded24-1c9a-4df6-8fe0-9d2d47dfe0a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:31.831938 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ded24-1c9a-4df6-8fe0-9d2d47dfe0a9 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:31.849390 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 120/231] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:31 2022] GET /identity/v3/role_assignments?user.id=74e2072e53104ebd92b2a7a54a6caf3c&scope.project.id=a281171d594749e4986718444da08d9e&role.id=c770dd0c3bc540c3a48b0393d192b17a => generated 259 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:31.871291 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076d648-b531-4930-b3bd-a47792ddb3ba None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:31.944380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cb637-4321-4343-8dd8-4e5293a4e85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:31.944954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cb637-4321-4343-8dd8-4e5293a4e85d None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:31.945235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cb637-4321-4343-8dd8-4e5293a4e85d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:31.945572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cb637-4321-4343-8dd8-4e5293a4e85d None admin] PATH_INFO: `/v3/users/8e2fdae3a3cf4e13bd818a4e4b6d6a65` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:31.950267 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cb637-4321-4343-8dd8-4e5293a4e85d None admin] RBAC: Authorizing `identity:get_user(user_id=8e2fdae3a3cf4e13bd818a4e4b6d6a65)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:31.951805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cb637-4321-4343-8dd8-4e5293a4e85d None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:31.954082 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 112/232] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:31 2022] GET /identity/v3/users/8e2fdae3a3cf4e13bd818a4e4b6d6a65 => generated 283 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:31.959824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ded24-1c9a-4df6-8fe0-9d2d47dfe0a9 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:32.133032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ded24-1c9a-4df6-8fe0-9d2d47dfe0a9 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:32.149480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:32.195045 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13bda0-36ec-4402-b6d3-4edc1f43a1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:32.196232 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13bda0-36ec-4402-b6d3-4edc1f43a1eb None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:32.196738 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13bda0-36ec-4402-b6d3-4edc1f43a1eb None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:32.197716 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13bda0-36ec-4402-b6d3-4edc1f43a1eb None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:32.199969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13bda0-36ec-4402-b6d3-4edc1f43a1eb None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:32.202836 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13bda0-36ec-4402-b6d3-4edc1f43a1eb None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:32.209653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 121/233] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:31 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:32.217629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cb637-4321-4343-8dd8-4e5293a4e85d None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:32.381655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:32.423719 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cb637-4321-4343-8dd8-4e5293a4e85d None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:32.490393 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e19378-1ca1-4eee-a17b-2dbea4df5bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:32.491626 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e19378-1ca1-4eee-a17b-2dbea4df5bbb None admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:32.492071 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e19378-1ca1-4eee-a17b-2dbea4df5bbb None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:32.492554 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e19378-1ca1-4eee-a17b-2dbea4df5bbb None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e/users/8e2fdae3a3cf4e13bd818a4e4b6d6a65/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:32.496549 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e19378-1ca1-4eee-a17b-2dbea4df5bbb None admin] RBAC: Authorizing `identity:create_grant(project_id=a281171d594749e4986718444da08d9e, user_id=8e2fdae3a3cf4e13bd818a4e4b6d6a65, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:32.499810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e19378-1ca1-4eee-a17b-2dbea4df5bbb None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:32.537375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 113/234] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:38:32 2022] PUT /identity/v3/projects/a281171d594749e4986718444da08d9e/users/8e2fdae3a3cf4e13bd818a4e4b6d6a65/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:33.268406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a6340-e2f6-4af5-b8b1-10c6cbfdad47 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.268937 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a6340-e2f6-4af5-b8b1-10c6cbfdad47 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.269408 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a6340-e2f6-4af5-b8b1-10c6cbfdad47 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:33.272420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 122/235] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:33.281294 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9560-4329-4ab8-a84a-e38abc07bae2 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.281862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9560-4329-4ab8-a84a-e38abc07bae2 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.282483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd9560-4329-4ab8-a84a-e38abc07bae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:33.322426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-ecbd9560-4329-4ab8-a84a-e38abc07bae2 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:33.323994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ecbd9560-4329-4ab8-a84a-e38abc07bae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:33.358405 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a146a0-6649-4d2b-a954-69522e265ccf None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.359024 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a146a0-6649-4d2b-a954-69522e265ccf None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.359483 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a146a0-6649-4d2b-a954-69522e265ccf None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:33.361061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 123/236] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:38:33.370886 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bc43b-44d7-4bf7-ba54-e1f0679992f6 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.371420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bc43b-44d7-4bf7-ba54-e1f0679992f6 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.371787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bc43b-44d7-4bf7-ba54-e1f0679992f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:33.441896 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-c01bc43b-44d7-4bf7-ba54-e1f0679992f6 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:33.445687 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c01bc43b-44d7-4bf7-ba54-e1f0679992f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:33.456448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 114/237] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:33.583782 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 124/238] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:33.737514 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd9560-4329-4ab8-a84a-e38abc07bae2 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:33.862985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:33.910147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd9560-4329-4ab8-a84a-e38abc07bae2 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:33.959039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336e2ca-9efb-46a3-a1b6-67bf26a9d5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:33.959700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336e2ca-9efb-46a3-a1b6-67bf26a9d5f5 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:33.959975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336e2ca-9efb-46a3-a1b6-67bf26a9d5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:33.960236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336e2ca-9efb-46a3-a1b6-67bf26a9d5f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:33.961434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336e2ca-9efb-46a3-a1b6-67bf26a9d5f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:33.962918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336e2ca-9efb-46a3-a1b6-67bf26a9d5f5 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:33.964836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 115/239] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:38:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:33.971119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bc43b-44d7-4bf7-ba54-e1f0679992f6 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:34.067921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336e2ca-9efb-46a3-a1b6-67bf26a9d5f5 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:34.196266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bc43b-44d7-4bf7-ba54-e1f0679992f6 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:34.219019 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:34.270128 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71702f1-0e2b-45e4-acdb-ff48c67104fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:34.271119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71702f1-0e2b-45e4-acdb-ff48c67104fc None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:34.271119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71702f1-0e2b-45e4-acdb-ff48c67104fc None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:34.271339 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71702f1-0e2b-45e4-acdb-ff48c67104fc None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:34.271927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71702f1-0e2b-45e4-acdb-ff48c67104fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:34.273413 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71702f1-0e2b-45e4-acdb-ff48c67104fc None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:34.291228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336e2ca-9efb-46a3-a1b6-67bf26a9d5f5 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:34.322403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 125/240] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:38:33 2022] POST /identity/v3/users => generated 293 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:34.368319 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9e41d-6dac-4cb2-a190-bb2d2743901b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:34.369003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9e41d-6dac-4cb2-a190-bb2d2743901b None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:34.369280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9e41d-6dac-4cb2-a190-bb2d2743901b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:34.369587 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9e41d-6dac-4cb2-a190-bb2d2743901b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:34.376676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:34.393335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9e41d-6dac-4cb2-a190-bb2d2743901b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:34.398482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-87a9e41d-6dac-4cb2-a190-bb2d2743901b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:34.398482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:34.398482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:34.398482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:34.398482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:34.398482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:34.398482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:34.398482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:34.398482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:34.398482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:34.398482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:34.398482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:34.398482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:34.398482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:34.398482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:34.398482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:34.400254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:34.400254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:34.400254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:34.400254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:34.400254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:34.400254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:34.400254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:34.400254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:34.400254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:34.400254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:34.400254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:34.400254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:34.400254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:34.400254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:34.400254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:34.400254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:34.401643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:34.401643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:34.401643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:34.401643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:34.401643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:34.401643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:34.401643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:34.401643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:34.401643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:34.401643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:34.401643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:34.401643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:34.401643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 116/241] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:34.413440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71702f1-0e2b-45e4-acdb-ff48c67104fc None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:34.688422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71702f1-0e2b-45e4-acdb-ff48c67104fc None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:34.757943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227c0b5-33eb-40f9-ad61-2ab6c47e6f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:34.758953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227c0b5-33eb-40f9-ad61-2ab6c47e6f9a None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:34.759466 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227c0b5-33eb-40f9-ad61-2ab6c47e6f9a None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:34.759882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227c0b5-33eb-40f9-ad61-2ab6c47e6f9a None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:34.761112 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227c0b5-33eb-40f9-ad61-2ab6c47e6f9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:34.761681 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227c0b5-33eb-40f9-ad61-2ab6c47e6f9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:34.764387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227c0b5-33eb-40f9-ad61-2ab6c47e6f9a None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:34.780369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 126/242] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:34.790516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9e41d-6dac-4cb2-a190-bb2d2743901b None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:34.793510 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d084674-7540-4f9e-a7a6-335ef509a5c3 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:34.794016 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d084674-7540-4f9e-a7a6-335ef509a5c3 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:34.794490 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d084674-7540-4f9e-a7a6-335ef509a5c3 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:34.797212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 127/243] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:34.811789 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05658cf-595b-4305-beac-758d82802377 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:34.812278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05658cf-595b-4305-beac-758d82802377 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:34.813121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05658cf-595b-4305-beac-758d82802377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:34.842073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-e05658cf-595b-4305-beac-758d82802377 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:34.843479 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-e05658cf-595b-4305-beac-758d82802377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:34.868553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:34.965689 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9e41d-6dac-4cb2-a190-bb2d2743901b None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:34.970569 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 128/244] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:38:35.042094 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51680aeb-4dbd-4e5a-8f11-f67be00f5372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:35.043696 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51680aeb-4dbd-4e5a-8f11-f67be00f5372 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:35.044464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51680aeb-4dbd-4e5a-8f11-f67be00f5372 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:35.045240 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51680aeb-4dbd-4e5a-8f11-f67be00f5372 None admin] PATH_INFO: `/v3/users/ea7102f7d9704ea8857f1d16ef19669c` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:35.074259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51680aeb-4dbd-4e5a-8f11-f67be00f5372 None admin] RBAC: Authorizing `identity:get_user(user_id=ea7102f7d9704ea8857f1d16ef19669c)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:35.077434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51680aeb-4dbd-4e5a-8f11-f67be00f5372 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:35.081623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 117/245] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:34 2022] GET /identity/v3/users/ea7102f7d9704ea8857f1d16ef19669c => generated 297 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:35.091547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05658cf-595b-4305-beac-758d82802377 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:35.237201 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2fdc2-b828-42bf-a2af-442b5efd8e99 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:35.237695 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2fdc2-b828-42bf-a2af-442b5efd8e99 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:35.238061 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2fdc2-b828-42bf-a2af-442b5efd8e99 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:35.239800 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 118/246] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:38:35.245937 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40710114-a520-45fa-beaf-0712eb6b208e None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:35.246355 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40710114-a520-45fa-beaf-0712eb6b208e None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:35.246717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40710114-a520-45fa-beaf-0712eb6b208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:35.285485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-40710114-a520-45fa-beaf-0712eb6b208e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:35.286836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-40710114-a520-45fa-beaf-0712eb6b208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:35.293861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05658cf-595b-4305-beac-758d82802377 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:35.336305 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e0567-f5ce-4397-a6a2-8e4c7566ea7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:35.336940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e0567-f5ce-4397-a6a2-8e4c7566ea7f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:35.337234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e0567-f5ce-4397-a6a2-8e4c7566ea7f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:35.337508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e0567-f5ce-4397-a6a2-8e4c7566ea7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:35.372403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:35.392667 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:35.429363 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 119/247] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:38:35.431308 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40710114-a520-45fa-beaf-0712eb6b208e None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:35.455429 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e0567-f5ce-4397-a6a2-8e4c7566ea7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:35.456923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e0567-f5ce-4397-a6a2-8e4c7566ea7f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:35.671938 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40710114-a520-45fa-beaf-0712eb6b208e None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:35.697418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 129/248] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:35.697418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e0567-f5ce-4397-a6a2-8e4c7566ea7f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:35.733915 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef5adf-401a-49ad-8ce7-ed43983c185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:35.734955 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef5adf-401a-49ad-8ce7-ed43983c185f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:35.735505 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef5adf-401a-49ad-8ce7-ed43983c185f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:35.735977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef5adf-401a-49ad-8ce7-ed43983c185f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:35.748556 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef5adf-401a-49ad-8ce7-ed43983c185f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:35.754380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-62ef5adf-401a-49ad-8ce7-ed43983c185f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:38:35.754380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:35.754380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:35.754380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:35.754380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:35.754380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:35.754380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:35.754380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:35.754380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:35.754380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:35.754380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:35.754380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:35.754380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:35.754380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:35.754380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:35.754380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:35.755285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:35.755285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:35.755285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:35.755285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:35.755285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:35.755285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:35.755285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:35.755285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:35.755285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:35.755285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:35.755285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:35.755285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:35.755285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:35.755285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:35.755285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:35.755285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:35.756066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:35.756066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:35.756066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:35.756066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:35.756066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:35.756066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:35.756066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:35.756066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:35.756066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:35.756066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:35.756066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:38:35.756066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:35.758830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 120/249] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:38:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:35.759989 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef5adf-401a-49ad-8ce7-ed43983c185f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:35.781059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:35.812884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:35.837719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e0567-f5ce-4397-a6a2-8e4c7566ea7f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:35.883305 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1cb95-eba3-42f0-84f4-4d30eea01356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:35.884448 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1cb95-eba3-42f0-84f4-4d30eea01356 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:35.884936 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1cb95-eba3-42f0-84f4-4d30eea01356 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:35.885535 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1cb95-eba3-42f0-84f4-4d30eea01356 None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:35.888294 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1cb95-eba3-42f0-84f4-4d30eea01356 None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:35.890266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1cb95-eba3-42f0-84f4-4d30eea01356 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:35.893634 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 130/250] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:35 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:35.894972 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1cb95-eba3-42f0-84f4-4d30eea01356 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:35.995746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef5adf-401a-49ad-8ce7-ed43983c185f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:36.030863 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1cb95-eba3-42f0-84f4-4d30eea01356 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:36.063405 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:36.078580 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774677a-2351-41a7-9d69-046cb36e1722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:36.080286 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774677a-2351-41a7-9d69-046cb36e1722 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:36.081124 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774677a-2351-41a7-9d69-046cb36e1722 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:36.081696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774677a-2351-41a7-9d69-046cb36e1722 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:36.082777 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774677a-2351-41a7-9d69-046cb36e1722 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:36.083437 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774677a-2351-41a7-9d69-046cb36e1722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:36.085026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774677a-2351-41a7-9d69-046cb36e1722 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:36.089004 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abaeb4a-eef0-4b84-83c2-d8652d6f0f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:36.090041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaeb4a-eef0-4b84-83c2-d8652d6f0f27 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:36.090511 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaeb4a-eef0-4b84-83c2-d8652d6f0f27 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:36.090954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaeb4a-eef0-4b84-83c2-d8652d6f0f27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:36.100967 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 131/251] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:38:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:36.100967 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774677a-2351-41a7-9d69-046cb36e1722 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:36.111053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abaeb4a-eef0-4b84-83c2-d8652d6f0f27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:36.116443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-2abaeb4a-eef0-4b84-83c2-d8652d6f0f27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:36.116443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:36.116443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:36.116443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:36.116443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:36.116443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:36.116443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:36.116443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:36.116443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:36.116443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:36.116443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:36.116443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:36.116443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:36.116443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:36.116443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:36.116443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:36.117417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:36.117417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:36.117417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:36.117417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:36.117417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:36.117417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:36.117417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:36.117417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:36.117417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:36.117417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:36.117417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:36.117417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:36.117417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:36.117417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:36.117417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:36.117417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:36.118186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:36.118186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:36.118186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:36.118186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:36.118186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:36.118186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:36.118186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:36.118186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:36.118186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:36.118186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:36.118186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:36.118186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:36.127439 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 121/252] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:36.127439 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4b6d0-23a9-4bf6-866c-2124b897589d None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:36.127439 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4b6d0-23a9-4bf6-866c-2124b897589d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:36.127439 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4b6d0-23a9-4bf6-866c-2124b897589d None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:36.127439 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 122/253] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:36.128618 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4b6d0-23a9-4bf6-866c-2124b897589d None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:36.222852 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774677a-2351-41a7-9d69-046cb36e1722 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:36.266055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a9d15-56a7-4291-8631-55f3e8bd7138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:36.266771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a9d15-56a7-4291-8631-55f3e8bd7138 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:36.267054 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a9d15-56a7-4291-8631-55f3e8bd7138 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:36.267327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a9d15-56a7-4291-8631-55f3e8bd7138 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:36.268092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a9d15-56a7-4291-8631-55f3e8bd7138 None admin] RBAC: Adding query filter params (role.id=1f24a90c6e1a4534b0a55f86ccc0ee7f, scope.project.id=a281171d594749e4986718444da08d9e, user.id=ea7102f7d9704ea8857f1d16ef19669c) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:36.268401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a9d15-56a7-4291-8631-55f3e8bd7138 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:36.270090 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a9d15-56a7-4291-8631-55f3e8bd7138 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:36.276525 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 132/254] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:36 2022] GET /identity/v3/role_assignments?user.id=ea7102f7d9704ea8857f1d16ef19669c&scope.project.id=a281171d594749e4986718444da08d9e&role.id=1f24a90c6e1a4534b0a55f86ccc0ee7f => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:36.278056 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f415f5b-4241-4d74-82a7-14a60e4c2e95 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:36.278347 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f415f5b-4241-4d74-82a7-14a60e4c2e95 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:36.278622 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f415f5b-4241-4d74-82a7-14a60e4c2e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:36.338770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-8f415f5b-4241-4d74-82a7-14a60e4c2e95 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:36.347853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-8f415f5b-4241-4d74-82a7-14a60e4c2e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:36.370650 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4b6d0-23a9-4bf6-866c-2124b897589d None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:36.380870 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:36.502262 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfb684-11e2-457f-8236-992947d0acf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:36.503323 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfb684-11e2-457f-8236-992947d0acf1 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:36.504110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:36.504505 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfb684-11e2-457f-8236-992947d0acf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:36.505096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfb684-11e2-457f-8236-992947d0acf1 None admin] PATH_INFO: `/v3/users/8e2fdae3a3cf4e13bd818a4e4b6d6a65` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:36.508746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfb684-11e2-457f-8236-992947d0acf1 None admin] RBAC: Authorizing `identity:get_user(user_id=8e2fdae3a3cf4e13bd818a4e4b6d6a65)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:36.512067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfb684-11e2-457f-8236-992947d0acf1 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:36.521473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 123/255] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:36 2022] GET /identity/v3/users/8e2fdae3a3cf4e13bd818a4e4b6d6a65 => generated 283 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:36.521473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfb684-11e2-457f-8236-992947d0acf1 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:36.539364 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 133/256] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:36.542227 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f415f5b-4241-4d74-82a7-14a60e4c2e95 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:36.724240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f415f5b-4241-4d74-82a7-14a60e4c2e95 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:36.741973 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfb684-11e2-457f-8236-992947d0acf1 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:36.764784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a36184-d829-403a-bd55-c4dab9a11ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:36.765460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a36184-d829-403a-bd55-c4dab9a11ecd None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:36.765744 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a36184-d829-403a-bd55-c4dab9a11ecd None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:36.766017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a36184-d829-403a-bd55-c4dab9a11ecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:36.810518 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20ef7b-163e-4223-afa8-0dc5e3560624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:36.811504 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20ef7b-163e-4223-afa8-0dc5e3560624 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:36.812073 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20ef7b-163e-4223-afa8-0dc5e3560624 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:36.812967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20ef7b-163e-4223-afa8-0dc5e3560624 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:36.814356 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20ef7b-163e-4223-afa8-0dc5e3560624 None admin] RBAC: Adding query filter params (name=member) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:36.814886 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20ef7b-163e-4223-afa8-0dc5e3560624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:36.817554 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20ef7b-163e-4223-afa8-0dc5e3560624 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:36.823665 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:36.835953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 124/257] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:36.845260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20ef7b-163e-4223-afa8-0dc5e3560624 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:36.847334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a36184-d829-403a-bd55-c4dab9a11ecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:36.848857 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a36184-d829-403a-bd55-c4dab9a11ecd None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:36.914586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:37.003881 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 134/258] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:37.010630 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a36184-d829-403a-bd55-c4dab9a11ecd None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:37.097244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20ef7b-163e-4223-afa8-0dc5e3560624 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:37.244646 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639a369-ce58-4c89-aea4-56d51caca925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:37.245748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639a369-ce58-4c89-aea4-56d51caca925 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:37.246229 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639a369-ce58-4c89-aea4-56d51caca925 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:37.246702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639a369-ce58-4c89-aea4-56d51caca925 None admin] PATH_INFO: `/v3/users/74e2072e53104ebd92b2a7a54a6caf3c` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:37.254644 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639a369-ce58-4c89-aea4-56d51caca925 None admin] RBAC: Authorizing `identity:get_user(user_id=74e2072e53104ebd92b2a7a54a6caf3c)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:37.257321 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639a369-ce58-4c89-aea4-56d51caca925 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:37.260857 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 125/259] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:36 2022] GET /identity/v3/users/74e2072e53104ebd92b2a7a54a6caf3c => generated 297 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:37.261096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:37.277790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639a369-ce58-4c89-aea4-56d51caca925 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:37.323815 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a36184-d829-403a-bd55-c4dab9a11ecd None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:37.368534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c42fe9-2278-40b8-86df-b66d7ad1f24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:37.369493 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c42fe9-2278-40b8-86df-b66d7ad1f24e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:37.369493 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c42fe9-2278-40b8-86df-b66d7ad1f24e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:37.369762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c42fe9-2278-40b8-86df-b66d7ad1f24e None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:37.371893 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c42fe9-2278-40b8-86df-b66d7ad1f24e None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:37.373399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c42fe9-2278-40b8-86df-b66d7ad1f24e None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:37.375139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 135/260] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:37 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:37.375922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c42fe9-2278-40b8-86df-b66d7ad1f24e None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:37.490589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639a369-ce58-4c89-aea4-56d51caca925 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:37.493854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:37.536415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210663fc-89b9-4930-a3cd-0bfa22e03392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:37.537375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210663fc-89b9-4930-a3cd-0bfa22e03392 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:37.537546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210663fc-89b9-4930-a3cd-0bfa22e03392 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:37.540606 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210663fc-89b9-4930-a3cd-0bfa22e03392 None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:37.542174 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210663fc-89b9-4930-a3cd-0bfa22e03392 None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:37.543688 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210663fc-89b9-4930-a3cd-0bfa22e03392 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:37.545419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 126/261] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:37 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:37.546210 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210663fc-89b9-4930-a3cd-0bfa22e03392 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:37.622539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c42fe9-2278-40b8-86df-b66d7ad1f24e None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:37.666713 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d10e5-e747-4e76-bbeb-a0012f9ce56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:37.667392 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d10e5-e747-4e76-bbeb-a0012f9ce56a None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:37.667664 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d10e5-e747-4e76-bbeb-a0012f9ce56a None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:37.667948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d10e5-e747-4e76-bbeb-a0012f9ce56a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:37.682587 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d10e5-e747-4e76-bbeb-a0012f9ce56a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:37.689018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-4b6d10e5-e747-4e76-bbeb-a0012f9ce56a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:38:37.689018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:37.689018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:37.689018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:37.689018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:37.689018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:37.689018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:37.689018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:37.689018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:37.689018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:37.689018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:37.689018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:37.689018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:37.689018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:37.689018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:37.689018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:37.690762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:37.690762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:37.690762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:37.690762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:37.690762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:37.690762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:37.690762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:37.690762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:37.690762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:37.690762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:37.690762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:37.690762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:37.690762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:37.690762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:37.690762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:37.690762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:37.692217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:37.692217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:37.692217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:37.692217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:37.692217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:37.692217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:37.692217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:37.692217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:37.692217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:37.692217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:37.692217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:38:37.692217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:38:37.692217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 136/262] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:38:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:37.692217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d10e5-e747-4e76-bbeb-a0012f9ce56a None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:37.705318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:37.822055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d10e5-e747-4e76-bbeb-a0012f9ce56a None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:37.863790 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b728330-b6ef-4739-b690-35ff46238357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:37.864505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b728330-b6ef-4739-b690-35ff46238357 None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:37.865039 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b728330-b6ef-4739-b690-35ff46238357 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:37.865308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b728330-b6ef-4739-b690-35ff46238357 None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e/users/74e2072e53104ebd92b2a7a54a6caf3c/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:37.867532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b728330-b6ef-4739-b690-35ff46238357 None admin] RBAC: Authorizing `identity:create_grant(project_id=a281171d594749e4986718444da08d9e, user_id=74e2072e53104ebd92b2a7a54a6caf3c, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:37.869069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b728330-b6ef-4739-b690-35ff46238357 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:37.886745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 137/263] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:38:37 2022] PUT /identity/v3/projects/a281171d594749e4986718444da08d9e/users/74e2072e53104ebd92b2a7a54a6caf3c/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:38:37.887270 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b728330-b6ef-4739-b690-35ff46238357 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:37.943383 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210663fc-89b9-4930-a3cd-0bfa22e03392 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:37.992096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:38.035449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b728330-b6ef-4739-b690-35ff46238357 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:38.075805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f6eb5-12e7-40fd-a001-63a53dcc9d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:38.077082 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f6eb5-12e7-40fd-a001-63a53dcc9d6f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:38.077584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f6eb5-12e7-40fd-a001-63a53dcc9d6f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:38.078011 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f6eb5-12e7-40fd-a001-63a53dcc9d6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:38.078332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942922c-78a4-4f06-9f8e-a652bb5cc8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:38.079276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942922c-78a4-4f06-9f8e-a652bb5cc8bf None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:38.079462 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f6eb5-12e7-40fd-a001-63a53dcc9d6f None admin] RBAC: Adding query filter params (role.id=e4d659212810456798a60c1902537d7d, scope.project.id=a281171d594749e4986718444da08d9e, user.id=8e2fdae3a3cf4e13bd818a4e4b6d6a65) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:38.079849 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942922c-78a4-4f06-9f8e-a652bb5cc8bf None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:38.080063 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f6eb5-12e7-40fd-a001-63a53dcc9d6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:38.080425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942922c-78a4-4f06-9f8e-a652bb5cc8bf None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:38.081357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942922c-78a4-4f06-9f8e-a652bb5cc8bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:38.081808 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942922c-78a4-4f06-9f8e-a652bb5cc8bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:38.083375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942922c-78a4-4f06-9f8e-a652bb5cc8bf None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:38.091122 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f6eb5-12e7-40fd-a001-63a53dcc9d6f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:38.094289 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 138/264] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:38.099951 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 127/265] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:37 2022] GET /identity/v3/role_assignments?user.id=8e2fdae3a3cf4e13bd818a4e4b6d6a65&scope.project.id=a281171d594749e4986718444da08d9e&role.id=e4d659212810456798a60c1902537d7d => generated 608 bytes in 554 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:38.104194 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942922c-78a4-4f06-9f8e-a652bb5cc8bf None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:38.230431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942922c-78a4-4f06-9f8e-a652bb5cc8bf None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:38.266693 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:38.274385 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ea399-ccb9-4314-952b-d91b776d1dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:38.275297 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ea399-ccb9-4314-952b-d91b776d1dc8 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:38.275756 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ea399-ccb9-4314-952b-d91b776d1dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:38.276171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ea399-ccb9-4314-952b-d91b776d1dc8 None admin] PATH_INFO: `/v3/users/8e2fdae3a3cf4e13bd818a4e4b6d6a65` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:38.277623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ea399-ccb9-4314-952b-d91b776d1dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=8e2fdae3a3cf4e13bd818a4e4b6d6a65)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:38.279319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ea399-ccb9-4314-952b-d91b776d1dc8 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:38.281557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 139/266] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:38 2022] GET /identity/v3/users/8e2fdae3a3cf4e13bd818a4e4b6d6a65 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:38.294119 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f6eb5-12e7-40fd-a001-63a53dcc9d6f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:38.336540 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:38.430882 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f6eb5-12e7-40fd-a001-63a53dcc9d6f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:38.488045 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed735-f561-4305-a5f2-2e1762fbe2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:38.488638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed735-f561-4305-a5f2-2e1762fbe2a1 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:38.488921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed735-f561-4305-a5f2-2e1762fbe2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:38.489193 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ed735-f561-4305-a5f2-2e1762fbe2a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:38.614026 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ed735-f561-4305-a5f2-2e1762fbe2a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:38.615604 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ed735-f561-4305-a5f2-2e1762fbe2a1 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:38.654445 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:38.740517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 128/267] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:38.748887 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ea399-ccb9-4314-952b-d91b776d1dc8 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:38.882500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ea399-ccb9-4314-952b-d91b776d1dc8 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:38.927108 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309795c-8983-4559-af07-0b9291c84219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:38.927850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309795c-8983-4559-af07-0b9291c84219 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:38.928189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309795c-8983-4559-af07-0b9291c84219 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:38.928468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309795c-8983-4559-af07-0b9291c84219 None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:38.929731 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309795c-8983-4559-af07-0b9291c84219 None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:38.931254 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309795c-8983-4559-af07-0b9291c84219 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:38.933047 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 140/268] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:38 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:38.943735 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed735-f561-4305-a5f2-2e1762fbe2a1 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:39.081999 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ed735-f561-4305-a5f2-2e1762fbe2a1 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:39.129397 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33273060-4f0c-4685-a68b-be18bcb6a3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:39.130248 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33273060-4f0c-4685-a68b-be18bcb6a3a9 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.130533 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33273060-4f0c-4685-a68b-be18bcb6a3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.130807 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33273060-4f0c-4685-a68b-be18bcb6a3a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.131554 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33273060-4f0c-4685-a68b-be18bcb6a3a9 None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.project.id=a281171d594749e4986718444da08d9e, user.id=8e2fdae3a3cf4e13bd818a4e4b6d6a65) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:39.131867 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33273060-4f0c-4685-a68b-be18bcb6a3a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:39.133385 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33273060-4f0c-4685-a68b-be18bcb6a3a9 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:39.140365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 129/269] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:38 2022] GET /identity/v3/role_assignments?user.id=8e2fdae3a3cf4e13bd818a4e4b6d6a65&scope.project.id=a281171d594749e4986718444da08d9e&role.id=440092230f024959a90e846ab29c6367 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:39.141537 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:39.156022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d53c-3e90-48a5-9688-c694c9e7ea1f None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.156342 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d53c-3e90-48a5-9688-c694c9e7ea1f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.156572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d53c-3e90-48a5-9688-c694c9e7ea1f None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.158157 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 141/270] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:38:39.172943 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6c86-3635-40dc-a8a4-41b048f9f897 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.173527 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6c86-3635-40dc-a8a4-41b048f9f897 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.174015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6c86-3635-40dc-a8a4-41b048f9f897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.206652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-f12b6c86-3635-40dc-a8a4-41b048f9f897 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:39.208728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f12b6c86-3635-40dc-a8a4-41b048f9f897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:39.369628 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 130/271] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:39.537885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526092a8-4ab7-4568-908b-0df5d1d1eda3 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.538318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526092a8-4ab7-4568-908b-0df5d1d1eda3 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.538788 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526092a8-4ab7-4568-908b-0df5d1d1eda3 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.541783 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 142/272] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:39.551335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0f9f5-82a9-43f3-a440-1fac55333b59 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.551776 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0f9f5-82a9-43f3-a440-1fac55333b59 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.552243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0f9f5-82a9-43f3-a440-1fac55333b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:39.587899 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-d7a0f9f5-82a9-43f3-a440-1fac55333b59 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:39.589203 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-d7a0f9f5-82a9-43f3-a440-1fac55333b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:39.708016 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 131/273] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:39.942055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526092a8-4ab7-4568-908b-0df5d1d1eda3 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:39.995980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d0076-c564-4311-a2d5-5122da107a5b None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:39.996923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d0076-c564-4311-a2d5-5122da107a5b None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:39.997690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d0076-c564-4311-a2d5-5122da107a5b None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:40.000823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 132/274] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:40.010522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaae0d9-0e42-4a19-968b-1a55e622a4b0 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:40.011369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaae0d9-0e42-4a19-968b-1a55e622a4b0 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:40.012018 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaae0d9-0e42-4a19-968b-1a55e622a4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:40.046096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-1eaae0d9-0e42-4a19-968b-1a55e622a4b0 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:40.048733 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-1eaae0d9-0e42-4a19-968b-1a55e622a4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:40.101727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:40.141850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526092a8-4ab7-4568-908b-0df5d1d1eda3 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:40.161264 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:40.182841 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 133/275] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:38:40.184408 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaae0d9-0e42-4a19-968b-1a55e622a4b0 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:40.191212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039f2af-fe9c-47a9-b053-584ecded5386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:40.192275 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039f2af-fe9c-47a9-b053-584ecded5386 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:40.192778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039f2af-fe9c-47a9-b053-584ecded5386 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:40.193245 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039f2af-fe9c-47a9-b053-584ecded5386 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:40.194740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039f2af-fe9c-47a9-b053-584ecded5386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:40.196495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039f2af-fe9c-47a9-b053-584ecded5386 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:40.198918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 143/276] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:38:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:40.209484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039f2af-fe9c-47a9-b053-584ecded5386 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:40.336732 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039f2af-fe9c-47a9-b053-584ecded5386 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:40.382333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaae0d9-0e42-4a19-968b-1a55e622a4b0 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:40.409821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67484bb7-f48e-4d89-8ea3-1eb35440a5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:40.411252 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67484bb7-f48e-4d89-8ea3-1eb35440a5f0 None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:40.412053 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67484bb7-f48e-4d89-8ea3-1eb35440a5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:40.412725 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67484bb7-f48e-4d89-8ea3-1eb35440a5f0 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:40.414382 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67484bb7-f48e-4d89-8ea3-1eb35440a5f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:40.417307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67484bb7-f48e-4d89-8ea3-1eb35440a5f0 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:40.444311 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:40.454106 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f6747-c330-46fe-870e-35f67035f88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:40.455351 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f6747-c330-46fe-870e-35f67035f88b None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:40.455854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f6747-c330-46fe-870e-35f67035f88b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:40.456278 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f6747-c330-46fe-870e-35f67035f88b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:40.469417 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 144/277] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:38:40 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:40.473433 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67484bb7-f48e-4d89-8ea3-1eb35440a5f0 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:40.476940 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f6747-c330-46fe-870e-35f67035f88b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:40.486988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-f26f6747-c330-46fe-870e-35f67035f88b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:40.486988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:40.486988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:40.486988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:40.486988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:40.486988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:40.486988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:40.486988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:40.486988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:40.486988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:40.486988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:40.486988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:40.486988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:40.486988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:40.486988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:40.486988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:40.488664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:40.488664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:40.488664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:40.488664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:40.488664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:40.488664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:40.488664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:40.488664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:40.488664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:40.488664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:40.488664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:40.488664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:40.488664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:40.488664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:40.488664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:40.488664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:40.490234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:40.490234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:40.490234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:40.490234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:40.490234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:40.490234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:40.490234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:40.490234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:40.490234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:40.490234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:40.490234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:40.490234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:40.490234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 134/278] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:40.498743 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f6747-c330-46fe-870e-35f67035f88b None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:40.622628 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:40.715654 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67484bb7-f48e-4d89-8ea3-1eb35440a5f0 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:40.739416 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f6747-c330-46fe-870e-35f67035f88b None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:40.790658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a9080-0169-475d-8a39-59d26a10b9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:40.791268 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a9080-0169-475d-8a39-59d26a10b9e0 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:40.791559 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a9080-0169-475d-8a39-59d26a10b9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:40.791830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a9080-0169-475d-8a39-59d26a10b9e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:40.796127 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9686cc-d6a9-4a04-b632-b458b9ab13fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:40.797544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9686cc-d6a9-4a04-b632-b458b9ab13fe None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:40.798260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9686cc-d6a9-4a04-b632-b458b9ab13fe None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:40.798951 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9686cc-d6a9-4a04-b632-b458b9ab13fe None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:40.800403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9686cc-d6a9-4a04-b632-b458b9ab13fe None admin] RBAC: Adding query filter params (name=member) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:40.801175 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9686cc-d6a9-4a04-b632-b458b9ab13fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:40.804184 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9686cc-d6a9-4a04-b632-b458b9ab13fe None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:40.804375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a9080-0169-475d-8a39-59d26a10b9e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:40.811049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-dc0a9080-0169-475d-8a39-59d26a10b9e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:40.811049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:40.811049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:40.811049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:40.811049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:40.811049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:40.811049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:40.811049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:40.811049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:40.811049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:40.811049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:40.811049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:40.811049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:40.811049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:40.811049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:40.811049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:40.813186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:40.813186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:40.813186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:40.813186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:40.813186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:40.813186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:40.813186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:40.813186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:40.813186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:40.813186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:40.813186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:40.813186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:40.813186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:40.813186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:40.813186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:40.813186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:40.815422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:40.815422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:40.815422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:40.815422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:40.815422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:40.815422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:40.815422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:40.815422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:40.815422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:40.815422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:40.815422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:40.815422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:38:40.815422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 145/279] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:40.818803 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a9080-0169-475d-8a39-59d26a10b9e0 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:40.826843 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 135/280] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:40.837207 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9686cc-d6a9-4a04-b632-b458b9ab13fe None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:40.900707 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:40.995591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a9080-0169-475d-8a39-59d26a10b9e0 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:41.017698 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9686cc-d6a9-4a04-b632-b458b9ab13fe None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:41.034778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:41.045881 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3371e8-7b50-4de6-bfbb-1c318f5cc9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:41.047148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3371e8-7b50-4de6-bfbb-1c318f5cc9fb None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.047439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3371e8-7b50-4de6-bfbb-1c318f5cc9fb None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.047713 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3371e8-7b50-4de6-bfbb-1c318f5cc9fb None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.048499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3371e8-7b50-4de6-bfbb-1c318f5cc9fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:41.048807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3371e8-7b50-4de6-bfbb-1c318f5cc9fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:41.050625 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3371e8-7b50-4de6-bfbb-1c318f5cc9fb None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:41.061618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 146/281] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:41.068500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3371e8-7b50-4de6-bfbb-1c318f5cc9fb None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:41.076246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9fa10-1993-4973-8e1f-88467d1e476c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:41.076920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9fa10-1993-4973-8e1f-88467d1e476c None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.077198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9fa10-1993-4973-8e1f-88467d1e476c None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.077507 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9fa10-1993-4973-8e1f-88467d1e476c None admin] PATH_INFO: `/v3/users/4e8960e0dc5345c881574a6776d0da31` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.106836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9fa10-1993-4973-8e1f-88467d1e476c None admin] RBAC: Authorizing `identity:get_user(user_id=4e8960e0dc5345c881574a6776d0da31)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:41.108343 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9fa10-1993-4973-8e1f-88467d1e476c None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:41.114568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 136/282] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:40 2022] GET /identity/v3/users/4e8960e0dc5345c881574a6776d0da31 => generated 293 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:41.138853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9fa10-1993-4973-8e1f-88467d1e476c None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:41.269560 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3371e8-7b50-4de6-bfbb-1c318f5cc9fb None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:41.294851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9fa10-1993-4973-8e1f-88467d1e476c None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:41.298860 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:41.350855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c49fd1-53bd-4f92-8eba-078af65ba86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:41.351815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c49fd1-53bd-4f92-8eba-078af65ba86a None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.352187 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c49fd1-53bd-4f92-8eba-078af65ba86a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.352459 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c49fd1-53bd-4f92-8eba-078af65ba86a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.353252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c49fd1-53bd-4f92-8eba-078af65ba86a None admin] RBAC: Adding query filter params (role.id=c770dd0c3bc540c3a48b0393d192b17a, user.id=4e8960e0dc5345c881574a6776d0da31, scope.system=all) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:41.353593 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c49fd1-53bd-4f92-8eba-078af65ba86a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:41.356000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c49fd1-53bd-4f92-8eba-078af65ba86a None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:41.363111 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67f0bd-8a61-44a3-a207-754a06fa496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:41.363572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 137/283] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Sep 12 23:38:41 2022] GET /identity/v3/role_assignments?user.id=4e8960e0dc5345c881574a6776d0da31&scope.system=all&role.id=c770dd0c3bc540c3a48b0393d192b17a => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:41.363787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67f0bd-8a61-44a3-a207-754a06fa496f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.364065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67f0bd-8a61-44a3-a207-754a06fa496f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.364333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67f0bd-8a61-44a3-a207-754a06fa496f None admin] PATH_INFO: `/v3/users/ea7102f7d9704ea8857f1d16ef19669c` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.366284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67f0bd-8a61-44a3-a207-754a06fa496f None admin] RBAC: Authorizing `identity:get_user(user_id=ea7102f7d9704ea8857f1d16ef19669c)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:41.368842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67f0bd-8a61-44a3-a207-754a06fa496f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:41.372063 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 147/284] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:41 2022] GET /identity/v3/users/ea7102f7d9704ea8857f1d16ef19669c => generated 297 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:41.378033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c49fd1-53bd-4f92-8eba-078af65ba86a None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:41.469564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:41.567077 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c49fd1-53bd-4f92-8eba-078af65ba86a None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:41.633066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9ae57-7c4b-442a-b8b4-b51e58b73c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:41.633801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9ae57-7c4b-442a-b8b4-b51e58b73c14 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.634290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9ae57-7c4b-442a-b8b4-b51e58b73c14 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.634766 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9ae57-7c4b-442a-b8b4-b51e58b73c14 None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.636933 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9ae57-7c4b-442a-b8b4-b51e58b73c14 None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:41.639273 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9ae57-7c4b-442a-b8b4-b51e58b73c14 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:41.642180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 138/285] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:41 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:41.651925 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67f0bd-8a61-44a3-a207-754a06fa496f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:41.743107 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2f787-ed43-46cf-b5a8-4f364537dfa3 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.744496 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2f787-ed43-46cf-b5a8-4f364537dfa3 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.745157 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2f787-ed43-46cf-b5a8-4f364537dfa3 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.748140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 139/286] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:41.755940 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65210e0d-6344-4ac6-b9ae-2ccce08489f9 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.756776 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65210e0d-6344-4ac6-b9ae-2ccce08489f9 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.757475 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65210e0d-6344-4ac6-b9ae-2ccce08489f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.804937 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-65210e0d-6344-4ac6-b9ae-2ccce08489f9 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:41.807347 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-65210e0d-6344-4ac6-b9ae-2ccce08489f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:41.896755 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67f0bd-8a61-44a3-a207-754a06fa496f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:41.956502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 140/287] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:41.987829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b6aae-2ab8-4a10-b829-60d0871e14ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:41.989602 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b6aae-2ab8-4a10-b829-60d0871e14ef None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:41.990411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b6aae-2ab8-4a10-b829-60d0871e14ef None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:41.991129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b6aae-2ab8-4a10-b829-60d0871e14ef None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e/users/ea7102f7d9704ea8857f1d16ef19669c/roles/1f24a90c6e1a4534b0a55f86ccc0ee7f` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:41.995020 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b6aae-2ab8-4a10-b829-60d0871e14ef None admin] RBAC: Authorizing `identity:create_grant(project_id=a281171d594749e4986718444da08d9e, user_id=ea7102f7d9704ea8857f1d16ef19669c, role_id=1f24a90c6e1a4534b0a55f86ccc0ee7f)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:41.998083 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b6aae-2ab8-4a10-b829-60d0871e14ef None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:42.029905 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 148/288] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:38:41 2022] PUT /identity/v3/projects/a281171d594749e4986718444da08d9e/users/ea7102f7d9704ea8857f1d16ef19669c/roles/1f24a90c6e1a4534b0a55f86ccc0ee7f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:42.381525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65210e0d-6344-4ac6-b9ae-2ccce08489f9 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:42.455149 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:42.599426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65210e0d-6344-4ac6-b9ae-2ccce08489f9 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:42.665271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18223d8-2262-46bd-be91-791d78768a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:42.666260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18223d8-2262-46bd-be91-791d78768a6d None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:42.666729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18223d8-2262-46bd-be91-791d78768a6d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:42.667200 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18223d8-2262-46bd-be91-791d78768a6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:42.686111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18223d8-2262-46bd-be91-791d78768a6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:42.696599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-e18223d8-2262-46bd-be91-791d78768a6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:42.696599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:42.696599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:42.696599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:42.696599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:42.696599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:42.696599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:42.696599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:42.696599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:42.696599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:42.696599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:42.696599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:42.696599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:42.696599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:42.696599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:42.696599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:42.698309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:42.698309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:42.698309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:42.698309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:42.698309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:42.698309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:42.698309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:42.698309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:42.698309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:42.698309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:42.698309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:42.698309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:42.698309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:42.698309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:42.698309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:42.698309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:42.701115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:42.701115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:42.701115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:42.701115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:42.701115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:42.701115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:42.701115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:42.701115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:42.701115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:42.701115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:42.701115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:42.701115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:42.701115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 141/289] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:42.709893 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b6aae-2ab8-4a10-b829-60d0871e14ef None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:42.803222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:42.916549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b6aae-2ab8-4a10-b829-60d0871e14ef None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:42.999279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44fec2-460d-4634-ac57-3009a8b6ff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:43.000194 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44fec2-460d-4634-ac57-3009a8b6ff5d None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:43.000194 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44fec2-460d-4634-ac57-3009a8b6ff5d None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:43.000623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44fec2-460d-4634-ac57-3009a8b6ff5d None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:43.001238 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44fec2-460d-4634-ac57-3009a8b6ff5d None admin] RBAC: Adding query filter params (name=member) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:43.001572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44fec2-460d-4634-ac57-3009a8b6ff5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:43.002981 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44fec2-460d-4634-ac57-3009a8b6ff5d None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:43.017017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 149/290] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:43.023494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18223d8-2262-46bd-be91-791d78768a6d None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:43.143204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:43.154512 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18223d8-2262-46bd-be91-791d78768a6d None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:43.222674 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9030b4-fd05-4853-aecf-ad268b647b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:43.224197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9030b4-fd05-4853-aecf-ad268b647b06 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:43.224929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9030b4-fd05-4853-aecf-ad268b647b06 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:43.225869 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9030b4-fd05-4853-aecf-ad268b647b06 None admin] PATH_INFO: `/v3/users/74e2072e53104ebd92b2a7a54a6caf3c` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:43.228253 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9030b4-fd05-4853-aecf-ad268b647b06 None admin] RBAC: Authorizing `identity:get_user(user_id=74e2072e53104ebd92b2a7a54a6caf3c)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:43.231346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9030b4-fd05-4853-aecf-ad268b647b06 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:43.234655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 142/291] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:43 2022] GET /identity/v3/users/74e2072e53104ebd92b2a7a54a6caf3c => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:43.240826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44fec2-460d-4634-ac57-3009a8b6ff5d None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:43.396222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44fec2-460d-4634-ac57-3009a8b6ff5d None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:43.398339 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:43.443998 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9a302-bf46-44fe-a54f-0e6cc997d42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:43.444658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9a302-bf46-44fe-a54f-0e6cc997d42f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:43.444940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9a302-bf46-44fe-a54f-0e6cc997d42f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:43.445214 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9a302-bf46-44fe-a54f-0e6cc997d42f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:43.602570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9a302-bf46-44fe-a54f-0e6cc997d42f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:43.605792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9a302-bf46-44fe-a54f-0e6cc997d42f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:43.647381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763b22f-44e8-44e4-89eb-bf2bb5daf1ff None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:43.648312 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763b22f-44e8-44e4-89eb-bf2bb5daf1ff None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:43.649119 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763b22f-44e8-44e4-89eb-bf2bb5daf1ff None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:43.651949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 143/292] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:43.661382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b0416-6395-4727-9734-cc8c3adae327 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:43.661677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b0416-6395-4727-9734-cc8c3adae327 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:43.661978 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b0416-6395-4727-9734-cc8c3adae327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:43.693051 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-4f0b0416-6395-4727-9734-cc8c3adae327 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:43.694320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4f0b0416-6395-4727-9734-cc8c3adae327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:43.815902 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 150/293] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:43.822026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9a302-bf46-44fe-a54f-0e6cc997d42f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:43.824468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:43.904770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 144/294] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:43.938930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9a302-bf46-44fe-a54f-0e6cc997d42f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:43.977299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e09ed2-6699-4f8a-8d3d-87752ce096a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:43.978027 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e09ed2-6699-4f8a-8d3d-87752ce096a3 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:43.978312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e09ed2-6699-4f8a-8d3d-87752ce096a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:43.978962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e09ed2-6699-4f8a-8d3d-87752ce096a3 None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:43.980560 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e09ed2-6699-4f8a-8d3d-87752ce096a3 None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:43.982283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e09ed2-6699-4f8a-8d3d-87752ce096a3 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:43.984238 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 151/295] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:43 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:43.999595 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b0416-6395-4727-9734-cc8c3adae327 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:44.182614 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:44.210868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b0416-6395-4727-9734-cc8c3adae327 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:44.294797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793cf32-fbd8-4dcf-aeca-442ef96184e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:44.295791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793cf32-fbd8-4dcf-aeca-442ef96184e6 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:44.296266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793cf32-fbd8-4dcf-aeca-442ef96184e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:44.296726 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793cf32-fbd8-4dcf-aeca-442ef96184e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:44.298172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793cf32-fbd8-4dcf-aeca-442ef96184e6 None admin] RBAC: Adding query filter params (role.id=c770dd0c3bc540c3a48b0393d192b17a, scope.project.id=a281171d594749e4986718444da08d9e, user.id=74e2072e53104ebd92b2a7a54a6caf3c) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:44.298704 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793cf32-fbd8-4dcf-aeca-442ef96184e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:44.301294 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793cf32-fbd8-4dcf-aeca-442ef96184e6 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:44.318235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 145/296] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:43 2022] GET /identity/v3/role_assignments?user.id=74e2072e53104ebd92b2a7a54a6caf3c&scope.project.id=a281171d594749e4986718444da08d9e&role.id=c770dd0c3bc540c3a48b0393d192b17a => generated 608 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:44.487080 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c42334-1a9a-4c13-b884-263ae551f7db None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:44.488002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c42334-1a9a-4c13-b884-263ae551f7db None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:44.488435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c42334-1a9a-4c13-b884-263ae551f7db None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:44.490072 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 152/297] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:44.499296 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c74aa-5d4e-4c4b-b4a2-906a126eefbc None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:44.499875 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c74aa-5d4e-4c4b-b4a2-906a126eefbc None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:44.500370 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c74aa-5d4e-4c4b-b4a2-906a126eefbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:44.545038 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-729c74aa-5d4e-4c4b-b4a2-906a126eefbc None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:44.546981 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-729c74aa-5d4e-4c4b-b4a2-906a126eefbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:44.617129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c42334-1a9a-4c13-b884-263ae551f7db None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:44.677916 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 146/298] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:44.806256 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:44.865042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c42334-1a9a-4c13-b884-263ae551f7db None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:44.924533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed4663-c206-48ed-b0fb-7eeaed59280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:44.925685 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed4663-c206-48ed-b0fb-7eeaed59280e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:44.926164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed4663-c206-48ed-b0fb-7eeaed59280e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:44.926651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed4663-c206-48ed-b0fb-7eeaed59280e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:44.958201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed4663-c206-48ed-b0fb-7eeaed59280e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:44.968358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-cfed4663-c206-48ed-b0fb-7eeaed59280e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:44.968358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:44.968358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:44.968358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:44.968358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:44.968358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:44.968358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:44.968358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:44.968358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:44.968358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:44.968358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:44.968358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:44.968358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:44.968358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:44.968358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:44.968358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:44.970168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:44.970168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:44.970168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:44.970168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:44.970168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:44.970168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:44.970168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:44.970168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:44.970168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:44.970168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:44.970168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:44.970168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:44.970168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:44.970168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:44.970168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:44.970168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:44.971735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:44.971735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:44.971735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:44.971735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:44.971735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:44.971735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:44.971735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:44.971735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:44.971735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:44.971735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:44.971735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:44.971735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:38:44.977751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 153/299] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:38:44.986857 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c74aa-5d4e-4c4b-b4a2-906a126eefbc None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:45.152130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ebd3c-dedf-4370-9e31-3daa34d4dd0a None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:45.153063 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ebd3c-dedf-4370-9e31-3daa34d4dd0a None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:45.153787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ebd3c-dedf-4370-9e31-3daa34d4dd0a None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:45.156812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 154/300] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:45.162816 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33480af8-d2ab-41d1-9e31-0aa017c80c69 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:45.163193 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33480af8-d2ab-41d1-9e31-0aa017c80c69 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:45.163654 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:45.164565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33480af8-d2ab-41d1-9e31-0aa017c80c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:45.186398 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-33480af8-d2ab-41d1-9e31-0aa017c80c69 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:45.188501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-33480af8-d2ab-41d1-9e31-0aa017c80c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:45.200753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c74aa-5d4e-4c4b-b4a2-906a126eefbc None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:45.249440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20710ec7-bce8-4520-80fe-8926d5cf1e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:45.250484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20710ec7-bce8-4520-80fe-8926d5cf1e9f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:45.251062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20710ec7-bce8-4520-80fe-8926d5cf1e9f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:45.251564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20710ec7-bce8-4520-80fe-8926d5cf1e9f None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:45.252653 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20710ec7-bce8-4520-80fe-8926d5cf1e9f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:45.253190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20710ec7-bce8-4520-80fe-8926d5cf1e9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:45.254904 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20710ec7-bce8-4520-80fe-8926d5cf1e9f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:45.265743 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 147/301] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:45.269076 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20710ec7-bce8-4520-80fe-8926d5cf1e9f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:45.298094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 155/302] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:45.300067 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33480af8-d2ab-41d1-9e31-0aa017c80c69 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:45.410916 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20710ec7-bce8-4520-80fe-8926d5cf1e9f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:45.453203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:45.468695 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b2780-2a2f-46f5-ace0-e081ccf500f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:45.469577 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b2780-2a2f-46f5-ace0-e081ccf500f8 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:45.470099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b2780-2a2f-46f5-ace0-e081ccf500f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:45.470458 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b2780-2a2f-46f5-ace0-e081ccf500f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:45.471837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b2780-2a2f-46f5-ace0-e081ccf500f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:45.473868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b2780-2a2f-46f5-ace0-e081ccf500f8 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:45.483472 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 148/303] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:38:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:45.484748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b2780-2a2f-46f5-ace0-e081ccf500f8 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:45.504282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:45.547174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33480af8-d2ab-41d1-9e31-0aa017c80c69 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:45.626133 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a90df-c12a-4ab8-ad52-7824cd2c570c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:45.627724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a90df-c12a-4ab8-ad52-7824cd2c570c None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:45.627892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b2780-2a2f-46f5-ace0-e081ccf500f8 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:45.628661 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a90df-c12a-4ab8-ad52-7824cd2c570c None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:45.629676 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a90df-c12a-4ab8-ad52-7824cd2c570c None admin] PATH_INFO: `/v3/users/9d94c6a7c2ee4c92b3d6f43c5cb70748` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:45.659875 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a90df-c12a-4ab8-ad52-7824cd2c570c None admin] RBAC: Authorizing `identity:get_user(user_id=9d94c6a7c2ee4c92b3d6f43c5cb70748)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:45.664041 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a90df-c12a-4ab8-ad52-7824cd2c570c None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:45.667395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 156/304] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:45 2022] GET /identity/v3/users/9d94c6a7c2ee4c92b3d6f43c5cb70748 => generated 293 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:45.673712 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a90df-c12a-4ab8-ad52-7824cd2c570c None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:45.675810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcfdad-780c-4127-bfe9-50ed3e3fe717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:45.677285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcfdad-780c-4127-bfe9-50ed3e3fe717 None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:45.678176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcfdad-780c-4127-bfe9-50ed3e3fe717 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:45.678901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcfdad-780c-4127-bfe9-50ed3e3fe717 None admin] PATH_INFO: `/v3/groups` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:45.680372 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcfdad-780c-4127-bfe9-50ed3e3fe717 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:45.683628 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcfdad-780c-4127-bfe9-50ed3e3fe717 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:45.715392 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 149/305] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Sep 12 23:38:45 2022] POST /identity/v3/groups => generated 229 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:38:45.774953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcfdad-780c-4127-bfe9-50ed3e3fe717 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:45.794547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a90df-c12a-4ab8-ad52-7824cd2c570c None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:45.829809 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:45.842143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9fbf4-856b-4052-9b27-0b7c5a69ff79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:45.842826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9fbf4-856b-4052-9b27-0b7c5a69ff79 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:45.843098 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9fbf4-856b-4052-9b27-0b7c5a69ff79 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:45.843357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9fbf4-856b-4052-9b27-0b7c5a69ff79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:45.844425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9fbf4-856b-4052-9b27-0b7c5a69ff79 None admin] RBAC: Adding query filter params (role.id=1f24a90c6e1a4534b0a55f86ccc0ee7f, user.id=9d94c6a7c2ee4c92b3d6f43c5cb70748, scope.system=all) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:45.844895 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9fbf4-856b-4052-9b27-0b7c5a69ff79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:45.847708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9fbf4-856b-4052-9b27-0b7c5a69ff79 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:45.857408 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 157/306] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Sep 12 23:38:45 2022] GET /identity/v3/role_assignments?user.id=9d94c6a7c2ee4c92b3d6f43c5cb70748&scope.system=all&role.id=1f24a90c6e1a4534b0a55f86ccc0ee7f => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:45.926757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:45.988951 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcfdad-780c-4127-bfe9-50ed3e3fe717 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:46.056119 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a20d4-aa34-4d7b-b125-fa3c78d462f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:46.057290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a20d4-aa34-4d7b-b125-fa3c78d462f8 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:46.057803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a20d4-aa34-4d7b-b125-fa3c78d462f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:46.058277 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a20d4-aa34-4d7b-b125-fa3c78d462f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:46.080425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a20d4-aa34-4d7b-b125-fa3c78d462f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:46.091034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-af6a20d4-aa34-4d7b-b125-fa3c78d462f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:46.091034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:46.091034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:46.091034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:46.091034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:46.091034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:46.091034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:46.091034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:46.091034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:46.091034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:46.091034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:46.091034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:46.091034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:46.091034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:46.091034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:46.091034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:46.091990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:46.091990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:46.091990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:46.091990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:46.091990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:46.091990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:46.091990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:46.091990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:46.091990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:46.091990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:46.091990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:46.091990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:46.091990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:46.091990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:46.091990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:46.091990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:46.092751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:46.092751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:46.092751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:46.092751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:46.092751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:46.092751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:46.092751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:46.092751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:46.092751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:46.092751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:46.092751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:46.092751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:46.095967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 150/307] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:38:46.104738 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9fbf4-856b-4052-9b27-0b7c5a69ff79 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:46.293614 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9fbf4-856b-4052-9b27-0b7c5a69ff79 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:46.308244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cabb4-5e1c-4eb5-bd50-110f59db984d None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:46.309016 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cabb4-5e1c-4eb5-bd50-110f59db984d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:46.309016 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cabb4-5e1c-4eb5-bd50-110f59db984d None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:46.311084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 151/308] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:38:46.320492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866b7c4-a2ba-40c2-a09c-e48ab3240c1e None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:46.321458 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866b7c4-a2ba-40c2-a09c-e48ab3240c1e None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:46.322191 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866b7c4-a2ba-40c2-a09c-e48ab3240c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:46.348913 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148f2e0-5176-439c-af63-e81cee7bdeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:46.350388 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148f2e0-5176-439c-af63-e81cee7bdeb1 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:46.351193 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148f2e0-5176-439c-af63-e81cee7bdeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:46.351454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-d866b7c4-a2ba-40c2-a09c-e48ab3240c1e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:46.352094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148f2e0-5176-439c-af63-e81cee7bdeb1 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:46.353180 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148f2e0-5176-439c-af63-e81cee7bdeb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:46.353399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-d866b7c4-a2ba-40c2-a09c-e48ab3240c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:46.354310 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148f2e0-5176-439c-af63-e81cee7bdeb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:46.357550 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148f2e0-5176-439c-af63-e81cee7bdeb1 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:46.380127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 158/309] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:46.389390 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148f2e0-5176-439c-af63-e81cee7bdeb1 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:46.460709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:46.462326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 152/310] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:46.581400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148f2e0-5176-439c-af63-e81cee7bdeb1 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:46.647246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea658a04-e0bc-479d-9020-037e3e8bc944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:46.648002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea658a04-e0bc-479d-9020-037e3e8bc944 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:46.648536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea658a04-e0bc-479d-9020-037e3e8bc944 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:46.648728 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea658a04-e0bc-479d-9020-037e3e8bc944 None admin] PATH_INFO: `/v3/users/4e8960e0dc5345c881574a6776d0da31` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:46.650318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea658a04-e0bc-479d-9020-037e3e8bc944 None admin] RBAC: Authorizing `identity:get_user(user_id=4e8960e0dc5345c881574a6776d0da31)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:46.651955 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea658a04-e0bc-479d-9020-037e3e8bc944 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:46.653775 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 159/311] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:46 2022] GET /identity/v3/users/4e8960e0dc5345c881574a6776d0da31 => generated 293 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:46.661152 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866b7c4-a2ba-40c2-a09c-e48ab3240c1e None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:46.766148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:46.844764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866b7c4-a2ba-40c2-a09c-e48ab3240c1e None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:46.910470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7644b-f755-42bd-8be3-c97fe9e50f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:46.911471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7644b-f755-42bd-8be3-c97fe9e50f9e None admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:46.911937 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7644b-f755-42bd-8be3-c97fe9e50f9e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:46.912373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7644b-f755-42bd-8be3-c97fe9e50f9e None admin] PATH_INFO: `/v3/system/users/4e8960e0dc5345c881574a6776d0da31/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:46.914834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7644b-f755-42bd-8be3-c97fe9e50f9e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4e8960e0dc5345c881574a6776d0da31, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:46.917315 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7644b-f755-42bd-8be3-c97fe9e50f9e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:46.934891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 153/312] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Sep 12 23:38:46 2022] PUT /identity/v3/system/users/4e8960e0dc5345c881574a6776d0da31/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:46.949113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea658a04-e0bc-479d-9020-037e3e8bc944 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:47.143193 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea658a04-e0bc-479d-9020-037e3e8bc944 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:47.159264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:47.182475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622f5ca-a406-48dd-b456-8147d1d74447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:47.183133 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622f5ca-a406-48dd-b456-8147d1d74447 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.183409 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622f5ca-a406-48dd-b456-8147d1d74447 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.183674 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622f5ca-a406-48dd-b456-8147d1d74447 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.195828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622f5ca-a406-48dd-b456-8147d1d74447 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:47.201250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-d622f5ca-a406-48dd-b456-8147d1d74447 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:47.201250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:47.201250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:47.201250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:47.201250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:47.201250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:47.201250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:47.201250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:47.201250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:47.201250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:47.201250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:47.201250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:47.201250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:47.201250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:47.201250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:47.201250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:47.202171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:47.202171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:47.202171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:47.202171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:47.202171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:47.202171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:47.202171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:47.202171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:47.202171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:47.202171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:47.202171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:47.202171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:47.202171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:47.202171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:47.202171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:47.202171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:47.202931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:47.202931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:47.202931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:47.202931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:47.202931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:47.202931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:47.202931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:47.202931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:47.202931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:47.202931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:47.202931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:47.202931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:38:47.202931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 160/313] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:47.209811 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7644b-f755-42bd-8be3-c97fe9e50f9e None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:47.322854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7644b-f755-42bd-8be3-c97fe9e50f9e None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:47.366078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:47.383945 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281f87f-b784-4c99-a6b0-8c7f0529a8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:47.384997 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281f87f-b784-4c99-a6b0-8c7f0529a8df None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.385628 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281f87f-b784-4c99-a6b0-8c7f0529a8df None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.386123 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281f87f-b784-4c99-a6b0-8c7f0529a8df None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.388789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281f87f-b784-4c99-a6b0-8c7f0529a8df None admin] RBAC: Adding query filter params (name=reader) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:47.389375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281f87f-b784-4c99-a6b0-8c7f0529a8df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:47.392107 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281f87f-b784-4c99-a6b0-8c7f0529a8df None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:47.409516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 154/314] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:47.414860 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622f5ca-a406-48dd-b456-8147d1d74447 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:47.593404 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622f5ca-a406-48dd-b456-8147d1d74447 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:47.659452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74ec31-2a08-4685-9a57-c08981316f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:47.660317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74ec31-2a08-4685-9a57-c08981316f6b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.660606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74ec31-2a08-4685-9a57-c08981316f6b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.661083 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74ec31-2a08-4685-9a57-c08981316f6b None admin] PATH_INFO: `/v3/users/ea7102f7d9704ea8857f1d16ef19669c` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:47.663367 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74ec31-2a08-4685-9a57-c08981316f6b None admin] RBAC: Authorizing `identity:get_user(user_id=ea7102f7d9704ea8857f1d16ef19669c)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:47.665958 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74ec31-2a08-4685-9a57-c08981316f6b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:47.669485 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 161/315] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:47 2022] GET /identity/v3/users/ea7102f7d9704ea8857f1d16ef19669c => generated 297 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:47.678788 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281f87f-b784-4c99-a6b0-8c7f0529a8df None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:47.860840 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281f87f-b784-4c99-a6b0-8c7f0529a8df None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:47.924169 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759fbf8-7f7d-4f42-9cef-deed533dc0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:47.924794 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759fbf8-7f7d-4f42-9cef-deed533dc0d8 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:47.925072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759fbf8-7f7d-4f42-9cef-deed533dc0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:47.925358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759fbf8-7f7d-4f42-9cef-deed533dc0d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:48.029184 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:48.057481 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759fbf8-7f7d-4f42-9cef-deed533dc0d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:48.060259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759fbf8-7f7d-4f42-9cef-deed533dc0d8 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:48.151699 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd7c4f-b5c2-4667-8253-28dba67dfc9e None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:48.152187 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd7c4f-b5c2-4667-8253-28dba67dfc9e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:48.152662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd7c4f-b5c2-4667-8253-28dba67dfc9e None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:48.155932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 162/316] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:48.165079 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c31eba-7258-49ba-b6e6-481141c13ac1 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:48.165569 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c31eba-7258-49ba-b6e6-481141c13ac1 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:48.166050 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c31eba-7258-49ba-b6e6-481141c13ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:48.196283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-a7c31eba-7258-49ba-b6e6-481141c13ac1 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:48.197901 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a7c31eba-7258-49ba-b6e6-481141c13ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:48.239894 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:48.245418 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 155/317] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:48.254254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759fbf8-7f7d-4f42-9cef-deed533dc0d8 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:48.287258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 163/318] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:38:48.423076 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759fbf8-7f7d-4f42-9cef-deed533dc0d8 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:48.425828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:48.455972 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cd5d8-66dc-41ac-a39d-6d63a70a3938 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:48.456163 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cd5d8-66dc-41ac-a39d-6d63a70a3938 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:48.456433 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cd5d8-66dc-41ac-a39d-6d63a70a3938 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:48.457845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 164/319] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:48.464372 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e2ae0-4eb3-454a-bc61-c2aac1961a7d None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:48.464800 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e2ae0-4eb3-454a-bc61-c2aac1961a7d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:48.465178 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e2ae0-4eb3-454a-bc61-c2aac1961a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:48.486962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-c43e2ae0-4eb3-454a-bc61-c2aac1961a7d None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:48.488343 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c43e2ae0-4eb3-454a-bc61-c2aac1961a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:48.491028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436a6fd-4b4d-4a80-aafb-efef2e1f9fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:48.493929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436a6fd-4b4d-4a80-aafb-efef2e1f9fbc None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:48.494704 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436a6fd-4b4d-4a80-aafb-efef2e1f9fbc None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:48.495353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436a6fd-4b4d-4a80-aafb-efef2e1f9fbc None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:48.497674 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436a6fd-4b4d-4a80-aafb-efef2e1f9fbc None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:48.503040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436a6fd-4b4d-4a80-aafb-efef2e1f9fbc None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:48.507987 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 156/320] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:48 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:48.518219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436a6fd-4b4d-4a80-aafb-efef2e1f9fbc None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:48.576628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 165/321] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:38:48.697841 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436a6fd-4b4d-4a80-aafb-efef2e1f9fbc None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:48.741849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d1b22-5b4d-4911-a2fd-c279ab287e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:48.742524 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d1b22-5b4d-4911-a2fd-c279ab287e88 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:48.742815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d1b22-5b4d-4911-a2fd-c279ab287e88 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:48.743088 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d1b22-5b4d-4911-a2fd-c279ab287e88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:48.743868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d1b22-5b4d-4911-a2fd-c279ab287e88 None admin] RBAC: Adding query filter params (role.id=1f24a90c6e1a4534b0a55f86ccc0ee7f, scope.project.id=a281171d594749e4986718444da08d9e, user.id=ea7102f7d9704ea8857f1d16ef19669c) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:48.744180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d1b22-5b4d-4911-a2fd-c279ab287e88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:48.745761 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d1b22-5b4d-4911-a2fd-c279ab287e88 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:48.753318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 157/322] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:38:48 2022] GET /identity/v3/role_assignments?user.id=ea7102f7d9704ea8857f1d16ef19669c&scope.project.id=a281171d594749e4986718444da08d9e&role.id=1f24a90c6e1a4534b0a55f86ccc0ee7f => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:48.784123 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e2ae0-4eb3-454a-bc61-c2aac1961a7d None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:48.912544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:48.916568 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e2ae0-4eb3-454a-bc61-c2aac1961a7d None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:48.960947 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f30611-bd7c-4cc2-8cb7-b89e5ab0f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:48.961662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f30611-bd7c-4cc2-8cb7-b89e5ab0f986 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:48.961940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f30611-bd7c-4cc2-8cb7-b89e5ab0f986 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:48.962209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f30611-bd7c-4cc2-8cb7-b89e5ab0f986 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:48.963495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f30611-bd7c-4cc2-8cb7-b89e5ab0f986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:48.965138 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f30611-bd7c-4cc2-8cb7-b89e5ab0f986 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:48.967276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 166/323] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:38:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:48.973399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d1b22-5b4d-4911-a2fd-c279ab287e88 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:49.002874 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:49.015205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f30611-bd7c-4cc2-8cb7-b89e5ab0f986 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:49.177188 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d1b22-5b4d-4911-a2fd-c279ab287e88 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:49.201969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f30611-bd7c-4cc2-8cb7-b89e5ab0f986 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:49.249991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90801460-5c41-484d-9a45-280f9930ceb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:49.250721 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90801460-5c41-484d-9a45-280f9930ceb5 None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.251054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90801460-5c41-484d-9a45-280f9930ceb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.251326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90801460-5c41-484d-9a45-280f9930ceb5 None admin] PATH_INFO: `/v3/groups` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.252015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90801460-5c41-484d-9a45-280f9930ceb5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:49.253619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90801460-5c41-484d-9a45-280f9930ceb5 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:49.260507 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b8582-148f-4dc4-8b8f-88d888dc4595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:49.261715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b8582-148f-4dc4-8b8f-88d888dc4595 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.262265 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b8582-148f-4dc4-8b8f-88d888dc4595 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.262703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b8582-148f-4dc4-8b8f-88d888dc4595 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.273926 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 158/324] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Sep 12 23:38:48 2022] POST /identity/v3/groups => generated 226 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:38:49.284190 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b8582-148f-4dc4-8b8f-88d888dc4595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:49.295217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-737b8582-148f-4dc4-8b8f-88d888dc4595 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:49.295217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:49.295217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:49.295217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:49.295217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:49.295217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:49.295217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:49.295217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:49.295217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:49.295217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:49.295217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:49.295217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:49.295217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:49.295217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:49.295217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:49.295217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:49.296924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:49.296924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:49.296924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:49.296924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:49.296924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:49.296924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:49.296924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:49.296924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:49.296924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:49.296924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:49.296924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:49.296924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:49.296924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:49.296924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:49.296924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:49.296924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:49.299184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:49.299184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:49.299184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:49.299184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:49.299184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:49.299184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:49.299184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:49.299184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:49.299184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:49.299184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:49.299184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:49.299184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:38:49.301870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 167/325] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:38:49.308033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90801460-5c41-484d-9a45-280f9930ceb5 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:49.485572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:49.519463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90801460-5c41-484d-9a45-280f9930ceb5 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:49.571952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facad4b-7fe9-4136-a890-da268c66a257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:49.572811 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facad4b-7fe9-4136-a890-da268c66a257 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.573233 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facad4b-7fe9-4136-a890-da268c66a257 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.573759 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facad4b-7fe9-4136-a890-da268c66a257 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.574915 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facad4b-7fe9-4136-a890-da268c66a257 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:49.575377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facad4b-7fe9-4136-a890-da268c66a257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:49.577690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facad4b-7fe9-4136-a890-da268c66a257 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:49.592961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 159/326] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:49.600781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b8582-148f-4dc4-8b8f-88d888dc4595 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:49.661800 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:49.761948 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aac7c-0a30-4f58-b01a-f12196ca7839 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.762387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aac7c-0a30-4f58-b01a-f12196ca7839 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.762832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aac7c-0a30-4f58-b01a-f12196ca7839 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.765385 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 160/327] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:49.775214 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796622b-a913-4b52-bda9-351cad894ea0 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.775537 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796622b-a913-4b52-bda9-351cad894ea0 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.776000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796622b-a913-4b52-bda9-351cad894ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.799696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b8582-148f-4dc4-8b8f-88d888dc4595 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:49.819495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-7796622b-a913-4b52-bda9-351cad894ea0 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:49.821491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7796622b-a913-4b52-bda9-351cad894ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:49.849046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e7578-27cd-4f33-8e23-9a4a24da8978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:49.849886 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e7578-27cd-4f33-8e23-9a4a24da8978 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:49.850174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e7578-27cd-4f33-8e23-9a4a24da8978 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:49.850450 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e7578-27cd-4f33-8e23-9a4a24da8978 None admin] PATH_INFO: `/v3/users/9d94c6a7c2ee4c92b3d6f43c5cb70748` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:49.851830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e7578-27cd-4f33-8e23-9a4a24da8978 None admin] RBAC: Authorizing `identity:get_user(user_id=9d94c6a7c2ee4c92b3d6f43c5cb70748)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:49.853322 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e7578-27cd-4f33-8e23-9a4a24da8978 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:49.861381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 168/328] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:49 2022] GET /identity/v3/users/9d94c6a7c2ee4c92b3d6f43c5cb70748 => generated 293 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:49.864511 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e7578-27cd-4f33-8e23-9a4a24da8978 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:49.963097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 161/329] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:50.035759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:50.043178 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e7578-27cd-4f33-8e23-9a4a24da8978 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:50.128929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6940a-8ecf-4aaf-9c98-3c62ab43e66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:50.132742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6940a-8ecf-4aaf-9c98-3c62ab43e66b None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:50.133232 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6940a-8ecf-4aaf-9c98-3c62ab43e66b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:50.133759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6940a-8ecf-4aaf-9c98-3c62ab43e66b None admin] PATH_INFO: `/v3/system/users/9d94c6a7c2ee4c92b3d6f43c5cb70748/roles/1f24a90c6e1a4534b0a55f86ccc0ee7f` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:50.136537 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6940a-8ecf-4aaf-9c98-3c62ab43e66b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9d94c6a7c2ee4c92b3d6f43c5cb70748, role_id=1f24a90c6e1a4534b0a55f86ccc0ee7f)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:50.139196 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6940a-8ecf-4aaf-9c98-3c62ab43e66b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:50.161236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 169/330] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Sep 12 23:38:49 2022] PUT /identity/v3/system/users/9d94c6a7c2ee4c92b3d6f43c5cb70748/roles/1f24a90c6e1a4534b0a55f86ccc0ee7f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:38:50.427023 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796622b-a913-4b52-bda9-351cad894ea0 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:50.525132 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:50.568017 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796622b-a913-4b52-bda9-351cad894ea0 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:50.623430 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119464c-0cb2-4b0a-ac3c-d4d206d0109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:50.624103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119464c-0cb2-4b0a-ac3c-d4d206d0109d None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:50.624381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119464c-0cb2-4b0a-ac3c-d4d206d0109d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:50.624651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119464c-0cb2-4b0a-ac3c-d4d206d0109d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:50.647114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119464c-0cb2-4b0a-ac3c-d4d206d0109d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:50.652833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-1119464c-0cb2-4b0a-ac3c-d4d206d0109d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:50.652833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:50.652833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:50.652833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:50.652833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:50.652833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:50.652833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:50.652833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:50.652833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:50.652833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:50.652833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:50.652833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:50.652833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:50.652833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:50.652833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:50.652833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:50.654086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:50.654086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:50.654086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:50.654086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:50.654086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:50.654086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:50.654086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:50.654086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:50.654086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:50.654086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:50.654086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:50.654086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:50.654086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:50.654086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:50.654086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:50.654086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:50.654953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:50.654953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:50.654953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:50.654953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:50.654953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:50.654953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:50.654953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:50.654953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:50.654953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:50.654953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:50.654953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:50.654953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:50.658287 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 162/331] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:50.667087 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6940a-8ecf-4aaf-9c98-3c62ab43e66b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:50.893848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6940a-8ecf-4aaf-9c98-3c62ab43e66b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:50.961181 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac037023-200e-433e-a2d2-d1bfb49c744d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:50.962198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac037023-200e-433e-a2d2-d1bfb49c744d None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:50.962699 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac037023-200e-433e-a2d2-d1bfb49c744d None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:50.963117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac037023-200e-433e-a2d2-d1bfb49c744d None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:50.964095 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac037023-200e-433e-a2d2-d1bfb49c744d None admin] RBAC: Adding query filter params (name=member) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:50.964529 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac037023-200e-433e-a2d2-d1bfb49c744d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:50.966670 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac037023-200e-433e-a2d2-d1bfb49c744d None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:50.982706 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 170/332] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:50.991302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119464c-0cb2-4b0a-ac3c-d4d206d0109d None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:51.161989 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119464c-0cb2-4b0a-ac3c-d4d206d0109d None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:51.212296 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:51.216073 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158e626-984e-45ec-9763-b7add00620ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:51.216735 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158e626-984e-45ec-9763-b7add00620ad None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:51.221889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158e626-984e-45ec-9763-b7add00620ad None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:51.222236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158e626-984e-45ec-9763-b7add00620ad None admin] PATH_INFO: `/v3/users/4e8960e0dc5345c881574a6776d0da31` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:51.223813 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158e626-984e-45ec-9763-b7add00620ad None admin] RBAC: Authorizing `identity:get_user(user_id=4e8960e0dc5345c881574a6776d0da31)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:51.225389 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9158e626-984e-45ec-9763-b7add00620ad None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:51.227410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 163/333] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:50 2022] GET /identity/v3/users/4e8960e0dc5345c881574a6776d0da31 => generated 293 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:51.237128 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac037023-200e-433e-a2d2-d1bfb49c744d None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:51.305764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:51.441386 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac037023-200e-433e-a2d2-d1bfb49c744d None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:51.494442 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3596a6-904a-411f-bd6f-5c0c6b1a6064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:51.495072 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3596a6-904a-411f-bd6f-5c0c6b1a6064 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:51.495353 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3596a6-904a-411f-bd6f-5c0c6b1a6064 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:51.495604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3596a6-904a-411f-bd6f-5c0c6b1a6064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:51.496359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3596a6-904a-411f-bd6f-5c0c6b1a6064 None admin] RBAC: Adding query filter params (role.id=c770dd0c3bc540c3a48b0393d192b17a, user.id=4e8960e0dc5345c881574a6776d0da31, scope.system=all) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:51.496658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3596a6-904a-411f-bd6f-5c0c6b1a6064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:51.498175 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3596a6-904a-411f-bd6f-5c0c6b1a6064 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:51.514891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 171/334] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Sep 12 23:38:51 2022] GET /identity/v3/role_assignments?user.id=4e8960e0dc5345c881574a6776d0da31&scope.system=all&role.id=c770dd0c3bc540c3a48b0393d192b17a => generated 510 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:53.052510 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ac32d-aaa8-4c9c-b953-15e16fc8587d None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.053286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ac32d-aaa8-4c9c-b953-15e16fc8587d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.053286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ac32d-aaa8-4c9c-b953-15e16fc8587d None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.054755 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 164/335] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:53.061680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92921aae-d51f-4c44-8de2-0123ff53ef3a None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.062792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92921aae-d51f-4c44-8de2-0123ff53ef3a None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.063087 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92921aae-d51f-4c44-8de2-0123ff53ef3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.105145 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-92921aae-d51f-4c44-8de2-0123ff53ef3a None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:53.107222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-92921aae-d51f-4c44-8de2-0123ff53ef3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:53.265674 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 172/336] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:53.425855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aebe42-1aaa-4fee-8357-05084e6fa758 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.426244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aebe42-1aaa-4fee-8357-05084e6fa758 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.426456 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aebe42-1aaa-4fee-8357-05084e6fa758 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.427821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 165/337] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:53.436264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cac11-6559-468e-b3e3-f304b8611307 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:53.436546 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cac11-6559-468e-b3e3-f304b8611307 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:53.436834 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cac11-6559-468e-b3e3-f304b8611307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:53.465838 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-4e5cac11-6559-468e-b3e3-f304b8611307 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:53.470523 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4e5cac11-6559-468e-b3e3-f304b8611307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:53.474315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:53.566063 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 173/338] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:53.876546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aebe42-1aaa-4fee-8357-05084e6fa758 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:54.097722 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aebe42-1aaa-4fee-8357-05084e6fa758 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:54.123407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3776dfc-5fc7-4d19-88d6-466fe8ff8394 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.125000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3776dfc-5fc7-4d19-88d6-466fe8ff8394 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.130199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3776dfc-5fc7-4d19-88d6-466fe8ff8394 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:54.132506 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 174/339] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:54 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:54.141156 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2f17e-ce20-492e-ac9c-453d4f32c73b None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.141674 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2f17e-ce20-492e-ac9c-453d4f32c73b None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.141970 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2f17e-ce20-492e-ac9c-453d4f32c73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:54.172516 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-0ea2f17e-ce20-492e-ac9c-453d4f32c73b None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:54.174034 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0ea2f17e-ce20-492e-ac9c-453d4f32c73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:54.174973 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dbed7-8f39-478b-a854-de0b1bea5d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:54.175632 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dbed7-8f39-478b-a854-de0b1bea5d92 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.175919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dbed7-8f39-478b-a854-de0b1bea5d92 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.176185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dbed7-8f39-478b-a854-de0b1bea5d92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:54.205809 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dbed7-8f39-478b-a854-de0b1bea5d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:54.210717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-c94dbed7-8f39-478b-a854-de0b1bea5d92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:54.210717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:54.210717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:54.210717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:54.210717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:54.210717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:54.210717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:54.210717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:54.210717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:54.210717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:54.210717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:54.210717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:54.210717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:54.210717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:54.210717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:54.210717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:54.212495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:54.212495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:54.212495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:54.212495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:54.212495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:54.212495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:54.212495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:54.212495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:54.212495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:54.212495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:54.212495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:54.212495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:54.212495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:54.212495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:54.212495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:54.212495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:54.214143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:54.214143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:54.214143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:54.214143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:54.214143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:54.214143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:54.214143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:54.214143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:54.214143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:54.214143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:54.214143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:54.214143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:38:54.214143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 166/340] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:54.221242 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dbed7-8f39-478b-a854-de0b1bea5d92 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:54.323733 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 175/341] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:38:54.324684 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:54.382543 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dbed7-8f39-478b-a854-de0b1bea5d92 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:54.389909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2f17e-ce20-492e-ac9c-453d4f32c73b None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:54.446619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b47c7f-a8d5-4985-ba93-434dbffab209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:54.448197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b47c7f-a8d5-4985-ba93-434dbffab209 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.448997 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b47c7f-a8d5-4985-ba93-434dbffab209 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.449795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b47c7f-a8d5-4985-ba93-434dbffab209 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:54.451277 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b47c7f-a8d5-4985-ba93-434dbffab209 None admin] RBAC: Adding query filter params (name=member) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:54.452099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b47c7f-a8d5-4985-ba93-434dbffab209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:54.455198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b47c7f-a8d5-4985-ba93-434dbffab209 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:54.473688 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 167/342] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:54.485980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b47c7f-a8d5-4985-ba93-434dbffab209 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:54.574892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:54.670365 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2f17e-ce20-492e-ac9c-453d4f32c73b None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:54.765190 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd59d1-7f0f-475a-9945-92421a00e2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:54.768735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd59d1-7f0f-475a-9945-92421a00e2f8 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.771557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd59d1-7f0f-475a-9945-92421a00e2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.772351 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd59d1-7f0f-475a-9945-92421a00e2f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:54.787147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b47c7f-a8d5-4985-ba93-434dbffab209 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:54.809725 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd59d1-7f0f-475a-9945-92421a00e2f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:54.815512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-81fd59d1-7f0f-475a-9945-92421a00e2f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:38:54.815512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:54.815512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:54.815512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:54.815512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:54.815512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:54.815512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:54.815512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:54.815512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:54.815512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:54.815512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:54.815512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:54.815512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:54.815512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:54.815512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:54.815512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:54.817205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:54.817205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:54.817205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:54.817205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:54.817205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:54.817205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:54.817205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:54.817205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:54.817205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:54.817205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:54.817205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:54.817205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:54.817205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:54.817205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:54.817205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:54.817205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:54.818753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:54.818753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:54.818753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:54.818753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:54.818753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:54.818753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:54.818753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:54.818753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:54.818753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:54.818753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:54.818753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:38:54.818753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:38:54.818753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 176/343] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:38:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:54.823760 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2722438-c20e-413d-85d1-7f0c0e268232 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.824107 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2722438-c20e-413d-85d1-7f0c0e268232 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.824322 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2722438-c20e-413d-85d1-7f0c0e268232 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:54.831039 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 177/344] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:54.832032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2722438-c20e-413d-85d1-7f0c0e268232 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:54.857174 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:54.886849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ebeb8-876b-4430-badd-2aed8b6aab76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:54.887849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ebeb8-876b-4430-badd-2aed8b6aab76 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:54.888022 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ebeb8-876b-4430-badd-2aed8b6aab76 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:54.888269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ebeb8-876b-4430-badd-2aed8b6aab76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:55.065271 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2722438-c20e-413d-85d1-7f0c0e268232 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:55.067794 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ebeb8-876b-4430-badd-2aed8b6aab76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:55.071046 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ebeb8-876b-4430-badd-2aed8b6aab76 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:55.106833 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:55.115970 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5e2c7-8b0a-4c43-b9cf-22aab771e5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:55.116967 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5e2c7-8b0a-4c43-b9cf-22aab771e5c9 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:55.117212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5e2c7-8b0a-4c43-b9cf-22aab771e5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:55.117511 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5e2c7-8b0a-4c43-b9cf-22aab771e5c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:55.118169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5e2c7-8b0a-4c43-b9cf-22aab771e5c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:55.118469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5e2c7-8b0a-4c43-b9cf-22aab771e5c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:55.120156 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5e2c7-8b0a-4c43-b9cf-22aab771e5c9 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:55.131258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 178/345] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:38:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:55.135277 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3644b7-36fa-4954-85bd-ed79476f0161 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:55.135630 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3644b7-36fa-4954-85bd-ed79476f0161 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:55.135895 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3644b7-36fa-4954-85bd-ed79476f0161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:55.159240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-6c3644b7-36fa-4954-85bd-ed79476f0161 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:55.161200 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6c3644b7-36fa-4954-85bd-ed79476f0161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:55.260658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 179/346] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:55.262708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3644b7-36fa-4954-85bd-ed79476f0161 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:55.284120 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 168/347] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 799 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:55.287523 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f514718-f655-4860-b9e5-cb6d068ea487 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:55.287894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f514718-f655-4860-b9e5-cb6d068ea487 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:55.288678 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f514718-f655-4860-b9e5-cb6d068ea487 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:55.291417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 169/348] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:55.295980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f514718-f655-4860-b9e5-cb6d068ea487 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:55.349605 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:55.444002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3644b7-36fa-4954-85bd-ed79476f0161 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:55.473601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:55.498976 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42753285-de8f-4021-b7c0-b3251975d391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:55.499833 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42753285-de8f-4021-b7c0-b3251975d391 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:55.500202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42753285-de8f-4021-b7c0-b3251975d391 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:55.500566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42753285-de8f-4021-b7c0-b3251975d391 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:55.515925 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42753285-de8f-4021-b7c0-b3251975d391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:55.520585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-42753285-de8f-4021-b7c0-b3251975d391 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:55.520585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:55.520585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:55.520585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:55.520585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:55.520585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:55.520585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:55.520585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:55.520585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:55.520585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:55.520585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:55.520585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:55.520585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:55.520585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:55.520585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:55.520585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:55.522420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:55.522420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:55.522420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:55.522420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:55.522420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:55.522420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:55.522420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:55.522420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:55.522420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:55.522420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:55.522420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:55.522420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:55.522420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:55.522420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:55.522420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:55.522420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:55.523829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:55.523829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:55.523829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:55.523829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:55.523829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:55.523829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:55.523829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:55.523829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:55.523829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:55.523829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:55.523829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 12 23:38:55.523829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:38:55.523829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 180/349] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:55.523829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42753285-de8f-4021-b7c0-b3251975d391 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:55.565477 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f514718-f655-4860-b9e5-cb6d068ea487 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:55.630897 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224f464-dae4-4a2f-b5d0-9c8c86bbb7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:55.632456 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224f464-dae4-4a2f-b5d0-9c8c86bbb7c2 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:55.633463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224f464-dae4-4a2f-b5d0-9c8c86bbb7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:55.634129 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224f464-dae4-4a2f-b5d0-9c8c86bbb7c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:55.676609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42753285-de8f-4021-b7c0-b3251975d391 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:55.730806 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b824b74-aa4d-469e-9083-338c653badb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:55.732166 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824b74-aa4d-469e-9083-338c653badb8 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:55.733000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824b74-aa4d-469e-9083-338c653badb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:55.733284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824b74-aa4d-469e-9083-338c653badb8 None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:55.735128 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b824b74-aa4d-469e-9083-338c653badb8 None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:55.736824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b824b74-aa4d-469e-9083-338c653badb8 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:55.740962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 181/350] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:55 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:55.747259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8b2f9-318e-4b91-ade5-b3d73b1e9a40 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:55.747683 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8b2f9-318e-4b91-ade5-b3d73b1e9a40 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:55.748102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8b2f9-318e-4b91-ade5-b3d73b1e9a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:55.750319 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224f464-dae4-4a2f-b5d0-9c8c86bbb7c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:55.751887 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224f464-dae4-4a2f-b5d0-9c8c86bbb7c2 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:55.780644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-44f8b2f9-318e-4b91-ade5-b3d73b1e9a40 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:55.782171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-44f8b2f9-318e-4b91-ade5-b3d73b1e9a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:55.782778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:55.860311 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:55.897288 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 170/351] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:55.898710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224f464-dae4-4a2f-b5d0-9c8c86bbb7c2 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:55.904829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 182/352] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:55.906143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8b2f9-318e-4b91-ade5-b3d73b1e9a40 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:56.042923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8b2f9-318e-4b91-ade5-b3d73b1e9a40 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:56.077196 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224f464-dae4-4a2f-b5d0-9c8c86bbb7c2 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:56.098745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522144e-e331-4f2c-a8ff-a2c35228e6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:56.099425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522144e-e331-4f2c-a8ff-a2c35228e6ad None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:56.099707 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522144e-e331-4f2c-a8ff-a2c35228e6ad None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:56.099962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522144e-e331-4f2c-a8ff-a2c35228e6ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:56.120953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522144e-e331-4f2c-a8ff-a2c35228e6ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:56.128219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-9522144e-e331-4f2c-a8ff-a2c35228e6ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:56.128219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:56.128219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:56.128219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:56.128219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:56.128219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:56.128219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:56.128219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:56.128219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:56.128219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:56.128219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:56.128219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:56.128219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:56.128219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:56.128219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:56.128219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:56.129424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:56.129424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:56.129424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:56.129424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:56.129424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:56.129424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:56.129424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:56.129424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:56.129424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:56.129424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:56.129424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:56.129424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:56.129424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:56.129424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:56.129424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:56.129424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:56.130946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:56.130946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:56.130946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:56.130946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:56.130946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:56.130946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:56.130946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:56.130946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:56.130946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:56.130946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:56.130946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:38:56.130946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:38:56.133627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 183/353] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:56.134523 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522144e-e331-4f2c-a8ff-a2c35228e6ad None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:56.137776 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:56.159223 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944c774-847b-4556-bd70-3310ffaa6610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:56.160532 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944c774-847b-4556-bd70-3310ffaa6610 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:56.161105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944c774-847b-4556-bd70-3310ffaa6610 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:56.162920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944c774-847b-4556-bd70-3310ffaa6610 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:56.164243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944c774-847b-4556-bd70-3310ffaa6610 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:56.164889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944c774-847b-4556-bd70-3310ffaa6610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:56.168756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944c774-847b-4556-bd70-3310ffaa6610 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:56.186298 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 171/354] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:56.188920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944c774-847b-4556-bd70-3310ffaa6610 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:56.225674 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:56.322281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522144e-e331-4f2c-a8ff-a2c35228e6ad None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:56.372927 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944c774-847b-4556-bd70-3310ffaa6610 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:56.379263 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc545a-1718-4899-88a4-dd37263e7d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:56.379934 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc545a-1718-4899-88a4-dd37263e7d89 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:56.380217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc545a-1718-4899-88a4-dd37263e7d89 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:56.380489 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc545a-1718-4899-88a4-dd37263e7d89 None admin] PATH_INFO: `/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:56.389209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc545a-1718-4899-88a4-dd37263e7d89 None admin] RBAC: Authorizing `identity:get_group(group_id=ea734b61d1ec4605b8258b5a73c69d0e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:56.390755 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc545a-1718-4899-88a4-dd37263e7d89 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:56.392890 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 184/355] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 23:38:56 2022] GET /identity/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:56.393562 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc545a-1718-4899-88a4-dd37263e7d89 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:56.434083 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497964a-047c-451c-aea0-f2e667fdb050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:56.435469 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497964a-047c-451c-aea0-f2e667fdb050 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:56.435945 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497964a-047c-451c-aea0-f2e667fdb050 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:56.436217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497964a-047c-451c-aea0-f2e667fdb050 None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:56.438730 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497964a-047c-451c-aea0-f2e667fdb050 None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:56.440532 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497964a-047c-451c-aea0-f2e667fdb050 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:56.443099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 172/356] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:56 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:56.445541 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497964a-047c-451c-aea0-f2e667fdb050 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:56.521444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:56.556698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc545a-1718-4899-88a4-dd37263e7d89 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:56.561483 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:56.601857 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497964a-047c-451c-aea0-f2e667fdb050 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:56.612620 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86895089-69dd-4cd3-9dce-6941b44588b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:56.612833 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86895089-69dd-4cd3-9dce-6941b44588b2 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:56.613232 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86895089-69dd-4cd3-9dce-6941b44588b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:56.613758 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86895089-69dd-4cd3-9dce-6941b44588b2 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:56.616005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86895089-69dd-4cd3-9dce-6941b44588b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:56.616552 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86895089-69dd-4cd3-9dce-6941b44588b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:56.620312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86895089-69dd-4cd3-9dce-6941b44588b2 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:56.631932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 185/357] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:38:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:56.635151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d8065-2467-43b8-a10e-85b7bda249d7 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:56.635553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d8065-2467-43b8-a10e-85b7bda249d7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:56.636014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d8065-2467-43b8-a10e-85b7bda249d7 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:56.637719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 186/358] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:38:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:38:56.638610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d8065-2467-43b8-a10e-85b7bda249d7 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:56.670614 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e40b5-b5cc-482a-a6da-0b4dc7ebd571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:56.671273 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e40b5-b5cc-482a-a6da-0b4dc7ebd571 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:56.671552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e40b5-b5cc-482a-a6da-0b4dc7ebd571 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:56.671814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e40b5-b5cc-482a-a6da-0b4dc7ebd571 None admin] PATH_INFO: `/v3/users/9d94c6a7c2ee4c92b3d6f43c5cb70748` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:56.673859 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e40b5-b5cc-482a-a6da-0b4dc7ebd571 None admin] RBAC: Authorizing `identity:get_user(user_id=9d94c6a7c2ee4c92b3d6f43c5cb70748)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:56.676006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e40b5-b5cc-482a-a6da-0b4dc7ebd571 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:56.677978 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 173/359] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:38:56 2022] GET /identity/v3/users/9d94c6a7c2ee4c92b3d6f43c5cb70748 => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:56.678598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e40b5-b5cc-482a-a6da-0b4dc7ebd571 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:56.795384 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d8065-2467-43b8-a10e-85b7bda249d7 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:56.840499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae700370-1d60-4933-824b-9dd83b45d179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:56.843838 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae700370-1d60-4933-824b-9dd83b45d179 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:56.843838 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae700370-1d60-4933-824b-9dd83b45d179 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:56.843838 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae700370-1d60-4933-824b-9dd83b45d179 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:56.851399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e40b5-b5cc-482a-a6da-0b4dc7ebd571 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:56.855399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae700370-1d60-4933-824b-9dd83b45d179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:56.860431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-ae700370-1d60-4933-824b-9dd83b45d179 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:38:56.860431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:56.860431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:56.860431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:56.860431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:56.860431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:56.860431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:56.860431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:56.860431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:56.860431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:56.860431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:56.860431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:56.860431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:56.860431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:56.860431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:56.860431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:56.862078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:56.862078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:56.862078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:56.862078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:56.862078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:56.862078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:56.862078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:56.862078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:56.862078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:56.862078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:56.862078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:56.862078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:56.862078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:56.862078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:56.862078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:56.862078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:56.863610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:56.863610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:56.863610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:56.863610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:56.863610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:56.863610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:56.863610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:56.863610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:56.863610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:56.863610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:56.863610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:38:56.863610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:38:56.863610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 187/360] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:38:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:56.863610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae700370-1d60-4933-824b-9dd83b45d179 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:56.880807 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:56.902006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4c941-eb1e-40ca-8551-c7cc307aa402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:56.902844 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4c941-eb1e-40ca-8551-c7cc307aa402 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:56.903093 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4c941-eb1e-40ca-8551-c7cc307aa402 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:56.903382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4c941-eb1e-40ca-8551-c7cc307aa402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:56.905317 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4c941-eb1e-40ca-8551-c7cc307aa402 None admin] RBAC: Adding query filter params (group.id=ea734b61d1ec4605b8258b5a73c69d0e, role.id=c770dd0c3bc540c3a48b0393d192b17a, scope.project.id=ab929f16a6c349389781c723ea5d01a3) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:56.905751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4c941-eb1e-40ca-8551-c7cc307aa402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:56.907890 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4c941-eb1e-40ca-8551-c7cc307aa402 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:56.909546 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:56.915636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 174/361] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 23:38:56 2022] GET /identity/v3/role_assignments?group.id=ea734b61d1ec4605b8258b5a73c69d0e&scope.project.id=ab929f16a6c349389781c723ea5d01a3&role.id=c770dd0c3bc540c3a48b0393d192b17a => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:56.916514 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4c941-eb1e-40ca-8551-c7cc307aa402 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:57.068033 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae700370-1d60-4933-824b-9dd83b45d179 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:57.109403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4c941-eb1e-40ca-8551-c7cc307aa402 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:57.137465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd6b27-0468-409e-9a9e-3bfba6941a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:57.138244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd6b27-0468-409e-9a9e-3bfba6941a62 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:57.138244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd6b27-0468-409e-9a9e-3bfba6941a62 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:57.138680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd6b27-0468-409e-9a9e-3bfba6941a62 None admin] PATH_INFO: `/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:57.141711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd6b27-0468-409e-9a9e-3bfba6941a62 None admin] RBAC: Authorizing `identity:get_group(group_id=ea734b61d1ec4605b8258b5a73c69d0e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:57.142503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd6b27-0468-409e-9a9e-3bfba6941a62 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:57.144418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 188/362] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 23:38:56 2022] GET /identity/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:57.145518 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e698a-f65d-48b5-b678-624b833207ab None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:57.145799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e698a-f65d-48b5-b678-624b833207ab None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:57.146068 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e698a-f65d-48b5-b678-624b833207ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:57.169792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-be1e698a-f65d-48b5-b678-624b833207ab None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:38:57.169984 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47026ee-7f71-488f-b2ee-512a74c2fe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:57.170704 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47026ee-7f71-488f-b2ee-512a74c2fe50 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:57.171003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47026ee-7f71-488f-b2ee-512a74c2fe50 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:57.172033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47026ee-7f71-488f-b2ee-512a74c2fe50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:57.172936 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-be1e698a-f65d-48b5-b678-624b833207ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:38:57.236178 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:57.265387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 189/363] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:38:57.265387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e698a-f65d-48b5-b678-624b833207ab None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:57.271691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47026ee-7f71-488f-b2ee-512a74c2fe50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:57.274357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47026ee-7f71-488f-b2ee-512a74c2fe50 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:57.292246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:57.430749 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e698a-f65d-48b5-b678-624b833207ab None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:57.432519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 175/364] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:57.434317 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47026ee-7f71-488f-b2ee-512a74c2fe50 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:57.507289 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffeb813-53b5-4f65-9dab-094ac4489dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:57.508911 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeb813-53b5-4f65-9dab-094ac4489dd2 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:57.509539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeb813-53b5-4f65-9dab-094ac4489dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:57.510313 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeb813-53b5-4f65-9dab-094ac4489dd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:57.511893 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffeb813-53b5-4f65-9dab-094ac4489dd2 None admin] RBAC: Adding query filter params (role.id=1f24a90c6e1a4534b0a55f86ccc0ee7f, user.id=9d94c6a7c2ee4c92b3d6f43c5cb70748, scope.system=all) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:57.512721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffeb813-53b5-4f65-9dab-094ac4489dd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:57.515752 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffeb813-53b5-4f65-9dab-094ac4489dd2 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:57.538579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 190/365] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Sep 12 23:38:57 2022] GET /identity/v3/role_assignments?user.id=9d94c6a7c2ee4c92b3d6f43c5cb70748&scope.system=all&role.id=1f24a90c6e1a4534b0a55f86ccc0ee7f => generated 510 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:57.546488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffeb813-53b5-4f65-9dab-094ac4489dd2 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:57.603424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:57.629845 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47026ee-7f71-488f-b2ee-512a74c2fe50 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:57.667045 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:57.682411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238be73-2b6b-4552-9e03-bc915cac53a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:57.683468 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238be73-2b6b-4552-9e03-bc915cac53a3 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:57.683818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238be73-2b6b-4552-9e03-bc915cac53a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:57.684157 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238be73-2b6b-4552-9e03-bc915cac53a3 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:57.685101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238be73-2b6b-4552-9e03-bc915cac53a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:57.685526 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238be73-2b6b-4552-9e03-bc915cac53a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:57.688297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238be73-2b6b-4552-9e03-bc915cac53a3 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:57.694424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffeb813-53b5-4f65-9dab-094ac4489dd2 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:57.701117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 176/366] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:38:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:57.702715 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238be73-2b6b-4552-9e03-bc915cac53a3 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:57.748916 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a26914-c7c9-42ab-94b0-42d2e585fa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:57.750078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a26914-c7c9-42ab-94b0-42d2e585fa01 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:57.750078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a26914-c7c9-42ab-94b0-42d2e585fa01 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:57.750375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a26914-c7c9-42ab-94b0-42d2e585fa01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:57.752344 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a26914-c7c9-42ab-94b0-42d2e585fa01 None admin] RBAC: Adding query filter params (group.id=ea734b61d1ec4605b8258b5a73c69d0e, role.id=e4d659212810456798a60c1902537d7d, scope.project.id=ab929f16a6c349389781c723ea5d01a3) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:57.752740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a26914-c7c9-42ab-94b0-42d2e585fa01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:57.754249 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a26914-c7c9-42ab-94b0-42d2e585fa01 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:57.769472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 191/367] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 23:38:57 2022] GET /identity/v3/role_assignments?group.id=ea734b61d1ec4605b8258b5a73c69d0e&scope.project.id=ab929f16a6c349389781c723ea5d01a3&role.id=e4d659212810456798a60c1902537d7d => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:57.771410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a26914-c7c9-42ab-94b0-42d2e585fa01 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:57.847969 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238be73-2b6b-4552-9e03-bc915cac53a3 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:57.919661 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67287451-fd3f-4341-a7ad-208e6874403e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:57.920683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67287451-fd3f-4341-a7ad-208e6874403e None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:57.921315 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67287451-fd3f-4341-a7ad-208e6874403e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:57.921841 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67287451-fd3f-4341-a7ad-208e6874403e None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:57.923575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67287451-fd3f-4341-a7ad-208e6874403e None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:57.924452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a26914-c7c9-42ab-94b0-42d2e585fa01 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:57.925831 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67287451-fd3f-4341-a7ad-208e6874403e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:57.928211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 177/368] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:57 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:57.929419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67287451-fd3f-4341-a7ad-208e6874403e None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:57.958152 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:57.971414 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7a90c-bbd1-492f-b3b5-0025f848ce0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:57.972390 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7a90c-bbd1-492f-b3b5-0025f848ce0d None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:57.972738 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7a90c-bbd1-492f-b3b5-0025f848ce0d None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:57.973021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7a90c-bbd1-492f-b3b5-0025f848ce0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:57.996963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7a90c-bbd1-492f-b3b5-0025f848ce0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:38:58.003867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-cad7a90c-bbd1-492f-b3b5-0025f848ce0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:38:58.003867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:38:58.003867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:38:58.003867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:38:58.003867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:38:58.003867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:38:58.003867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:38:58.003867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:38:58.003867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:38:58.003867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:38:58.003867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:38:58.003867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:38:58.003867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:38:58.003867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:38:58.003867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:38:58.003867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:38:58.004858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:38:58.004858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:38:58.004858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:38:58.004858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:38:58.004858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:38:58.004858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:38:58.004858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:38:58.004858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:38:58.004858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:38:58.004858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:38:58.004858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:38:58.004858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:38:58.004858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:38:58.004858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:38:58.004858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:38:58.004858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:38:58.005652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:38:58.005652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:38:58.005652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:38:58.005652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:38:58.005652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:38:58.005652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:38:58.005652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:38:58.005652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:38:58.005652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:38:58.005652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:38:58.005652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:38:58.005652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:38:58.008178 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 192/369] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:38:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:38:58.009489 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7a90c-bbd1-492f-b3b5-0025f848ce0d None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:58.026517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:58.120148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67287451-fd3f-4341-a7ad-208e6874403e None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:58.192095 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6e259-1559-45f2-8146-b4a49349313c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:58.194410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6e259-1559-45f2-8146-b4a49349313c None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:58.194873 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7a90c-bbd1-492f-b3b5-0025f848ce0d None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:58.195693 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6e259-1559-45f2-8146-b4a49349313c None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:58.196366 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6e259-1559-45f2-8146-b4a49349313c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:58.269068 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfca16-b6d5-46bc-9e16-728ac1db3149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:58.270777 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfca16-b6d5-46bc-9e16-728ac1db3149 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:58.271529 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfca16-b6d5-46bc-9e16-728ac1db3149 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:58.272274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfca16-b6d5-46bc-9e16-728ac1db3149 None admin] PATH_INFO: `/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:58.275234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfca16-b6d5-46bc-9e16-728ac1db3149 None admin] RBAC: Authorizing `identity:get_group(group_id=ea734b61d1ec4605b8258b5a73c69d0e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:58.278507 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfca16-b6d5-46bc-9e16-728ac1db3149 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:58.288760 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 193/370] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 23:38:58 2022] GET /identity/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:58.290712 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfca16-b6d5-46bc-9e16-728ac1db3149 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:58.359602 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6e259-1559-45f2-8146-b4a49349313c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:58.362202 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6e259-1559-45f2-8146-b4a49349313c None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:58.399929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:58.471796 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:58.545552 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfca16-b6d5-46bc-9e16-728ac1db3149 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:58.600364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 178/371] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:58.606049 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6e259-1559-45f2-8146-b4a49349313c None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:58.616366 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382f366-e946-455c-bf95-002bc4c154fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:58.617654 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382f366-e946-455c-bf95-002bc4c154fc None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:58.618157 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382f366-e946-455c-bf95-002bc4c154fc None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:58.618653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3382f366-e946-455c-bf95-002bc4c154fc None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:58.619634 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382f366-e946-455c-bf95-002bc4c154fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:58.620154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382f366-e946-455c-bf95-002bc4c154fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:58.623012 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3382f366-e946-455c-bf95-002bc4c154fc None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:58.632974 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 194/372] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:38:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:58.634305 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382f366-e946-455c-bf95-002bc4c154fc None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:58.748028 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3382f366-e946-455c-bf95-002bc4c154fc None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:58.783434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6e259-1559-45f2-8146-b4a49349313c None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:58.784918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1319c0-bdcf-452e-b5d3-e3e403f39394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:58.785721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1319c0-bdcf-452e-b5d3-e3e403f39394 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:58.786045 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1319c0-bdcf-452e-b5d3-e3e403f39394 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:58.786393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1319c0-bdcf-452e-b5d3-e3e403f39394 None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:58.787643 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1319c0-bdcf-452e-b5d3-e3e403f39394 None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:58.789254 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1319c0-bdcf-452e-b5d3-e3e403f39394 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:58.791125 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 195/373] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:58 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:58.796676 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1319c0-bdcf-452e-b5d3-e3e403f39394 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:58.800769 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:58.804550 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:58.831487 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc405d-7f7c-48b8-9adf-b48e769d5822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:58.832502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc405d-7f7c-48b8-9adf-b48e769d5822 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:58.832956 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc405d-7f7c-48b8-9adf-b48e769d5822 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:58.833470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc405d-7f7c-48b8-9adf-b48e769d5822 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:58.834522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc405d-7f7c-48b8-9adf-b48e769d5822 None admin] RBAC: Adding query filter params (group.id=ea734b61d1ec4605b8258b5a73c69d0e, role.id=c770dd0c3bc540c3a48b0393d192b17a, scope.project.id=a281171d594749e4986718444da08d9e) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:58.835100 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc405d-7f7c-48b8-9adf-b48e769d5822 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:58.836810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc405d-7f7c-48b8-9adf-b48e769d5822 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:58.843628 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 179/374] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 23:38:58 2022] GET /identity/v3/role_assignments?group.id=ea734b61d1ec4605b8258b5a73c69d0e&scope.project.id=a281171d594749e4986718444da08d9e&role.id=c770dd0c3bc540c3a48b0393d192b17a => generated 260 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:58.845049 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc405d-7f7c-48b8-9adf-b48e769d5822 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:58.987861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1319c0-bdcf-452e-b5d3-e3e403f39394 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:59.043150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3912ca-6d69-4bd4-a530-5ee66cf73070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:59.043717 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3912ca-6d69-4bd4-a530-5ee66cf73070 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:59.043997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3912ca-6d69-4bd4-a530-5ee66cf73070 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:59.044270 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3912ca-6d69-4bd4-a530-5ee66cf73070 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:59.092826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc405d-7f7c-48b8-9adf-b48e769d5822 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:59.153737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fec9f9-2fc6-4000-bcfd-d62c9e2090d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:59.155209 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fec9f9-2fc6-4000-bcfd-d62c9e2090d1 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:59.155548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fec9f9-2fc6-4000-bcfd-d62c9e2090d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:59.155833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fec9f9-2fc6-4000-bcfd-d62c9e2090d1 None admin] PATH_INFO: `/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:59.157593 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fec9f9-2fc6-4000-bcfd-d62c9e2090d1 None admin] RBAC: Authorizing `identity:get_group(group_id=ea734b61d1ec4605b8258b5a73c69d0e)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:59.159660 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fec9f9-2fc6-4000-bcfd-d62c9e2090d1 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:59.162527 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 180/375] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 23:38:58 2022] GET /identity/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e => generated 226 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:59.169285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fec9f9-2fc6-4000-bcfd-d62c9e2090d1 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:59.181956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3912ca-6d69-4bd4-a530-5ee66cf73070 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:59.183683 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3912ca-6d69-4bd4-a530-5ee66cf73070 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:59.194680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:59.281739 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:59.353007 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 196/376] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:38:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:38:59.361667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3912ca-6d69-4bd4-a530-5ee66cf73070 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:59.460118 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fec9f9-2fc6-4000-bcfd-d62c9e2090d1 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:59.545999 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dae556-852c-4d56-b0be-57a3101a8fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:59.546641 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dae556-852c-4d56-b0be-57a3101a8fff None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:59.546918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dae556-852c-4d56-b0be-57a3101a8fff None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:59.547187 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dae556-852c-4d56-b0be-57a3101a8fff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:59.548015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dae556-852c-4d56-b0be-57a3101a8fff None admin] RBAC: Adding query filter params (group.id=ea734b61d1ec4605b8258b5a73c69d0e, role.id=e4d659212810456798a60c1902537d7d, scope.project.id=a281171d594749e4986718444da08d9e) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:38:59.548328 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dae556-852c-4d56-b0be-57a3101a8fff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:59.553334 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dae556-852c-4d56-b0be-57a3101a8fff None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:59.569480 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 181/377] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 23:38:59 2022] GET /identity/v3/role_assignments?group.id=ea734b61d1ec4605b8258b5a73c69d0e&scope.project.id=a281171d594749e4986718444da08d9e&role.id=e4d659212810456798a60c1902537d7d => generated 260 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:59.600700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3912ca-6d69-4bd4-a530-5ee66cf73070 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:59.610063 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:59.666302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50489323-7d05-4351-b7a5-5bdac3fc665f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:59.667510 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50489323-7d05-4351-b7a5-5bdac3fc665f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:59.668064 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50489323-7d05-4351-b7a5-5bdac3fc665f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:59.668552 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50489323-7d05-4351-b7a5-5bdac3fc665f None admin] PATH_INFO: `/v3/projects/7f4013b4b7a749e88ad00a53390dd085` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:59.671099 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50489323-7d05-4351-b7a5-5bdac3fc665f None admin] RBAC: Authorizing `identity:get_project(project_id=7f4013b4b7a749e88ad00a53390dd085)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:59.673046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50489323-7d05-4351-b7a5-5bdac3fc665f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:59.675291 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 197/378] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:38:59 2022] GET /identity/v3/projects/7f4013b4b7a749e88ad00a53390dd085 => generated 344 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:38:59.681643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dae556-852c-4d56-b0be-57a3101a8fff None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:38:59.892211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dae556-852c-4d56-b0be-57a3101a8fff None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:38:59.909866 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:38:59.944476 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d20fc-35e1-44d4-a008-0e3db5516f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:38:59.945568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d20fc-35e1-44d4-a008-0e3db5516f9e None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:38:59.946048 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d20fc-35e1-44d4-a008-0e3db5516f9e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:38:59.946622 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d20fc-35e1-44d4-a008-0e3db5516f9e None admin] PATH_INFO: `/v3/groups/2370e2310846499c90886b53d5f1cdf5` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:38:59.957020 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d20fc-35e1-44d4-a008-0e3db5516f9e None admin] RBAC: Authorizing `identity:get_group(group_id=2370e2310846499c90886b53d5f1cdf5)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:38:59.958894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d20fc-35e1-44d4-a008-0e3db5516f9e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:38:59.960864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 182/379] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 23:38:59 2022] GET /identity/v3/groups/2370e2310846499c90886b53d5f1cdf5 => generated 229 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:38:59.967967 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50489323-7d05-4351-b7a5-5bdac3fc665f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:00.175197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff7a97-4b1e-41ce-a43b-c4915c95f696 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:00.175860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff7a97-4b1e-41ce-a43b-c4915c95f696 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:00.176136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff7a97-4b1e-41ce-a43b-c4915c95f696 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:00.182026 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 183/380] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:39:00.191012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b51fad-7b96-4c49-a302-8f9192026f85 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:00.191311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b51fad-7b96-4c49-a302-8f9192026f85 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:00.191714 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b51fad-7b96-4c49-a302-8f9192026f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:00.223239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-e6b51fad-7b96-4c49-a302-8f9192026f85 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:00.224594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e6b51fad-7b96-4c49-a302-8f9192026f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:00.239974 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50489323-7d05-4351-b7a5-5bdac3fc665f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:00.313781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff574cc-38d9-4c35-8b79-1d24299b7f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:00.314701 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff574cc-38d9-4c35-8b79-1d24299b7f71 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:00.315132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff574cc-38d9-4c35-8b79-1d24299b7f71 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:00.315554 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff574cc-38d9-4c35-8b79-1d24299b7f71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:00.316472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff574cc-38d9-4c35-8b79-1d24299b7f71 None admin] RBAC: Adding query filter params (group.id=2370e2310846499c90886b53d5f1cdf5, role.id=440092230f024959a90e846ab29c6367, scope.project.id=7f4013b4b7a749e88ad00a53390dd085) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:00.316956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff574cc-38d9-4c35-8b79-1d24299b7f71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:00.318648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff574cc-38d9-4c35-8b79-1d24299b7f71 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:00.325278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 198/381] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 23:38:59 2022] GET /identity/v3/role_assignments?group.id=2370e2310846499c90886b53d5f1cdf5&scope.project.id=7f4013b4b7a749e88ad00a53390dd085&role.id=440092230f024959a90e846ab29c6367 => generated 260 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:00.333381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702122e-c253-4b51-a47f-20769d244b8f None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:00.334140 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702122e-c253-4b51-a47f-20769d244b8f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:00.334587 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702122e-c253-4b51-a47f-20769d244b8f None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:00.336544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 199/382] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:00.342257 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed98077-8321-40c1-8541-06a7c18441c8 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:00.342784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed98077-8321-40c1-8541-06a7c18441c8 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:00.343205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed98077-8321-40c1-8541-06a7c18441c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:00.352441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 184/383] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:39:00.364152 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-eed98077-8321-40c1-8541-06a7c18441c8 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:00.366045 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-eed98077-8321-40c1-8541-06a7c18441c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:00.400860 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:00.446063 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 200/384] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:00.692551 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b51fad-7b96-4c49-a302-8f9192026f85 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:00.840087 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b51fad-7b96-4c49-a302-8f9192026f85 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:00.846232 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:00.877226 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed98077-8321-40c1-8541-06a7c18441c8 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:00.914125 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5141240-4981-4902-bcfa-05bd99f9eb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:00.915902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5141240-4981-4902-bcfa-05bd99f9eb92 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:00.920262 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5141240-4981-4902-bcfa-05bd99f9eb92 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:00.920825 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5141240-4981-4902-bcfa-05bd99f9eb92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:00.944698 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5141240-4981-4902-bcfa-05bd99f9eb92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:00.954877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-d5141240-4981-4902-bcfa-05bd99f9eb92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:39:00.954877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:00.954877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:00.954877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:00.954877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:00.954877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:00.954877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:00.954877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:00.954877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:00.954877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:00.954877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:00.954877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:00.954877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:00.954877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:00.954877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:00.954877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:00.955861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:00.955861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:00.955861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:00.955861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:00.955861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:00.955861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:00.955861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:00.955861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:00.955861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:00.955861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:00.955861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:00.955861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:00.955861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:00.955861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:00.955861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:00.955861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:00.956647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:00.956647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:00.956647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:00.956647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:00.956647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:00.956647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:00.956647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:00.956647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:00.956647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:00.956647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:00.956647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:39:00.956647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:00.966807 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 185/385] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:39:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:00.979879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5141240-4981-4902-bcfa-05bd99f9eb92 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:01.053747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed98077-8321-40c1-8541-06a7c18441c8 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:01.119702 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55a819-d374-4398-91d1-5d67edbe033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:01.120729 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55a819-d374-4398-91d1-5d67edbe033e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:01.121478 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55a819-d374-4398-91d1-5d67edbe033e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:01.121954 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55a819-d374-4398-91d1-5d67edbe033e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:01.149793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55a819-d374-4398-91d1-5d67edbe033e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:01.155567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-be55a819-d374-4398-91d1-5d67edbe033e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:39:01.155567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:01.155567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:01.155567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:01.155567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:01.155567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:01.155567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:01.155567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:01.155567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:01.155567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:01.155567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:01.155567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:01.155567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:01.155567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:01.155567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:01.155567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:01.156538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:01.156538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:01.156538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:01.156538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:01.156538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:01.156538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:01.156538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:01.156538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:01.156538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:01.156538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:01.156538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:01.156538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:01.156538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:01.156538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:01.156538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:01.156538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:01.158110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:01.158110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:01.158110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:01.158110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:01.158110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:01.158110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:01.158110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:01.158110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:01.158110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:01.158110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:01.158110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:39:01.158110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:01.163444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 201/386] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:39:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:39:01.173237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55a819-d374-4398-91d1-5d67edbe033e None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:01.228825 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5141240-4981-4902-bcfa-05bd99f9eb92 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:01.229553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:01.301854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb01970-f0f6-4ff4-b521-1ab13d9b3abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:01.302927 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb01970-f0f6-4ff4-b521-1ab13d9b3abf None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:01.303594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb01970-f0f6-4ff4-b521-1ab13d9b3abf None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:01.304970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb01970-f0f6-4ff4-b521-1ab13d9b3abf None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:01.307859 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb01970-f0f6-4ff4-b521-1ab13d9b3abf None admin] RBAC: Adding query filter params (name=member) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:01.308435 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb01970-f0f6-4ff4-b521-1ab13d9b3abf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:01.310229 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb01970-f0f6-4ff4-b521-1ab13d9b3abf None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:01.331191 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 186/387] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:39:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:01.336874 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb01970-f0f6-4ff4-b521-1ab13d9b3abf None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:01.380701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:01.397020 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55a819-d374-4398-91d1-5d67edbe033e None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:01.473389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efeaac0-3776-4532-84d5-e189d627234b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:01.477381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efeaac0-3776-4532-84d5-e189d627234b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:01.477381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efeaac0-3776-4532-84d5-e189d627234b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:01.477381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efeaac0-3776-4532-84d5-e189d627234b None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:01.477381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efeaac0-3776-4532-84d5-e189d627234b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:01.477381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efeaac0-3776-4532-84d5-e189d627234b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:01.477381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efeaac0-3776-4532-84d5-e189d627234b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:01.487276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 202/388] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:01.495962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efeaac0-3776-4532-84d5-e189d627234b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:01.511165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb01970-f0f6-4ff4-b521-1ab13d9b3abf None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:01.560688 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0a6ce-63a1-4743-824c-afb794f10778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:01.561828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0a6ce-63a1-4743-824c-afb794f10778 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:01.562664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0a6ce-63a1-4743-824c-afb794f10778 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:01.563738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0a6ce-63a1-4743-824c-afb794f10778 None admin] PATH_INFO: `/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:01.565559 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0a6ce-63a1-4743-824c-afb794f10778 None admin] RBAC: Authorizing `identity:get_group(group_id=ea734b61d1ec4605b8258b5a73c69d0e)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:01.567407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0a6ce-63a1-4743-824c-afb794f10778 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:01.570748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 187/389] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 23:39:01 2022] GET /identity/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:01.577527 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0a6ce-63a1-4743-824c-afb794f10778 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:01.644337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:01.654257 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efeaac0-3776-4532-84d5-e189d627234b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:01.719511 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb243fe-44a3-4dbf-a34e-4f29a702f6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:01.720663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb243fe-44a3-4dbf-a34e-4f29a702f6ba None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:01.722247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb243fe-44a3-4dbf-a34e-4f29a702f6ba None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:01.722878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb243fe-44a3-4dbf-a34e-4f29a702f6ba None admin] PATH_INFO: `/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:01.725553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb243fe-44a3-4dbf-a34e-4f29a702f6ba None admin] RBAC: Authorizing `identity:get_group(group_id=ea734b61d1ec4605b8258b5a73c69d0e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:01.728181 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb243fe-44a3-4dbf-a34e-4f29a702f6ba None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:01.732046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 203/390] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 23:39:01 2022] GET /identity/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:01.737953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb243fe-44a3-4dbf-a34e-4f29a702f6ba None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:01.764220 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:01.777704 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0a6ce-63a1-4743-824c-afb794f10778 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:01.852607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacc0bf-33b5-4562-951a-e19762482f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:01.853778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacc0bf-33b5-4562-951a-e19762482f43 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:01.854341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacc0bf-33b5-4562-951a-e19762482f43 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:01.854840 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacc0bf-33b5-4562-951a-e19762482f43 None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:01.857450 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacc0bf-33b5-4562-951a-e19762482f43 None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:01.860130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacc0bf-33b5-4562-951a-e19762482f43 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:01.862578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 188/391] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:39:01 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:01.869198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacc0bf-33b5-4562-951a-e19762482f43 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:01.929193 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb243fe-44a3-4dbf-a34e-4f29a702f6ba None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:01.975124 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fc9bd-ad5f-48bc-b5bb-b19347f8f8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:01.976242 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fc9bd-ad5f-48bc-b5bb-b19347f8f8db None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:01.977632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fc9bd-ad5f-48bc-b5bb-b19347f8f8db None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:01.980235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fc9bd-ad5f-48bc-b5bb-b19347f8f8db None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:01.981701 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fc9bd-ad5f-48bc-b5bb-b19347f8f8db None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:01.986923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fc9bd-ad5f-48bc-b5bb-b19347f8f8db None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:01.991787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 204/392] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:39:01 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:01.994654 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fc9bd-ad5f-48bc-b5bb-b19347f8f8db None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:02.029799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:02.119609 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacc0bf-33b5-4562-951a-e19762482f43 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:02.179702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9034f81-99a4-4497-b0d4-89038976b4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:02.180721 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9034f81-99a4-4497-b0d4-89038976b4b8 None admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:02.181231 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9034f81-99a4-4497-b0d4-89038976b4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:02.184988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fc9bd-ad5f-48bc-b5bb-b19347f8f8db None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:02.188594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9034f81-99a4-4497-b0d4-89038976b4b8 None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3/groups/ea734b61d1ec4605b8258b5a73c69d0e/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:02.193097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9034f81-99a4-4497-b0d4-89038976b4b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab929f16a6c349389781c723ea5d01a3, group_id=ea734b61d1ec4605b8258b5a73c69d0e, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:02.195906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9034f81-99a4-4497-b0d4-89038976b4b8 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:02.232252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 189/393] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Sep 12 23:39:01 2022] PUT /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3/groups/ea734b61d1ec4605b8258b5a73c69d0e/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:39:02.272251 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc1554-1fd0-4b47-88f8-ee203d5ad6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:02.273279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc1554-1fd0-4b47-88f8-ee203d5ad6bb None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:02.273809 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc1554-1fd0-4b47-88f8-ee203d5ad6bb None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:02.274217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc1554-1fd0-4b47-88f8-ee203d5ad6bb None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3/groups/ea734b61d1ec4605b8258b5a73c69d0e/roles/e4d659212810456798a60c1902537d7d` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:02.278175 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc1554-1fd0-4b47-88f8-ee203d5ad6bb None admin] RBAC: Authorizing `identity:create_grant(project_id=ab929f16a6c349389781c723ea5d01a3, group_id=ea734b61d1ec4605b8258b5a73c69d0e, role_id=e4d659212810456798a60c1902537d7d)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:02.280572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc1554-1fd0-4b47-88f8-ee203d5ad6bb None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:02.324019 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 205/394] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Sep 12 23:39:01 2022] PUT /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3/groups/ea734b61d1ec4605b8258b5a73c69d0e/roles/e4d659212810456798a60c1902537d7d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:39:02.630251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76c3e6-9eb1-45ee-a2df-79ce8fba53df None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:02.630651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76c3e6-9eb1-45ee-a2df-79ce8fba53df None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:02.630824 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76c3e6-9eb1-45ee-a2df-79ce8fba53df None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:02.632603 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 190/395] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:02.636054 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20623fca-9f19-4382-a596-550e78ee8515 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:02.636557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20623fca-9f19-4382-a596-550e78ee8515 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:02.637803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af07681-ac6c-4a5f-840d-d60fd4c348d6 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:02.638083 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af07681-ac6c-4a5f-840d-d60fd4c348d6 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:02.638355 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af07681-ac6c-4a5f-840d-d60fd4c348d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:02.641749 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20623fca-9f19-4382-a596-550e78ee8515 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:02.643401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 206/396] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:02.651170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910f30a-e157-4010-97ea-2b89adf92e06 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:02.651471 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910f30a-e157-4010-97ea-2b89adf92e06 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:02.651719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910f30a-e157-4010-97ea-2b89adf92e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:02.663539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-7af07681-ac6c-4a5f-840d-d60fd4c348d6 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:02.665248 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7af07681-ac6c-4a5f-840d-d60fd4c348d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:02.682005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-d910f30a-e157-4010-97ea-2b89adf92e06 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:02.684021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d910f30a-e157-4010-97ea-2b89adf92e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:02.685978 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:02.786171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 207/397] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:39:02.787780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 191/398] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:39:03.151021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910f30a-e157-4010-97ea-2b89adf92e06 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:03.168659 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:03.267947 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910f30a-e157-4010-97ea-2b89adf92e06 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:03.282848 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af07681-ac6c-4a5f-840d-d60fd4c348d6 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:03.311746 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b6227-da22-4695-a03f-189f57839d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:03.312805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b6227-da22-4695-a03f-189f57839d12 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:03.313227 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b6227-da22-4695-a03f-189f57839d12 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:03.313779 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b6227-da22-4695-a03f-189f57839d12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:03.332292 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b6227-da22-4695-a03f-189f57839d12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:03.338185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-1b4b6227-da22-4695-a03f-189f57839d12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:39:03.338185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:03.338185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:03.338185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:03.338185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:03.338185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:03.338185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:03.338185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:03.338185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:03.338185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:03.338185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:03.338185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:03.338185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:03.338185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:03.338185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:03.338185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:03.339317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:03.339317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:03.339317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:03.339317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:03.339317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:03.339317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:03.339317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:03.339317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:03.339317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:03.339317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:03.339317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:03.339317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:03.339317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:03.339317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:03.339317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:03.339317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:03.340315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:03.340315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:03.340315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:03.340315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:03.340315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:03.340315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:03.340315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:03.340315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:03.340315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:03.340315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:03.340315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:39:03.340315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:03.350952 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 208/399] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:39:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:03.358582 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b6227-da22-4695-a03f-189f57839d12 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:03.472759 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af07681-ac6c-4a5f-840d-d60fd4c348d6 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:03.514209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:03.546648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b6227-da22-4695-a03f-189f57839d12 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:03.570298 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72329546-334d-4d9d-a97f-3be6ebbddf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:03.571010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329546-334d-4d9d-a97f-3be6ebbddf88 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:03.571291 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329546-334d-4d9d-a97f-3be6ebbddf88 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:03.571851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329546-334d-4d9d-a97f-3be6ebbddf88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:03.594445 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72329546-334d-4d9d-a97f-3be6ebbddf88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:03.599361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-72329546-334d-4d9d-a97f-3be6ebbddf88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:39:03.599361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:03.599361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:03.599361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:03.599361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:03.599361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:03.599361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:03.599361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:03.599361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:03.599361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:03.599361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:03.599361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:03.599361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:03.599361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:03.599361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:03.599361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:03.600338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:03.600338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:03.600338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:03.600338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:03.600338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:03.600338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:03.600338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:03.600338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:03.600338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:03.600338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:03.600338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:03.600338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:03.600338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:03.600338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:03.600338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:03.600338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:03.601197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:03.601197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:03.601197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:03.601197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:03.601197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:03.601197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:03.601197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:03.601197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:03.601197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:03.601197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:03.601197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:39:03.601197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:03.601197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 192/400] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:39:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:03.610910 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72329546-334d-4d9d-a97f-3be6ebbddf88 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:03.612859 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fa3f0-bd31-44d1-97d2-1988fad69d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:03.613530 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fa3f0-bd31-44d1-97d2-1988fad69d5c None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:03.613804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fa3f0-bd31-44d1-97d2-1988fad69d5c None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:03.614069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fa3f0-bd31-44d1-97d2-1988fad69d5c None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:03.614764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fa3f0-bd31-44d1-97d2-1988fad69d5c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:03.615061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fa3f0-bd31-44d1-97d2-1988fad69d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:03.616491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548fa3f0-bd31-44d1-97d2-1988fad69d5c None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:03.637051 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 209/401] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:03.642394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:03.644185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fa3f0-bd31-44d1-97d2-1988fad69d5c None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:03.804180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72329546-334d-4d9d-a97f-3be6ebbddf88 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:03.846367 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f10df-a79e-4931-bdb4-a82eab781120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:03.847065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f10df-a79e-4931-bdb4-a82eab781120 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:03.847344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f10df-a79e-4931-bdb4-a82eab781120 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:03.847616 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f10df-a79e-4931-bdb4-a82eab781120 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:03.848343 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f10df-a79e-4931-bdb4-a82eab781120 None admin] RBAC: Adding query filter params (name=member) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:03.848646 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f10df-a79e-4931-bdb4-a82eab781120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:03.850205 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f10df-a79e-4931-bdb4-a82eab781120 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:03.861542 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 193/402] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:39:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:03.863048 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bab42-df1b-4606-b8fb-74669b9eaf21 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:03.863335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bab42-df1b-4606-b8fb-74669b9eaf21 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:03.863602 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bab42-df1b-4606-b8fb-74669b9eaf21 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:03.865442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 194/403] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:03.870331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bab42-df1b-4606-b8fb-74669b9eaf21 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:03.897847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fa3f0-bd31-44d1-97d2-1988fad69d5c None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:03.944811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a53e1-f821-4bc5-8ffa-7bd548ceb655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:03.946051 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a53e1-f821-4bc5-8ffa-7bd548ceb655 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:03.947089 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a53e1-f821-4bc5-8ffa-7bd548ceb655 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:03.947593 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a53e1-f821-4bc5-8ffa-7bd548ceb655 None admin] PATH_INFO: `/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:03.949617 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a53e1-f821-4bc5-8ffa-7bd548ceb655 None admin] RBAC: Authorizing `identity:get_group(group_id=ea734b61d1ec4605b8258b5a73c69d0e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:03.951668 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a53e1-f821-4bc5-8ffa-7bd548ceb655 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:03.953803 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 210/404] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 23:39:03 2022] GET /identity/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e => generated 226 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:03.955320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba9d53-8c30-4cbf-b5ad-ee39768fd2ff None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:03.955893 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba9d53-8c30-4cbf-b5ad-ee39768fd2ff None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:03.956389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba9d53-8c30-4cbf-b5ad-ee39768fd2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:03.964993 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:03.979217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-e2ba9d53-8c30-4cbf-b5ad-ee39768fd2ff None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:03.980458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-e2ba9d53-8c30-4cbf-b5ad-ee39768fd2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:04.004044 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:04.032695 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bab42-df1b-4606-b8fb-74669b9eaf21 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:04.073458 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df032fc-b28b-476e-9dba-f960ade69091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:04.073458 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df032fc-b28b-476e-9dba-f960ade69091 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:04.073458 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df032fc-b28b-476e-9dba-f960ade69091 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:04.073458 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df032fc-b28b-476e-9dba-f960ade69091 None admin] PATH_INFO: `/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:04.073866 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df032fc-b28b-476e-9dba-f960ade69091 None admin] RBAC: Authorizing `identity:get_group(group_id=ea734b61d1ec4605b8258b5a73c69d0e)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:04.074319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 211/405] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:04.074487 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df032fc-b28b-476e-9dba-f960ade69091 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:04.075569 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba9d53-8c30-4cbf-b5ad-ee39768fd2ff None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:04.076614 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 195/406] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 23:39:03 2022] GET /identity/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:04.086157 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df032fc-b28b-476e-9dba-f960ade69091 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:04.376124 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba9d53-8c30-4cbf-b5ad-ee39768fd2ff None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:04.408411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df032fc-b28b-476e-9dba-f960ade69091 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:04.461983 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3ffbf-538d-4ac8-bb17-81a4fbe22c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:04.463119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3ffbf-538d-4ac8-bb17-81a4fbe22c38 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:04.463295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b4bab-cd56-4daf-91dc-ebe582373af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:04.463607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3ffbf-538d-4ac8-bb17-81a4fbe22c38 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:04.464071 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3ffbf-538d-4ac8-bb17-81a4fbe22c38 None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:04.464421 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b4bab-cd56-4daf-91dc-ebe582373af5 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:04.464862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b4bab-cd56-4daf-91dc-ebe582373af5 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:04.465410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b4bab-cd56-4daf-91dc-ebe582373af5 None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:04.466264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3ffbf-538d-4ac8-bb17-81a4fbe22c38 None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:04.466981 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b4bab-cd56-4daf-91dc-ebe582373af5 None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:04.468624 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b4bab-cd56-4daf-91dc-ebe582373af5 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:04.468955 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3ffbf-538d-4ac8-bb17-81a4fbe22c38 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:04.470842 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 196/407] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:39:04 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:04.471848 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b4bab-cd56-4daf-91dc-ebe582373af5 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:04.478659 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 212/408] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:39:04 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:04.483519 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3ffbf-538d-4ac8-bb17-81a4fbe22c38 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:04.488051 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:04.489282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:04.628106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3ffbf-538d-4ac8-bb17-81a4fbe22c38 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:04.674718 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a128fc4-c4dd-4d76-87d0-94233fe99555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:04.676168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a128fc4-c4dd-4d76-87d0-94233fe99555 None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:04.676437 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b4bab-cd56-4daf-91dc-ebe582373af5 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:04.676848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a128fc4-c4dd-4d76-87d0-94233fe99555 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:04.677309 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a128fc4-c4dd-4d76-87d0-94233fe99555 None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e/groups/ea734b61d1ec4605b8258b5a73c69d0e/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:04.679914 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a128fc4-c4dd-4d76-87d0-94233fe99555 None admin] RBAC: Authorizing `identity:create_grant(project_id=a281171d594749e4986718444da08d9e, group_id=ea734b61d1ec4605b8258b5a73c69d0e, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:04.681777 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a128fc4-c4dd-4d76-87d0-94233fe99555 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:04.706678 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 213/409] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Sep 12 23:39:04 2022] PUT /identity/v3/projects/a281171d594749e4986718444da08d9e/groups/ea734b61d1ec4605b8258b5a73c69d0e/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:39:04.708707 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a128fc4-c4dd-4d76-87d0-94233fe99555 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:04.742044 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1311a8b-a5ec-486c-9282-9786bfc2a4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:04.743164 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1311a8b-a5ec-486c-9282-9786bfc2a4c9 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:04.744091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1311a8b-a5ec-486c-9282-9786bfc2a4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:04.744220 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1311a8b-a5ec-486c-9282-9786bfc2a4c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:04.765019 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1311a8b-a5ec-486c-9282-9786bfc2a4c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:04.776101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-a1311a8b-a5ec-486c-9282-9786bfc2a4c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:39:04.776101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:04.776101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:04.776101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:04.776101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:04.776101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:04.776101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:04.776101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:04.776101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:04.776101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:04.776101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:04.776101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:04.776101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:04.776101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:04.776101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:04.776101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:04.777074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:04.777074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:04.777074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:04.777074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:04.777074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:04.777074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:04.777074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:04.777074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:04.777074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:04.777074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:04.777074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:04.777074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:04.777074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:04.777074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:04.777074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:04.777074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:04.777928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:04.777928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:04.777928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:04.777928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:04.777928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:04.777928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:04.777928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:04.777928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:04.777928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:04.777928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:04.777928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:39:04.777928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:04.783842 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 197/410] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:39:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:04.789083 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1311a8b-a5ec-486c-9282-9786bfc2a4c9 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:04.796567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:04.854366 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a128fc4-c4dd-4d76-87d0-94233fe99555 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:04.900478 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10385d-3bef-4a4c-94ba-75248c39b888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:04.902530 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10385d-3bef-4a4c-94ba-75248c39b888 None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:04.903145 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10385d-3bef-4a4c-94ba-75248c39b888 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:04.903669 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10385d-3bef-4a4c-94ba-75248c39b888 None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e/groups/ea734b61d1ec4605b8258b5a73c69d0e/roles/e4d659212810456798a60c1902537d7d` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:04.907522 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10385d-3bef-4a4c-94ba-75248c39b888 None admin] RBAC: Authorizing `identity:create_grant(project_id=a281171d594749e4986718444da08d9e, group_id=ea734b61d1ec4605b8258b5a73c69d0e, role_id=e4d659212810456798a60c1902537d7d)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:04.909899 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10385d-3bef-4a4c-94ba-75248c39b888 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:04.930652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:04.955644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 214/411] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Sep 12 23:39:04 2022] PUT /identity/v3/projects/a281171d594749e4986718444da08d9e/groups/ea734b61d1ec4605b8258b5a73c69d0e/roles/e4d659212810456798a60c1902537d7d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:39:05.006967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1311a8b-a5ec-486c-9282-9786bfc2a4c9 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:05.077097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409ed69-3d5d-4c39-a06d-30edeef5fdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:05.078227 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409ed69-3d5d-4c39-a06d-30edeef5fdf3 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:05.078797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409ed69-3d5d-4c39-a06d-30edeef5fdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:05.079275 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409ed69-3d5d-4c39-a06d-30edeef5fdf3 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:05.080681 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409ed69-3d5d-4c39-a06d-30edeef5fdf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:05.083751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd535ec-e2a3-4c3c-b4a6-ecf7923f8c64 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:05.084235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd535ec-e2a3-4c3c-b4a6-ecf7923f8c64 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:05.084720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd535ec-e2a3-4c3c-b4a6-ecf7923f8c64 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:05.087381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 215/412] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:05.087913 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409ed69-3d5d-4c39-a06d-30edeef5fdf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:05.090785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409ed69-3d5d-4c39-a06d-30edeef5fdf3 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:05.093542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdca6f-510f-4ee7-8518-1a8918463d99 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:05.093832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdca6f-510f-4ee7-8518-1a8918463d99 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:05.094117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdca6f-510f-4ee7-8518-1a8918463d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:05.112656 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 198/413] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:39:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:05.117640 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-f6bdca6f-510f-4ee7-8518-1a8918463d99 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:05.118538 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409ed69-3d5d-4c39-a06d-30edeef5fdf3 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:05.118968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-f6bdca6f-510f-4ee7-8518-1a8918463d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:05.219620 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 216/414] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:39:05.312975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409ed69-3d5d-4c39-a06d-30edeef5fdf3 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:05.371421 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:05.378601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46463350-20b1-402a-906d-54338ee427c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:05.379331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46463350-20b1-402a-906d-54338ee427c7 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:05.379806 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46463350-20b1-402a-906d-54338ee427c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:05.380361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46463350-20b1-402a-906d-54338ee427c7 None admin] PATH_INFO: `/v3/groups/2370e2310846499c90886b53d5f1cdf5` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:05.382458 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46463350-20b1-402a-906d-54338ee427c7 None admin] RBAC: Authorizing `identity:get_group(group_id=2370e2310846499c90886b53d5f1cdf5)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:05.385182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46463350-20b1-402a-906d-54338ee427c7 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:05.390343 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 199/415] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 23:39:05 2022] GET /identity/v3/groups/2370e2310846499c90886b53d5f1cdf5 => generated 229 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:05.397864 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdca6f-510f-4ee7-8518-1a8918463d99 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:05.496524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:05.569630 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdca6f-510f-4ee7-8518-1a8918463d99 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:05.616887 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27986ac-a64d-408b-98c6-20df1e7ff200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:05.617583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27986ac-a64d-408b-98c6-20df1e7ff200 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:05.617869 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27986ac-a64d-408b-98c6-20df1e7ff200 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:05.618138 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27986ac-a64d-408b-98c6-20df1e7ff200 None admin] PATH_INFO: `/v3/projects/7f4013b4b7a749e88ad00a53390dd085` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:05.619326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27986ac-a64d-408b-98c6-20df1e7ff200 None admin] RBAC: Authorizing `identity:get_project(project_id=7f4013b4b7a749e88ad00a53390dd085)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:05.620853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27986ac-a64d-408b-98c6-20df1e7ff200 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:05.622974 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 217/416] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:39:05 2022] GET /identity/v3/projects/7f4013b4b7a749e88ad00a53390dd085 => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:05.635161 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46463350-20b1-402a-906d-54338ee427c7 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:05.645025 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27986ac-a64d-408b-98c6-20df1e7ff200 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:05.870041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46463350-20b1-402a-906d-54338ee427c7 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:05.907646 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27986ac-a64d-408b-98c6-20df1e7ff200 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:05.967001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030ed5f-d317-409b-834b-ffa4b22c1e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:05.970361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030ed5f-d317-409b-834b-ffa4b22c1e80 None admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:05.973453 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030ed5f-d317-409b-834b-ffa4b22c1e80 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:05.974249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030ed5f-d317-409b-834b-ffa4b22c1e80 None admin] PATH_INFO: `/v3/projects/7f4013b4b7a749e88ad00a53390dd085/groups/2370e2310846499c90886b53d5f1cdf5/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:05.985536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030ed5f-d317-409b-834b-ffa4b22c1e80 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f4013b4b7a749e88ad00a53390dd085, group_id=2370e2310846499c90886b53d5f1cdf5, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:05.985922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:05.989044 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030ed5f-d317-409b-834b-ffa4b22c1e80 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:06.036436 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 200/417] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Sep 12 23:39:05 2022] PUT /identity/v3/projects/7f4013b4b7a749e88ad00a53390dd085/groups/2370e2310846499c90886b53d5f1cdf5/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:39:06.043487 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313e7cf-db1a-4054-b20d-f596d15cee4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:06.044759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313e7cf-db1a-4054-b20d-f596d15cee4f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:06.048250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7015c8-a7f8-4e44-8613-b08bf7d0aa45 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:06.048848 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7015c8-a7f8-4e44-8613-b08bf7d0aa45 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:06.049367 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7015c8-a7f8-4e44-8613-b08bf7d0aa45 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:06.052077 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 201/418] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:06.052345 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313e7cf-db1a-4054-b20d-f596d15cee4f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:06.053043 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313e7cf-db1a-4054-b20d-f596d15cee4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:06.059309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119cf7f-0b58-4254-b8fb-6248925fb9f2 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:06.059970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119cf7f-0b58-4254-b8fb-6248925fb9f2 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:06.060438 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119cf7f-0b58-4254-b8fb-6248925fb9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:06.084810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313e7cf-db1a-4054-b20d-f596d15cee4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:06.096460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-f313e7cf-db1a-4054-b20d-f596d15cee4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:39:06.096460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:06.096460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:06.096460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:06.096460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:06.096460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:06.096460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:06.096460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:06.096460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:06.096460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:06.096460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:06.096460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:06.096460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:06.096460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:06.096460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:06.096460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:06.098182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:06.098182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:06.098182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:06.098182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:06.098182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:06.098182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:06.098182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:06.098182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:06.098182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:06.098182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:06.098182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:06.098182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:06.098182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:06.098182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:06.098182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:06.098182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:06.099651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:06.099651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:06.099651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:06.099651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:06.099651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:06.099651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:06.099651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:06.099651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:06.099651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:06.099651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:06.099651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:39:06.099651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:06.099651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 218/419] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:39:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:39:06.108432 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-2119cf7f-0b58-4254-b8fb-6248925fb9f2 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:06.109486 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-2119cf7f-0b58-4254-b8fb-6248925fb9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:06.110991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313e7cf-db1a-4054-b20d-f596d15cee4f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:06.286177 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:06.331246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 202/420] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:39:06.349738 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313e7cf-db1a-4054-b20d-f596d15cee4f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:06.454705 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2015dd1-f406-42c3-a198-04bdbcb3b1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:06.456357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2015dd1-f406-42c3-a198-04bdbcb3b1c8 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:06.457188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2015dd1-f406-42c3-a198-04bdbcb3b1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:06.457945 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2015dd1-f406-42c3-a198-04bdbcb3b1c8 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:06.459865 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2015dd1-f406-42c3-a198-04bdbcb3b1c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:06.460693 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2015dd1-f406-42c3-a198-04bdbcb3b1c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:06.463861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2015dd1-f406-42c3-a198-04bdbcb3b1c8 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:06.483224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 219/421] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:39:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:06.491784 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119cf7f-0b58-4254-b8fb-6248925fb9f2 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:06.656369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119cf7f-0b58-4254-b8fb-6248925fb9f2 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:06.708089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7dbf9-ef71-40f2-8598-8c4a2401afbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:06.708733 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7dbf9-ef71-40f2-8598-8c4a2401afbd None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:06.709010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7dbf9-ef71-40f2-8598-8c4a2401afbd None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:06.709286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7dbf9-ef71-40f2-8598-8c4a2401afbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:06.841880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:06.875524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2015dd1-f406-42c3-a198-04bdbcb3b1c8 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:06.901523 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7dbf9-ef71-40f2-8598-8c4a2401afbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:06.906088 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7dbf9-ef71-40f2-8598-8c4a2401afbd None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:07.009870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:07.096400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2015dd1-f406-42c3-a198-04bdbcb3b1c8 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:07.164139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52842427-9dc3-495c-a52e-4b61550290ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:07.164820 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52842427-9dc3-495c-a52e-4b61550290ed None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:07.165106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52842427-9dc3-495c-a52e-4b61550290ed None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:07.165409 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52842427-9dc3-495c-a52e-4b61550290ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:07.184049 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 203/422] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:39:07.192704 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52842427-9dc3-495c-a52e-4b61550290ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:07.198183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-52842427-9dc3-495c-a52e-4b61550290ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:39:07.198183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:07.198183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:07.198183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:07.198183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:07.198183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:07.198183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:07.198183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:07.198183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:07.198183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:07.198183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:07.198183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:07.198183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:07.198183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:07.198183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:07.198183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:07.200475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:07.200475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:07.200475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:07.200475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:07.200475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:07.200475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:07.200475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:07.200475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:07.200475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:07.200475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:07.200475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:07.200475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:07.200475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:07.200475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:07.200475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:07.200475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:07.202048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:07.202048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:07.202048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:07.202048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:07.202048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:07.202048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:07.202048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:07.202048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:07.202048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:07.202048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:07.202048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:39:07.202048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:07.202048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 220/423] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:39:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:39:07.205781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7dbf9-ef71-40f2-8598-8c4a2401afbd None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:07.218119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52842427-9dc3-495c-a52e-4b61550290ed None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:07.398422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:07.410947 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7dbf9-ef71-40f2-8598-8c4a2401afbd None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:07.461774 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52842427-9dc3-495c-a52e-4b61550290ed None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:07.462075 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637c4d2-a6a2-4521-92d6-3dd9124fdbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:07.462748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637c4d2-a6a2-4521-92d6-3dd9124fdbce None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:07.463032 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637c4d2-a6a2-4521-92d6-3dd9124fdbce None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:07.463306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637c4d2-a6a2-4521-92d6-3dd9124fdbce None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:07.464542 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637c4d2-a6a2-4521-92d6-3dd9124fdbce None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:07.466059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637c4d2-a6a2-4521-92d6-3dd9124fdbce None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:07.468597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 204/424] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:39:07 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:07.478448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637c4d2-a6a2-4521-92d6-3dd9124fdbce None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:07.497765 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:07.529932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cb0bf-71ee-4555-859a-55123e681a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:07.531380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cb0bf-71ee-4555-859a-55123e681a6c None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:07.532340 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cb0bf-71ee-4555-859a-55123e681a6c None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:07.533063 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cb0bf-71ee-4555-859a-55123e681a6c None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:07.534435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cb0bf-71ee-4555-859a-55123e681a6c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:07.535135 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cb0bf-71ee-4555-859a-55123e681a6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:07.537838 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0cb0bf-71ee-4555-859a-55123e681a6c None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:07.555391 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 221/425] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:07.563210 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cb0bf-71ee-4555-859a-55123e681a6c None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:07.676675 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637c4d2-a6a2-4521-92d6-3dd9124fdbce None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:07.716300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a201c1-79c1-4f74-b461-48e4d717d110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:07.716944 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a201c1-79c1-4f74-b461-48e4d717d110 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:07.717223 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a201c1-79c1-4f74-b461-48e4d717d110 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:07.717533 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a201c1-79c1-4f74-b461-48e4d717d110 None admin] PATH_INFO: `/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:07.718873 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a201c1-79c1-4f74-b461-48e4d717d110 None admin] RBAC: Authorizing `identity:get_group(group_id=ea734b61d1ec4605b8258b5a73c69d0e)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:07.720467 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a201c1-79c1-4f74-b461-48e4d717d110 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:07.722320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 205/426] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 23:39:07 2022] GET /identity/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:07.723508 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e60707-b745-4673-922e-5d79712c5955 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:07.723777 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e60707-b745-4673-922e-5d79712c5955 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:07.724040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e60707-b745-4673-922e-5d79712c5955 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:07.730316 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 206/427] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:07.731155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e60707-b745-4673-922e-5d79712c5955 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:07.759427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0cb0bf-71ee-4555-859a-55123e681a6c None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:07.761891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:07.821091 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a3654-85aa-4742-b494-ce529d8aa017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:07.822453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a3654-85aa-4742-b494-ce529d8aa017 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:07.823086 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a3654-85aa-4742-b494-ce529d8aa017 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:07.823689 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a3654-85aa-4742-b494-ce529d8aa017 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:07.849447 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e60707-b745-4673-922e-5d79712c5955 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:07.882752 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:07.891717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c95403-1a1f-486a-a921-7bb0d08a3fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:07.892617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c95403-1a1f-486a-a921-7bb0d08a3fe1 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:07.893057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c95403-1a1f-486a-a921-7bb0d08a3fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:07.893554 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c95403-1a1f-486a-a921-7bb0d08a3fe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:07.894461 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c95403-1a1f-486a-a921-7bb0d08a3fe1 None admin] RBAC: Adding query filter params (group.id=ea734b61d1ec4605b8258b5a73c69d0e, role.id=c770dd0c3bc540c3a48b0393d192b17a, scope.project.id=ab929f16a6c349389781c723ea5d01a3) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:07.894915 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c95403-1a1f-486a-a921-7bb0d08a3fe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:07.896579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c95403-1a1f-486a-a921-7bb0d08a3fe1 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:07.903973 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 207/428] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 23:39:07 2022] GET /identity/v3/role_assignments?group.id=ea734b61d1ec4605b8258b5a73c69d0e&scope.project.id=ab929f16a6c349389781c723ea5d01a3&role.id=c770dd0c3bc540c3a48b0393d192b17a => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:07.910685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776232d-8067-485f-91c8-54482c9f82ac None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:07.911239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776232d-8067-485f-91c8-54482c9f82ac None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:07.911655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776232d-8067-485f-91c8-54482c9f82ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:07.945532 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-1776232d-8067-485f-91c8-54482c9f82ac None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:07.947030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-1776232d-8067-485f-91c8-54482c9f82ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:07.973919 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a3654-85aa-4742-b494-ce529d8aa017 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:07.983003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a3654-85aa-4742-b494-ce529d8aa017 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:08.064339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 208/429] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:08.213421 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 222/430] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:39:08.219358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776232d-8067-485f-91c8-54482c9f82ac None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:08.246386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:08.343823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776232d-8067-485f-91c8-54482c9f82ac None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:08.386831 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b767c-6e01-42c3-b9d4-0c518510974e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:08.387484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b767c-6e01-42c3-b9d4-0c518510974e None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:08.387762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b767c-6e01-42c3-b9d4-0c518510974e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:08.388086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b767c-6e01-42c3-b9d4-0c518510974e None admin] PATH_INFO: `/v3/projects/ab929f16a6c349389781c723ea5d01a3` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:08.389255 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b767c-6e01-42c3-b9d4-0c518510974e None admin] RBAC: Authorizing `identity:get_project(project_id=ab929f16a6c349389781c723ea5d01a3)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:08.390767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b767c-6e01-42c3-b9d4-0c518510974e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:08.392854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 209/431] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:39:08 2022] GET /identity/v3/projects/ab929f16a6c349389781c723ea5d01a3 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:08.401399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a3654-85aa-4742-b494-ce529d8aa017 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:08.427010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b767c-6e01-42c3-b9d4-0c518510974e None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:08.525510 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:08.582130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a3654-85aa-4742-b494-ce529d8aa017 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:08.594084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:08.621804 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b767c-6e01-42c3-b9d4-0c518510974e None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:08.632352 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a465b-df40-4a25-8262-a02fa30cb265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:08.633017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a465b-df40-4a25-8262-a02fa30cb265 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:08.633300 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a465b-df40-4a25-8262-a02fa30cb265 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:08.633612 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a465b-df40-4a25-8262-a02fa30cb265 None admin] PATH_INFO: `/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:08.634808 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a465b-df40-4a25-8262-a02fa30cb265 None admin] RBAC: Authorizing `identity:get_group(group_id=ea734b61d1ec4605b8258b5a73c69d0e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:08.636296 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a465b-df40-4a25-8262-a02fa30cb265 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:08.641380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 223/432] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 23:39:08 2022] GET /identity/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:08.641380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ce726-8cc1-43b4-a462-987e944e03fa None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:08.641380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ce726-8cc1-43b4-a462-987e944e03fa None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:08.641380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ce726-8cc1-43b4-a462-987e944e03fa None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:08.641714 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 224/433] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:08.646517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ce726-8cc1-43b4-a462-987e944e03fa None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:08.690397 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6469f-cd0d-4cf8-9e11-0cb4764960e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:08.691610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6469f-cd0d-4cf8-9e11-0cb4764960e4 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:08.692134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6469f-cd0d-4cf8-9e11-0cb4764960e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:08.692572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6469f-cd0d-4cf8-9e11-0cb4764960e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:08.709243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6469f-cd0d-4cf8-9e11-0cb4764960e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:08.716059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-02a6469f-cd0d-4cf8-9e11-0cb4764960e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:39:08.716059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:08.716059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:08.716059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:08.716059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:08.716059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:08.716059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:08.716059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:08.716059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:08.716059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:08.716059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:08.716059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:08.716059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:08.716059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:08.716059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:08.716059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:08.717008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:08.717008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:08.717008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:08.717008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:08.717008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:08.717008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:08.717008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:08.717008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:08.717008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:08.717008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:08.717008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:08.717008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:08.717008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:08.717008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:08.717008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:08.717008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:08.717864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:08.717864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:08.717864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:08.717864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:08.717864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:08.717864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:08.717864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:08.717864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:08.717864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:08.717864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:08.717864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 12 23:39:08.717864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:08.717864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 210/434] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:39:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:08.717864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436c26f-e5da-4528-82c1-dbeb74df50fd None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:08.718587 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436c26f-e5da-4528-82c1-dbeb74df50fd None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:08.718587 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436c26f-e5da-4528-82c1-dbeb74df50fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:08.739581 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-5436c26f-e5da-4528-82c1-dbeb74df50fd None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:08.740794 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5436c26f-e5da-4528-82c1-dbeb74df50fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:08.799439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ce726-8cc1-43b4-a462-987e944e03fa None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:08.826127 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 211/435] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:08.827121 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436c26f-e5da-4528-82c1-dbeb74df50fd None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:08.839157 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:08.846255 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acf335-fbae-4830-a2a0-1ffcc6b86a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:08.847302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acf335-fbae-4830-a2a0-1ffcc6b86a80 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:08.847898 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acf335-fbae-4830-a2a0-1ffcc6b86a80 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:08.848360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acf335-fbae-4830-a2a0-1ffcc6b86a80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:08.849286 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37acf335-fbae-4830-a2a0-1ffcc6b86a80 None admin] RBAC: Adding query filter params (group.id=ea734b61d1ec4605b8258b5a73c69d0e, role.id=e4d659212810456798a60c1902537d7d, scope.project.id=ab929f16a6c349389781c723ea5d01a3) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:08.849817 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37acf335-fbae-4830-a2a0-1ffcc6b86a80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:08.851484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37acf335-fbae-4830-a2a0-1ffcc6b86a80 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:08.858535 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 225/436] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 23:39:08 2022] GET /identity/v3/role_assignments?group.id=ea734b61d1ec4605b8258b5a73c69d0e&scope.project.id=ab929f16a6c349389781c723ea5d01a3&role.id=e4d659212810456798a60c1902537d7d => generated 611 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:08.933794 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:08.958630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436c26f-e5da-4528-82c1-dbeb74df50fd None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:08.999116 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd02cc-5fda-4de7-acc6-e9aacc7a5849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:08.999763 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd02cc-5fda-4de7-acc6-e9aacc7a5849 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:09.000033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd02cc-5fda-4de7-acc6-e9aacc7a5849 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:09.000303 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd02cc-5fda-4de7-acc6-e9aacc7a5849 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:09.001093 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd02cc-5fda-4de7-acc6-e9aacc7a5849 None admin] RBAC: Adding query filter params (name=member) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:09.001432 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd02cc-5fda-4de7-acc6-e9aacc7a5849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:09.002922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd02cc-5fda-4de7-acc6-e9aacc7a5849 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:09.015872 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 212/437] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:39:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:09.022570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acf335-fbae-4830-a2a0-1ffcc6b86a80 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:09.140472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acf335-fbae-4830-a2a0-1ffcc6b86a80 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:09.177829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb800d-929e-4869-bd28-b581338845ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:09.178468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb800d-929e-4869-bd28-b581338845ad None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:09.178813 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb800d-929e-4869-bd28-b581338845ad None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:09.179096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb800d-929e-4869-bd28-b581338845ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:09.239416 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd02cc-5fda-4de7-acc6-e9aacc7a5849 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:09.256114 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:09.272100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb800d-929e-4869-bd28-b581338845ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:09.274132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb800d-929e-4869-bd28-b581338845ad None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:09.424435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 226/438] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:39:09.425878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb800d-929e-4869-bd28-b581338845ad None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:09.443913 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd02cc-5fda-4de7-acc6-e9aacc7a5849 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:09.507211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67404065-b3d3-4d51-807c-c9cec346f1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:09.507861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67404065-b3d3-4d51-807c-c9cec346f1f1 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:09.508132 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67404065-b3d3-4d51-807c-c9cec346f1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:09.508405 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67404065-b3d3-4d51-807c-c9cec346f1f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:09.519584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:09.521932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67404065-b3d3-4d51-807c-c9cec346f1f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:09.528185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-67404065-b3d3-4d51-807c-c9cec346f1f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:39:09.528185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:09.528185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:09.528185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:09.528185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:09.528185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:09.528185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:09.528185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:09.528185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:09.528185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:09.528185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:09.528185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:09.528185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:09.528185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:09.528185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:09.528185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:09.529221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:09.529221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:09.529221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:09.529221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:09.529221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:09.529221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:09.529221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:09.529221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:09.529221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:09.529221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:09.529221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:09.529221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:09.529221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:09.529221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:09.529221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:09.529221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:09.530054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:09.530054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:09.530054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:09.530054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:09.530054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:09.530054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:09.530054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:09.530054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:09.530054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:09.530054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:09.530054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:39:09.530054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:09.535759 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 213/439] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:39:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:09.536797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67404065-b3d3-4d51-807c-c9cec346f1f1 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:09.550519 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:09.559325 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb800d-929e-4869-bd28-b581338845ad None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:09.598500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22944a67-b5e2-4d17-9726-50eafe2ffa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:09.599493 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22944a67-b5e2-4d17-9726-50eafe2ffa19 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:09.599940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22944a67-b5e2-4d17-9726-50eafe2ffa19 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:09.600381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22944a67-b5e2-4d17-9726-50eafe2ffa19 None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:09.602202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22944a67-b5e2-4d17-9726-50eafe2ffa19 None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:09.604669 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22944a67-b5e2-4d17-9726-50eafe2ffa19 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:09.607477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 227/440] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:39:09 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:09.609090 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d57b4-1a20-4c71-aa26-ecc7f4b69e52 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:09.609578 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d57b4-1a20-4c71-aa26-ecc7f4b69e52 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:09.610143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d57b4-1a20-4c71-aa26-ecc7f4b69e52 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:09.613483 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 228/441] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:09.614625 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d57b4-1a20-4c71-aa26-ecc7f4b69e52 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:09.667728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67404065-b3d3-4d51-807c-c9cec346f1f1 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:09.709383 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c6b8e-c548-460a-ae1a-eb909032d940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:09.710117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c6b8e-c548-460a-ae1a-eb909032d940 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:09.710437 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c6b8e-c548-460a-ae1a-eb909032d940 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:09.710750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c6b8e-c548-460a-ae1a-eb909032d940 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:09.711509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c6b8e-c548-460a-ae1a-eb909032d940 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:09.711864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c6b8e-c548-460a-ae1a-eb909032d940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:09.713411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c6b8e-c548-460a-ae1a-eb909032d940 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:09.724158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 214/442] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:09.725843 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dae25-a846-482a-9d98-2522568d870b None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:09.726118 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dae25-a846-482a-9d98-2522568d870b None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:09.726391 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dae25-a846-482a-9d98-2522568d870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:09.748653 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-566dae25-a846-482a-9d98-2522568d870b None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:09.750037 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-566dae25-a846-482a-9d98-2522568d870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:09.769840 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d57b4-1a20-4c71-aa26-ecc7f4b69e52 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:09.817242 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:09.824149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d3011-3a25-4c68-a998-6ece900a9f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:09.824917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d3011-3a25-4c68-a998-6ece900a9f17 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:09.825368 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d3011-3a25-4c68-a998-6ece900a9f17 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:09.825743 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d3011-3a25-4c68-a998-6ece900a9f17 None admin] PATH_INFO: `/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:09.827203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d3011-3a25-4c68-a998-6ece900a9f17 None admin] RBAC: Authorizing `identity:get_group(group_id=ea734b61d1ec4605b8258b5a73c69d0e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:09.828914 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d3011-3a25-4c68-a998-6ece900a9f17 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:09.830941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 229/443] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 23:39:09 2022] GET /identity/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:09.832104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d3011-3a25-4c68-a998-6ece900a9f17 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:09.841490 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 215/444] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:09.841490 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dae25-a846-482a-9d98-2522568d870b None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:09.878306 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:09.997108 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d3011-3a25-4c68-a998-6ece900a9f17 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:10.010546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dae25-a846-482a-9d98-2522568d870b None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:10.055071 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c6359-24c4-49b2-8141-b8c7d37a3d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:10.055955 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c6359-24c4-49b2-8141-b8c7d37a3d4f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:10.056405 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c6359-24c4-49b2-8141-b8c7d37a3d4f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:10.056839 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c6359-24c4-49b2-8141-b8c7d37a3d4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:10.067997 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0aea0d-d7fd-40d7-9dad-67c7918ba1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:10.068925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0aea0d-d7fd-40d7-9dad-67c7918ba1ec None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:10.069368 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0aea0d-d7fd-40d7-9dad-67c7918ba1ec None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:10.069818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0aea0d-d7fd-40d7-9dad-67c7918ba1ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:10.071048 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0aea0d-d7fd-40d7-9dad-67c7918ba1ec None admin] RBAC: Adding query filter params (group.id=ea734b61d1ec4605b8258b5a73c69d0e, role.id=c770dd0c3bc540c3a48b0393d192b17a, scope.project.id=a281171d594749e4986718444da08d9e) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:10.071544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0aea0d-d7fd-40d7-9dad-67c7918ba1ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:10.073720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0aea0d-d7fd-40d7-9dad-67c7918ba1ec None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:10.085392 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 216/445] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 23:39:09 2022] GET /identity/v3/role_assignments?group.id=ea734b61d1ec4605b8258b5a73c69d0e&scope.project.id=a281171d594749e4986718444da08d9e&role.id=c770dd0c3bc540c3a48b0393d192b17a => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:10.103870 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0aea0d-d7fd-40d7-9dad-67c7918ba1ec None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:10.196246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:10.202864 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c6359-24c4-49b2-8141-b8c7d37a3d4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:10.205579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c6359-24c4-49b2-8141-b8c7d37a3d4f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:10.266279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:10.284704 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0aea0d-d7fd-40d7-9dad-67c7918ba1ec None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:10.343806 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d031490-2105-425f-bf5b-d99543ebc315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:10.344514 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d031490-2105-425f-bf5b-d99543ebc315 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:10.344787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d031490-2105-425f-bf5b-d99543ebc315 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:10.345072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d031490-2105-425f-bf5b-d99543ebc315 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:10.361856 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d031490-2105-425f-bf5b-d99543ebc315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:10.370256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-8d031490-2105-425f-bf5b-d99543ebc315 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:39:10.370256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:10.370256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:10.370256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:10.370256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:10.370256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:10.370256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:10.370256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:10.370256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:10.370256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:10.370256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:10.370256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:10.370256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:10.370256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:10.370256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:10.370256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:10.371244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:10.371244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:10.371244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:10.371244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:10.371244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:10.371244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:10.371244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:10.371244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:10.371244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:10.371244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:10.371244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:10.371244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:10.371244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:10.371244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:10.371244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:10.371244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:10.372015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:10.372015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:10.372015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:10.372015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:10.372015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:10.372015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:10.372015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:10.372015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:10.372015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:10.372015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:10.372015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:39:10.372015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:10.376098 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 217/446] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:39:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:39:10.380838 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d031490-2105-425f-bf5b-d99543ebc315 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:10.397592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 230/447] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:39:10.408279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c6359-24c4-49b2-8141-b8c7d37a3d4f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:10.547225 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d031490-2105-425f-bf5b-d99543ebc315 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:10.548598 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c6359-24c4-49b2-8141-b8c7d37a3d4f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:10.566518 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:10.582923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:10.588770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d6ca3-7982-4127-b96d-01d3325b2f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:10.589452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d6ca3-7982-4127-b96d-01d3325b2f18 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:10.589622 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d6ca3-7982-4127-b96d-01d3325b2f18 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:10.589897 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d6ca3-7982-4127-b96d-01d3325b2f18 None admin] PATH_INFO: `/v3/projects/a281171d594749e4986718444da08d9e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:10.591033 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d6ca3-7982-4127-b96d-01d3325b2f18 None admin] RBAC: Authorizing `identity:get_project(project_id=a281171d594749e4986718444da08d9e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:10.592487 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d6ca3-7982-4127-b96d-01d3325b2f18 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:10.592781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be38f2-6c6d-4298-8d6b-685278295eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:10.593407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be38f2-6c6d-4298-8d6b-685278295eb3 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:10.593992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be38f2-6c6d-4298-8d6b-685278295eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:10.593992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be38f2-6c6d-4298-8d6b-685278295eb3 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:10.594697 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 231/448] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:39:10 2022] GET /identity/v3/projects/a281171d594749e4986718444da08d9e => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:10.594921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be38f2-6c6d-4298-8d6b-685278295eb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:10.595022 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be38f2-6c6d-4298-8d6b-685278295eb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:10.596360 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be38f2-6c6d-4298-8d6b-685278295eb3 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:10.600705 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d6ca3-7982-4127-b96d-01d3325b2f18 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:10.607054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 218/449] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:39:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:10.612938 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be38f2-6c6d-4298-8d6b-685278295eb3 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:10.720166 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d6ca3-7982-4127-b96d-01d3325b2f18 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:10.720678 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be38f2-6c6d-4298-8d6b-685278295eb3 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:10.760463 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae092b5-be61-43e8-9aef-529b3b5feb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:10.761107 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae092b5-be61-43e8-9aef-529b3b5feb74 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:10.761410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae092b5-be61-43e8-9aef-529b3b5feb74 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:10.761685 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae092b5-be61-43e8-9aef-529b3b5feb74 None admin] PATH_INFO: `/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:10.762273 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914b8d1-3829-44d1-b2a5-96dcc9f25d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:10.762808 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae092b5-be61-43e8-9aef-529b3b5feb74 None admin] RBAC: Authorizing `identity:get_group(group_id=ea734b61d1ec4605b8258b5a73c69d0e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:10.762908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914b8d1-3829-44d1-b2a5-96dcc9f25d88 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:10.763148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914b8d1-3829-44d1-b2a5-96dcc9f25d88 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:10.763412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914b8d1-3829-44d1-b2a5-96dcc9f25d88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:10.764260 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae092b5-be61-43e8-9aef-529b3b5feb74 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:10.766107 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 232/450] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 23:39:10 2022] GET /identity/v3/groups/ea734b61d1ec4605b8258b5a73c69d0e => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:10.771984 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae092b5-be61-43e8-9aef-529b3b5feb74 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:10.812184 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:10.836810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914b8d1-3829-44d1-b2a5-96dcc9f25d88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:10.838327 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914b8d1-3829-44d1-b2a5-96dcc9f25d88 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:10.843926 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:10.883667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae092b5-be61-43e8-9aef-529b3b5feb74 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:10.920621 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7e7bd-b85b-49c1-b653-b37cbeeb2e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:10.921379 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7e7bd-b85b-49c1-b653-b37cbeeb2e53 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:10.921767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7e7bd-b85b-49c1-b653-b37cbeeb2e53 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:10.922203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7e7bd-b85b-49c1-b653-b37cbeeb2e53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:10.923198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7e7bd-b85b-49c1-b653-b37cbeeb2e53 None admin] RBAC: Adding query filter params (group.id=ea734b61d1ec4605b8258b5a73c69d0e, role.id=e4d659212810456798a60c1902537d7d, scope.project.id=a281171d594749e4986718444da08d9e) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:10.923755 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7e7bd-b85b-49c1-b653-b37cbeeb2e53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:10.925284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7e7bd-b85b-49c1-b653-b37cbeeb2e53 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:10.931600 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 233/451] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 23:39:10 2022] GET /identity/v3/role_assignments?group.id=ea734b61d1ec4605b8258b5a73c69d0e&scope.project.id=a281171d594749e4986718444da08d9e&role.id=e4d659212810456798a60c1902537d7d => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:10.965296 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 219/452] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 23:39:10.971720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7e7bd-b85b-49c1-b653-b37cbeeb2e53 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:11.098064 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7e7bd-b85b-49c1-b653-b37cbeeb2e53 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:11.135053 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:11.141978 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ede7e-42d6-4b8a-9b9c-69bdd2076a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:11.142623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ede7e-42d6-4b8a-9b9c-69bdd2076a4a None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:11.142896 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ede7e-42d6-4b8a-9b9c-69bdd2076a4a None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:11.143169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ede7e-42d6-4b8a-9b9c-69bdd2076a4a None admin] PATH_INFO: `/v3/projects/7f4013b4b7a749e88ad00a53390dd085` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:11.144442 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ede7e-42d6-4b8a-9b9c-69bdd2076a4a None admin] RBAC: Authorizing `identity:get_project(project_id=7f4013b4b7a749e88ad00a53390dd085)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:11.146063 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ede7e-42d6-4b8a-9b9c-69bdd2076a4a None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:11.148301 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 234/453] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:39:10 2022] GET /identity/v3/projects/7f4013b4b7a749e88ad00a53390dd085 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:11.155872 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914b8d1-3829-44d1-b2a5-96dcc9f25d88 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:11.256854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:11.289916 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914b8d1-3829-44d1-b2a5-96dcc9f25d88 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:11.337151 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0d1ee-aa62-4221-8bb3-86e4786d1608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:11.337912 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0d1ee-aa62-4221-8bb3-86e4786d1608 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:11.338241 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0d1ee-aa62-4221-8bb3-86e4786d1608 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:11.338573 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0d1ee-aa62-4221-8bb3-86e4786d1608 None admin] PATH_INFO: `/v3/groups/2370e2310846499c90886b53d5f1cdf5` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:11.339917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0d1ee-aa62-4221-8bb3-86e4786d1608 None admin] RBAC: Authorizing `identity:get_group(group_id=2370e2310846499c90886b53d5f1cdf5)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:11.341870 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0d1ee-aa62-4221-8bb3-86e4786d1608 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:11.344712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 220/454] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 12 23:39:11 2022] GET /identity/v3/groups/2370e2310846499c90886b53d5f1cdf5 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:11.351270 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ede7e-42d6-4b8a-9b9c-69bdd2076a4a None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:11.461611 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ede7e-42d6-4b8a-9b9c-69bdd2076a4a None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:11.496974 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ac14a-7443-4cad-9c80-4922350dc956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:11.497627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ac14a-7443-4cad-9c80-4922350dc956 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:11.497906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ac14a-7443-4cad-9c80-4922350dc956 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:11.498175 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ac14a-7443-4cad-9c80-4922350dc956 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:11.498898 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ac14a-7443-4cad-9c80-4922350dc956 None admin] RBAC: Adding query filter params (group.id=2370e2310846499c90886b53d5f1cdf5, role.id=440092230f024959a90e846ab29c6367, scope.project.id=7f4013b4b7a749e88ad00a53390dd085) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:11.499207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ac14a-7443-4cad-9c80-4922350dc956 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:11.500721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ac14a-7443-4cad-9c80-4922350dc956 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:11.507364 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 235/455] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 12 23:39:11 2022] GET /identity/v3/role_assignments?group.id=2370e2310846499c90886b53d5f1cdf5&scope.project.id=7f4013b4b7a749e88ad00a53390dd085&role.id=440092230f024959a90e846ab29c6367 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:14.255948 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774751a5-309a-4111-9c81-704d36e5ff9a None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:14.256914 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774751a5-309a-4111-9c81-704d36e5ff9a None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:14.256914 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774751a5-309a-4111-9c81-704d36e5ff9a None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:14.259388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 221/456] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:14.268264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0d6ef-d2a4-48d1-a88b-3d6d2a193386 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:14.269029 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0d6ef-d2a4-48d1-a88b-3d6d2a193386 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:14.269499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0d6ef-d2a4-48d1-a88b-3d6d2a193386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:14.309735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-12b0d6ef-d2a4-48d1-a88b-3d6d2a193386 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:14.311695 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-12b0d6ef-d2a4-48d1-a88b-3d6d2a193386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:14.432324 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:14.451208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 236/457] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:39:14.610255 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991e888-89aa-40ba-9c20-f0a9cdc559b8 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:14.611026 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991e888-89aa-40ba-9c20-f0a9cdc559b8 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:14.611688 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991e888-89aa-40ba-9c20-f0a9cdc559b8 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:14.614742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 222/458] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:14.620069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77e90e-92f9-4d83-85eb-d449773037c9 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:14.620355 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77e90e-92f9-4d83-85eb-d449773037c9 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:14.620629 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77e90e-92f9-4d83-85eb-d449773037c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:14.650931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-3a77e90e-92f9-4d83-85eb-d449773037c9 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:14.652141 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3a77e90e-92f9-4d83-85eb-d449773037c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:14.751611 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 237/459] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:39:14.893236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991e888-89aa-40ba-9c20-f0a9cdc559b8 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:15.031384 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faada9b3-6906-4288-ac49-cdcc79bd2bee None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:15.032165 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faada9b3-6906-4288-ac49-cdcc79bd2bee None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:15.032650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faada9b3-6906-4288-ac49-cdcc79bd2bee None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:15.037645 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 238/460] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:15.044633 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692671b-fe22-405e-8cce-4be9d534f4a5 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:15.045310 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692671b-fe22-405e-8cce-4be9d534f4a5 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:15.045821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692671b-fe22-405e-8cce-4be9d534f4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:15.102400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-e692671b-fe22-405e-8cce-4be9d534f4a5 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:15.107384 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-e692671b-fe22-405e-8cce-4be9d534f4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:15.141385 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991e888-89aa-40ba-9c20-f0a9cdc559b8 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:15.179965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf59781-fe28-48b2-a18a-923b4ed4e89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:15.180948 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf59781-fe28-48b2-a18a-923b4ed4e89a None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:15.181484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf59781-fe28-48b2-a18a-923b4ed4e89a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:15.181949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf59781-fe28-48b2-a18a-923b4ed4e89a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:15.194580 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf59781-fe28-48b2-a18a-923b4ed4e89a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:15.195189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 239/461] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:15.196352 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692671b-fe22-405e-8cce-4be9d534f4a5 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:15.196726 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf59781-fe28-48b2-a18a-923b4ed4e89a None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:15.205297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:15.215263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-acf59781-fe28-48b2-a18a-923b4ed4e89a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:15.215263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:15.215263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:15.215263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:15.215263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:15.215263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:15.215263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:15.215263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:15.215263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:15.215263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:15.215263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:15.215263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:15.215263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:15.215263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:15.215263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:15.215263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:15.216501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:15.216501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:15.216501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:15.216501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:15.216501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:15.216501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:15.216501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:15.216501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:15.216501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:15.216501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:15.216501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:15.216501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:15.216501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:15.216501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:15.216501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:15.216501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:15.216501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:15.217426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:15.217426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:15.217426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:15.217686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 223/462] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:15.229724 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf59781-fe28-48b2-a18a-923b4ed4e89a None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:15.276209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:15.341968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692671b-fe22-405e-8cce-4be9d534f4a5 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:15.420151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cda8c-5154-4291-b9ed-0b288911f8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:15.420813 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cda8c-5154-4291-b9ed-0b288911f8f0 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:15.421088 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cda8c-5154-4291-b9ed-0b288911f8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:15.421379 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cda8c-5154-4291-b9ed-0b288911f8f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:15.445910 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cda8c-5154-4291-b9ed-0b288911f8f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:15.449555 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cda8c-5154-4291-b9ed-0b288911f8f0 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:15.454867 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf59781-fe28-48b2-a18a-923b4ed4e89a None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:15.483036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-aa9cda8c-5154-4291-b9ed-0b288911f8f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:15.483036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:15.483036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:15.483036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:15.483036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:15.483036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:15.483036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:15.483036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:15.483036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:15.483036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:15.483036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:15.483036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:15.483036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:15.483036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:15.483036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:15.483036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:15.484161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:15.484161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:15.484161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:15.484161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:15.484161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:15.484161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:15.484161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:15.484161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:15.484161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:15.484161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:15.484161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:15.484161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:15.484161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:15.484161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:15.484161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:15.484161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:15.484161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:15.485081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:15.485081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:15.485081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:15.486765 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 240/463] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:15.493374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cda8c-5154-4291-b9ed-0b288911f8f0 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:15.541436 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cb6bb-be77-4cd5-a4c6-cab9b895af05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:15.542606 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cb6bb-be77-4cd5-a4c6-cab9b895af05 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:15.543308 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cb6bb-be77-4cd5-a4c6-cab9b895af05 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:15.545044 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cb6bb-be77-4cd5-a4c6-cab9b895af05 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:15.546079 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cb6bb-be77-4cd5-a4c6-cab9b895af05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:15.547956 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cb6bb-be77-4cd5-a4c6-cab9b895af05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:15.550623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cb6bb-be77-4cd5-a4c6-cab9b895af05 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:15.589332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 224/464] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:15.597986 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cb6bb-be77-4cd5-a4c6-cab9b895af05 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:15.678566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:15.726571 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cb6bb-be77-4cd5-a4c6-cab9b895af05 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:15.742549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cda8c-5154-4291-b9ed-0b288911f8f0 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:15.763742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:15.773044 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65823f4-9d41-450e-96b7-2ddecf1b8cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:15.774044 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65823f4-9d41-450e-96b7-2ddecf1b8cd7 None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:15.774512 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65823f4-9d41-450e-96b7-2ddecf1b8cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:15.774963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65823f4-9d41-450e-96b7-2ddecf1b8cd7 None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:15.775823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65823f4-9d41-450e-96b7-2ddecf1b8cd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:15.777378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65823f4-9d41-450e-96b7-2ddecf1b8cd7 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:15.806818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 225/465] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:39:15 2022] POST /identity/v3/users => generated 246 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:39:15.808124 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65823f4-9d41-450e-96b7-2ddecf1b8cd7 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:15.846030 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2a8af-6f99-41f0-8f81-30da4b953c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:15.846999 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2a8af-6f99-41f0-8f81-30da4b953c01 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:15.847489 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2a8af-6f99-41f0-8f81-30da4b953c01 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:15.849093 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2a8af-6f99-41f0-8f81-30da4b953c01 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:15.850526 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2a8af-6f99-41f0-8f81-30da4b953c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:15.851263 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2a8af-6f99-41f0-8f81-30da4b953c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:15.854135 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2a8af-6f99-41f0-8f81-30da4b953c01 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:15.886396 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 241/466] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:15.894304 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2a8af-6f99-41f0-8f81-30da4b953c01 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:16.042462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2a8af-6f99-41f0-8f81-30da4b953c01 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:16.080576 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65823f4-9d41-450e-96b7-2ddecf1b8cd7 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:16.083264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558795a-40ca-4493-a76b-12039f67abd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:16.084179 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558795a-40ca-4493-a76b-12039f67abd7 None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:16.084630 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558795a-40ca-4493-a76b-12039f67abd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:16.085051 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558795a-40ca-4493-a76b-12039f67abd7 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:16.085906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558795a-40ca-4493-a76b-12039f67abd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:16.087666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558795a-40ca-4493-a76b-12039f67abd7 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:16.097857 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:16.130142 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 242/467] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:39:15 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:39:16.131792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a87f5-fa78-41e9-8d7a-9558067bc083 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:16.132076 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a87f5-fa78-41e9-8d7a-9558067bc083 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:16.132349 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a87f5-fa78-41e9-8d7a-9558067bc083 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:16.140558 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 243/468] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:16.142177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306b679-cb7b-4aec-abe0-bdb81585482a None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:16.142448 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306b679-cb7b-4aec-abe0-bdb81585482a None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:16.142725 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306b679-cb7b-4aec-abe0-bdb81585482a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:16.148060 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bef32-e2dc-4b30-9ca6-130758066d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:16.148740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bef32-e2dc-4b30-9ca6-130758066d1d None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:16.149022 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bef32-e2dc-4b30-9ca6-130758066d1d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:16.149291 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bef32-e2dc-4b30-9ca6-130758066d1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:16.169577 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bef32-e2dc-4b30-9ca6-130758066d1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:16.173063 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bef32-e2dc-4b30-9ca6-130758066d1d None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:16.185222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-c306b679-cb7b-4aec-abe0-bdb81585482a None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:16.187910 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c306b679-cb7b-4aec-abe0-bdb81585482a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:16.193691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-999bef32-e2dc-4b30-9ca6-130758066d1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:16.193691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:16.193691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:16.193691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:16.193691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:16.193691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:16.193691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:16.193691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:16.193691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:16.193691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:16.193691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:16.193691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:16.193691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:16.193691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:16.193691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:16.193691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:16.194669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:16.194669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:16.194669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:16.194669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:16.194669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:16.194669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:16.194669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:16.194669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:16.194669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:16.194669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:16.194669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:16.194669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:16.194669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:16.194669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:16.194669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:16.194669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:16.194669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:16.195517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:16.195517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:16.195517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:16.197936 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 226/469] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:16.215488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bef32-e2dc-4b30-9ca6-130758066d1d None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:16.235609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:16.321326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 244/470] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:16.433682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bef32-e2dc-4b30-9ca6-130758066d1d None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:16.493777 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c75f18-5962-4905-8cd6-b742aababc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:16.494883 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c75f18-5962-4905-8cd6-b742aababc5e None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:16.495286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c75f18-5962-4905-8cd6-b742aababc5e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:16.495756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c75f18-5962-4905-8cd6-b742aababc5e None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:16.496750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c75f18-5962-4905-8cd6-b742aababc5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:16.497405 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c75f18-5962-4905-8cd6-b742aababc5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:16.499969 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c75f18-5962-4905-8cd6-b742aababc5e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:16.526944 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 227/471] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:16.534511 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306b679-cb7b-4aec-abe0-bdb81585482a None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:16.603973 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bf925-e7e9-457d-b56a-a3d19c27904f None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:16.604376 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bf925-e7e9-457d-b56a-a3d19c27904f None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:16.604839 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bf925-e7e9-457d-b56a-a3d19c27904f None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:16.607705 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 228/472] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:16.614632 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65f073-9df5-4817-94cf-1f22228f5cc3 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:16.615495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65f073-9df5-4817-94cf-1f22228f5cc3 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:16.616235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65f073-9df5-4817-94cf-1f22228f5cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:16.667337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-da65f073-9df5-4817-94cf-1f22228f5cc3 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:16.677380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-da65f073-9df5-4817-94cf-1f22228f5cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:16.737787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:16.746987 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306b679-cb7b-4aec-abe0-bdb81585482a None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:16.815111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 229/473] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:16.816985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65f073-9df5-4817-94cf-1f22228f5cc3 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:16.832216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eac71a-024e-43a8-8d4a-de29a03244e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:16.838136 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eac71a-024e-43a8-8d4a-de29a03244e6 None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:16.838632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eac71a-024e-43a8-8d4a-de29a03244e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:16.839120 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eac71a-024e-43a8-8d4a-de29a03244e6 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:16.840442 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eac71a-024e-43a8-8d4a-de29a03244e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:16.847749 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eac71a-024e-43a8-8d4a-de29a03244e6 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:16.921138 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 245/474] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:39:16 2022] POST /identity/v3/users => generated 248 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:39:17.067734 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65f073-9df5-4817-94cf-1f22228f5cc3 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:17.101904 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eac71a-024e-43a8-8d4a-de29a03244e6 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:17.133141 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:17.140457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeefc45-9135-48b1-9e91-41c2ef6b94e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:17.141744 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeefc45-9135-48b1-9e91-41c2ef6b94e7 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:17.142258 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeefc45-9135-48b1-9e91-41c2ef6b94e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:17.142724 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeefc45-9135-48b1-9e91-41c2ef6b94e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:17.163724 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeefc45-9135-48b1-9e91-41c2ef6b94e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:17.166420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeefc45-9135-48b1-9e91-41c2ef6b94e7 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:17.197297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-cbeefc45-9135-48b1-9e91-41c2ef6b94e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:17.197297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:17.197297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:17.197297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:17.197297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:17.197297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:17.197297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:17.197297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:17.197297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:17.197297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:17.197297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:17.197297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:17.197297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:17.197297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:17.197297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:17.197297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:17.198836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:17.198836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:17.198836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:17.198836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:17.198836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:17.198836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:17.198836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:17.198836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:17.198836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:17.198836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:17.198836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:17.198836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:17.198836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:17.198836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:17.198836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:17.198836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:17.198836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:17.202568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:17.202568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:17.202568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:17.202568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 230/475] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:17.209904 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeefc45-9135-48b1-9e91-41c2ef6b94e7 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:17.237258 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:17.325243 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eac71a-024e-43a8-8d4a-de29a03244e6 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:17.413548 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81960be-f8a0-4a7a-a193-51171c841acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:17.414207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81960be-f8a0-4a7a-a193-51171c841acc None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:17.414482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81960be-f8a0-4a7a-a193-51171c841acc None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:17.414752 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81960be-f8a0-4a7a-a193-51171c841acc None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:17.415459 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81960be-f8a0-4a7a-a193-51171c841acc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:17.416886 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81960be-f8a0-4a7a-a193-51171c841acc None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:17.427279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.sql.core [None req-c81960be-f8a0-4a7a-a193-51171c841acc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 12 23:39:17.427279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 12 23:39:17.427279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [parameters: {'id': 'ba69ee15412c48c28861b39e4ef44b0f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 12 23:39:17.427279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87847) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 12 23:39:17.446465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-c81960be-f8a0-4a7a-a193-51171c841acc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 12 23:39:17.446465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:17.446465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 23:39:17.446465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 23:39:17.446465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 23:39:17.446465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 23:39:17.446465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 23:39:17.446465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 23:39:17.446465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 23:39:17.446465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application conn.query(q) Sep 12 23:39:17.446465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 23:39:17.446465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 23:39:17.446465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 23:39:17.446465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application result.read() Sep 12 23:39:17.446465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return ref.to_dict() Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 23:39:17.448281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application next(self.gen) Sep 12 23:39:17.450956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 12 23:39:17.450956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application yield resource Sep 12 23:39:17.450956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 23:39:17.450956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application next(self.gen) Sep 12 23:39:17.450956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 12 23:39:17.450956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self.session.rollback() Sep 12 23:39:17.450956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 12 23:39:17.450956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self.force_reraise() Sep 12 23:39:17.450956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 12 23:39:17.450956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise self.value Sep 12 23:39:17.450956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 12 23:39:17.450956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 12 23:39:17.450956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 12 23:39:17.450956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application session.commit() Sep 12 23:39:17.450956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 12 23:39:17.450956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 12 23:39:17.450956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 12 23:39:17.455276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._prepare_impl() Sep 12 23:39:17.455276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 12 23:39:17.455276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self.session.flush() Sep 12 23:39:17.455276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 12 23:39:17.455276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._flush(objects) Sep 12 23:39:17.455276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 12 23:39:17.455276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 12 23:39:17.455276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 12 23:39:17.455276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application compat.raise_( Sep 12 23:39:17.455276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 23:39:17.455276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception Sep 12 23:39:17.455276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 12 23:39:17.455276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application flush_context.execute() Sep 12 23:39:17.455276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 12 23:39:17.455276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rec.execute(self) Sep 12 23:39:17.455276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 12 23:39:17.455276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 12 23:39:17.457906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 12 23:39:17.457906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 12 23:39:17.457906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 12 23:39:17.457906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 12 23:39:17.457906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 12 23:39:17.457906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 12 23:39:17.457906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 12 23:39:17.457906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 12 23:39:17.457906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 12 23:39:17.457906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 12 23:39:17.457906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 12 23:39:17.457906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 12 23:39:17.457906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 12 23:39:17.457906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 12 23:39:17.457906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 23:39:17.457906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception Sep 12 23:39:17.459879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 23:39:17.459879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 23:39:17.459879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 23:39:17.459879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 23:39:17.459879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 23:39:17.459879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 23:39:17.459879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 23:39:17.459879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application conn.query(q) Sep 12 23:39:17.459879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 23:39:17.459879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 23:39:17.459879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 23:39:17.459879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application result.read() Sep 12 23:39:17.459879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 23:39:17.459879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 23:39:17.459879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 23:39:17.459879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 23:39:17.466684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 23:39:17.466684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 23:39:17.466684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 23:39:17.466684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 23:39:17.466684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 12 23:39:17.466684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 12 23:39:17.466684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [parameters: {'id': 'ba69ee15412c48c28861b39e4ef44b0f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 12 23:39:17.466684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 12 23:39:17.466684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:17.466684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:39:17.466684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:17.466684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:17.466684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:17.466684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:17.466684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:17.466684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:17.469477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:17.469477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:17.469477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:17.469477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:17.469477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:17.469477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:17.469477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 12 23:39:17.469477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 12 23:39:17.469477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:17.469477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:17.469477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 12 23:39:17.469477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 12 23:39:17.469477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 12 23:39:17.469477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 12 23:39:17.469477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 12 23:39:17.469477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:17.472165 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 246/476] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Sep 12 23:39:17 2022] POST /identity/v3/roles => generated 144 bytes in 347 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:17.472371 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeefc45-9135-48b1-9e91-41c2ef6b94e7 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:17.472574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81960be-f8a0-4a7a-a193-51171c841acc None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:17.535550 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611bf54-ea86-4fae-a2e4-d65931f063e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:17.536738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611bf54-ea86-4fae-a2e4-d65931f063e3 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:17.537293 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611bf54-ea86-4fae-a2e4-d65931f063e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:17.537856 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611bf54-ea86-4fae-a2e4-d65931f063e3 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:17.539109 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611bf54-ea86-4fae-a2e4-d65931f063e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:17.539719 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611bf54-ea86-4fae-a2e4-d65931f063e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:17.542381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611bf54-ea86-4fae-a2e4-d65931f063e3 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:17.551198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:17.581143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 231/477] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:17.591015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611bf54-ea86-4fae-a2e4-d65931f063e3 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:17.596608 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81960be-f8a0-4a7a-a193-51171c841acc None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:17.638709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69e095-7282-41b4-9f38-5f1ff4042c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:17.639401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69e095-7282-41b4-9f38-5f1ff4042c3b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:17.639714 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69e095-7282-41b4-9f38-5f1ff4042c3b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:17.639983 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69e095-7282-41b4-9f38-5f1ff4042c3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:17.658026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69e095-7282-41b4-9f38-5f1ff4042c3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:17.659496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-1e69e095-7282-41b4-9f38-5f1ff4042c3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:39:17.659496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:17.659496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:17.659496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:17.659496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:17.659496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:17.659496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:17.659496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:17.659496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:17.659496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:17.659496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:17.659496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:17.659496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:17.659496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:17.659496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:17.659496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:17.661146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:17.661146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:17.661146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:17.661146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:17.661146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:17.661146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:17.661146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:17.661146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:17.661146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:17.661146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:17.661146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:17.661146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:17.661146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:17.661146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:17.661146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:17.661146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:17.662724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:17.662724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:17.662724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:17.662724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:17.662724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:17.662724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:17.662724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:17.662724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:17.662724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:17.662724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:17.662724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 12 23:39:17.662724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:17.662724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 247/478] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:39:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:17.667792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69e095-7282-41b4-9f38-5f1ff4042c3b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:17.763831 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:17.788335 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69e095-7282-41b4-9f38-5f1ff4042c3b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:17.823396 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:17.825195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611bf54-ea86-4fae-a2e4-d65931f063e3 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:17.831903 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8becd-2c1a-48a9-bb1f-267c112be2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:17.832836 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8becd-2c1a-48a9-bb1f-267c112be2a6 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:17.833265 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8becd-2c1a-48a9-bb1f-267c112be2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:17.833701 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8becd-2c1a-48a9-bb1f-267c112be2a6 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:17.834552 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8becd-2c1a-48a9-bb1f-267c112be2a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:17.835026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8becd-2c1a-48a9-bb1f-267c112be2a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:17.836640 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8becd-2c1a-48a9-bb1f-267c112be2a6 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:17.847679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 248/479] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:17.907696 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5642d4d-9671-48cb-b967-904bcce8cde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:17.908765 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5642d4d-9671-48cb-b967-904bcce8cde7 None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:17.909190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5642d4d-9671-48cb-b967-904bcce8cde7 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:17.909706 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5642d4d-9671-48cb-b967-904bcce8cde7 None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:17.910951 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5642d4d-9671-48cb-b967-904bcce8cde7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:17.913826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5642d4d-9671-48cb-b967-904bcce8cde7 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:17.969723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 232/480] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:39:17 2022] POST /identity/v3/users => generated 249 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:39:20.063373 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114552dd-fa2f-46c8-b9aa-034b703eeef4 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:20.063373 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114552dd-fa2f-46c8-b9aa-034b703eeef4 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:20.063373 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114552dd-fa2f-46c8-b9aa-034b703eeef4 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:20.064572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 249/481] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:20.073694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d98cad-4202-42f7-b80c-4ed990cd477c None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:20.074646 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d98cad-4202-42f7-b80c-4ed990cd477c None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:20.075110 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d98cad-4202-42f7-b80c-4ed990cd477c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:20.098330 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-35d98cad-4202-42f7-b80c-4ed990cd477c None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:20.099884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-35d98cad-4202-42f7-b80c-4ed990cd477c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:20.139582 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5f6f9-5d1b-4341-b229-264c5749990d None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:20.140006 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5f6f9-5d1b-4341-b229-264c5749990d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:20.140407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5f6f9-5d1b-4341-b229-264c5749990d None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:20.143434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 250/482] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:20.152871 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae20b2-d526-4b90-a934-caa59dceeffe None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:20.153359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae20b2-d526-4b90-a934-caa59dceeffe None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:20.154010 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae20b2-d526-4b90-a934-caa59dceeffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:20.185992 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-f9ae20b2-d526-4b90-a934-caa59dceeffe None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:20.188434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-f9ae20b2-d526-4b90-a934-caa59dceeffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:20.239719 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 233/483] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:20.356136 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 251/484] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:39:20.654588 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d98cad-4202-42f7-b80c-4ed990cd477c None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:20.772251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:20.832519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d98cad-4202-42f7-b80c-4ed990cd477c None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:20.877462 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc7d8e-adad-4f49-8701-ff8fcc28aa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:20.878093 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc7d8e-adad-4f49-8701-ff8fcc28aa35 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:20.878367 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc7d8e-adad-4f49-8701-ff8fcc28aa35 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:20.878631 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc7d8e-adad-4f49-8701-ff8fcc28aa35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:20.896903 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc7d8e-adad-4f49-8701-ff8fcc28aa35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:20.902406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-36bc7d8e-adad-4f49-8701-ff8fcc28aa35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:20.902406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:20.902406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:20.902406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:20.902406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:20.902406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:20.902406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:20.902406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:20.902406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:20.902406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:20.902406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:20.902406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:20.902406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:20.902406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:20.902406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:20.902406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:20.905780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:20.905780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:20.905780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:20.905780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:20.905780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:20.905780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:20.905780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:20.905780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:20.905780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:20.905780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:20.905780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:20.905780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:20.905780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:20.905780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:20.905780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:20.905780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:20.907344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:20.907344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:20.907344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:20.907344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:20.907344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:20.907344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:20.907344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:20.907344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:20.907344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:20.907344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:20.907344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:20.907344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:20.907344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 234/485] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:20.911180 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae20b2-d526-4b90-a934-caa59dceeffe None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:20.912522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc7d8e-adad-4f49-8701-ff8fcc28aa35 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:21.070316 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc7d8e-adad-4f49-8701-ff8fcc28aa35 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:21.074584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae20b2-d526-4b90-a934-caa59dceeffe None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:21.089279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:21.106960 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:21.116732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279f926-35fc-4cae-8996-f99fe7bb3f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:21.117693 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279f926-35fc-4cae-8996-f99fe7bb3f9b None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:21.118059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279f926-35fc-4cae-8996-f99fe7bb3f9b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:21.118494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279f926-35fc-4cae-8996-f99fe7bb3f9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:21.120743 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdbf54-5fa3-4726-b73c-2e0997b78278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:21.121393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdbf54-5fa3-4726-b73c-2e0997b78278 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:21.121672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdbf54-5fa3-4726-b73c-2e0997b78278 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:21.121934 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdbf54-5fa3-4726-b73c-2e0997b78278 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:21.122628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdbf54-5fa3-4726-b73c-2e0997b78278 None admin] RBAC: Adding query filter params (name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:21.122922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdbf54-5fa3-4726-b73c-2e0997b78278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:21.124318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdbf54-5fa3-4726-b73c-2e0997b78278 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:21.133888 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 252/486] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:39:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:21.134128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279f926-35fc-4cae-8996-f99fe7bb3f9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:21.139853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f83f8-4766-485e-a8de-086cdccc9209 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:21.140288 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f83f8-4766-485e-a8de-086cdccc9209 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:21.140701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-b279f926-35fc-4cae-8996-f99fe7bb3f9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:21.140701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:21.140701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:21.140701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:21.140701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:21.140701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:21.140701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:21.140701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:21.140701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:21.140701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:21.140701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:21.140701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:21.140701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:21.140701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:21.140701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:21.140701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:21.141762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:21.141762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:21.141762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:21.141762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:21.141762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:21.141762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:21.141762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:21.141762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:21.141762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:21.141762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:21.141762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:21.141762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:21.141762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:21.141762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:21.141762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:21.141762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:21.142535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:21.142535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:21.142535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:21.142535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:21.142535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:21.142535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:21.142535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:21.142535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:21.142535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:21.142535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:21.142535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:21.142535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:21.143117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f83f8-4766-485e-a8de-086cdccc9209 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:21.143193 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 235/487] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:21.143742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 253/488] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:21.145433 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f83f8-4766-485e-a8de-086cdccc9209 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:21.145576 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc4963-8437-4a21-95de-131e973586ac None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:21.148865 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc4963-8437-4a21-95de-131e973586ac None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:21.148865 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc4963-8437-4a21-95de-131e973586ac None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:21.148865 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 236/489] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:21.152069 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4140f6-6827-48ea-95d8-bb9f5373f1fe None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:21.152547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4140f6-6827-48ea-95d8-bb9f5373f1fe None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:21.153697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4140f6-6827-48ea-95d8-bb9f5373f1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:21.172809 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-1b4140f6-6827-48ea-95d8-bb9f5373f1fe None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:21.174000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-1b4140f6-6827-48ea-95d8-bb9f5373f1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:21.263921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 237/490] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:21.265295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4140f6-6827-48ea-95d8-bb9f5373f1fe None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:21.341982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f83f8-4766-485e-a8de-086cdccc9209 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:21.420737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4f276-d666-4e9d-8772-06b32823f5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:21.421824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4f276-d666-4e9d-8772-06b32823f5fc None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:21.422398 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4f276-d666-4e9d-8772-06b32823f5fc None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:21.422927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4f276-d666-4e9d-8772-06b32823f5fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:21.441854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4f276-d666-4e9d-8772-06b32823f5fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:21.445121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4f276-d666-4e9d-8772-06b32823f5fc None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:21.460336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4140f6-6827-48ea-95d8-bb9f5373f1fe None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:21.464828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:21.471446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-13b4f276-d666-4e9d-8772-06b32823f5fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:21.471446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:21.471446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:21.471446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:21.471446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:21.471446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:21.471446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:21.471446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:21.471446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:21.471446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:21.471446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:21.471446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:21.471446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:21.471446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:21.471446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:21.471446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:21.473154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:21.473154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:21.473154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:21.473154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:21.473154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:21.473154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:21.473154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:21.473154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:21.473154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:21.473154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:21.473154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:21.473154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:21.473154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:21.473154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:21.473154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:21.473154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:21.473154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:21.474753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:21.474753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:21.474753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:21.474753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 254/491] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:21.474753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ca02a-32da-4b38-9adb-8ca4d0620704 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:21.474753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ca02a-32da-4b38-9adb-8ca4d0620704 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:21.474753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ca02a-32da-4b38-9adb-8ca4d0620704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:21.506895 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-6b6ca02a-32da-4b38-9adb-8ca4d0620704 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:21.508725 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6b6ca02a-32da-4b38-9adb-8ca4d0620704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:21.519279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362d205-c044-407b-a4b4-d3907afecba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:21.520221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362d205-c044-407b-a4b4-d3907afecba7 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:21.520599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362d205-c044-407b-a4b4-d3907afecba7 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:21.521007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362d205-c044-407b-a4b4-d3907afecba7 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:21.521885 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362d205-c044-407b-a4b4-d3907afecba7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:21.522356 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362d205-c044-407b-a4b4-d3907afecba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:21.524170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362d205-c044-407b-a4b4-d3907afecba7 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:21.542746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 238/492] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:39:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:21.542746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705c246-60a1-4898-b1ce-104932759613 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:21.542746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705c246-60a1-4898-b1ce-104932759613 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:21.542746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705c246-60a1-4898-b1ce-104932759613 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:21.542746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 239/493] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:21.542746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705c246-60a1-4898-b1ce-104932759613 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:21.559189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:21.603653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 255/494] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:21.604318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ca02a-32da-4b38-9adb-8ca4d0620704 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:21.683112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705c246-60a1-4898-b1ce-104932759613 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:21.741420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ca02a-32da-4b38-9adb-8ca4d0620704 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:21.747447 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473afdd-ebbf-4083-bb51-6461bd771a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:21.748315 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473afdd-ebbf-4083-bb51-6461bd771a08 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:21.748710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473afdd-ebbf-4083-bb51-6461bd771a08 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:21.748980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473afdd-ebbf-4083-bb51-6461bd771a08 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:21.749840 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473afdd-ebbf-4083-bb51-6461bd771a08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:21.750141 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473afdd-ebbf-4083-bb51-6461bd771a08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:21.751764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473afdd-ebbf-4083-bb51-6461bd771a08 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:21.771944 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 240/495] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:21.774329 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bae300-592d-4cfa-8c76-d88817fa17a8 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:21.774823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bae300-592d-4cfa-8c76-d88817fa17a8 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:21.775299 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bae300-592d-4cfa-8c76-d88817fa17a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:21.790434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d302f-42dc-4b30-95e6-b70c2d07d055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:21.791307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d302f-42dc-4b30-95e6-b70c2d07d055 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:21.791705 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d302f-42dc-4b30-95e6-b70c2d07d055 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:21.792100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d302f-42dc-4b30-95e6-b70c2d07d055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:21.805773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d302f-42dc-4b30-95e6-b70c2d07d055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:21.807610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-a0bae300-592d-4cfa-8c76-d88817fa17a8 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:21.807792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d302f-42dc-4b30-95e6-b70c2d07d055 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:21.809751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a0bae300-592d-4cfa-8c76-d88817fa17a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:21.826628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-7a2d302f-42dc-4b30-95e6-b70c2d07d055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:21.826628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:21.826628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:21.826628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:21.826628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:21.826628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:21.826628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:21.826628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:21.826628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:21.826628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:21.826628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:21.826628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:21.826628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:21.826628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:21.826628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:21.826628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:21.828435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:21.828435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:21.828435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:21.828435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:21.828435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:21.828435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:21.828435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:21.828435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:21.828435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:21.828435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:21.828435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:21.828435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:21.828435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:21.828435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:21.828435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:21.828435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:21.828435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:21.830071 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:21.830071 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:21.830071 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:21.833793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 256/496] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:21.835980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d302f-42dc-4b30-95e6-b70c2d07d055 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:21.851582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:21.872683 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:21.919202 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 241/497] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:21.926488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bae300-592d-4cfa-8c76-d88817fa17a8 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:21.994232 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d302f-42dc-4b30-95e6-b70c2d07d055 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:22.038361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bae300-592d-4cfa-8c76-d88817fa17a8 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:22.038660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87942c31-29ec-42af-9fc9-b20debb277db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:22.039332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942c31-29ec-42af-9fc9-b20debb277db None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:22.039723 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942c31-29ec-42af-9fc9-b20debb277db None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:22.040170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87942c31-29ec-42af-9fc9-b20debb277db None admin] PATH_INFO: `/v3/roles/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:22.053917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87942c31-29ec-42af-9fc9-b20debb277db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:22.060438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-87942c31-29ec-42af-9fc9-b20debb277db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:22.060438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:22.060438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:22.060438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:22.060438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:22.060438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:22.060438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:22.060438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:22.060438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:22.060438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:22.060438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:22.060438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:22.060438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:22.060438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:22.060438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:22.060438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:22.061496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:22.061496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:22.061496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:22.061496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:22.061496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:22.061496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:22.061496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:22.061496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:22.061496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:22.061496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:22.061496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:22.061496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:22.061496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:22.061496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:22.061496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:22.061496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:22.062930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:22.062930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:22.062930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:22.062930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:22.062930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:22.062930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:22.062930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:22.062930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:22.062930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:22.062930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:22.062930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:22.062930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:22.062930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 257/498] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:22.064312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87942c31-29ec-42af-9fc9-b20debb277db None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:22.086178 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9ca04-b7b3-4242-9f1c-eb152db6b85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:22.087118 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9ca04-b7b3-4242-9f1c-eb152db6b85b None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:22.087539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9ca04-b7b3-4242-9f1c-eb152db6b85b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:22.087961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9ca04-b7b3-4242-9f1c-eb152db6b85b None admin] PATH_INFO: `/v3/users/glance` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:22.096458 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9ca04-b7b3-4242-9f1c-eb152db6b85b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:22.098700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9ca04-b7b3-4242-9f1c-eb152db6b85b None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:22.113922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-a5d9ca04-b7b3-4242-9f1c-eb152db6b85b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 12 23:39:22.113922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:22.113922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:22.113922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:22.113922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:22.113922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:22.113922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:22.113922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:22.113922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:22.113922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:22.113922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:22.113922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:22.113922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:22.113922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:22.113922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:22.113922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:22.114935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:22.115837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:22.115837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:22.115837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:22.115837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:22.115837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:22.115837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:22.115837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:22.115837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:22.115837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 12 23:39:22.115837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:22.119969 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 242/499] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:39:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:22.120679 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9ca04-b7b3-4242-9f1c-eb152db6b85b None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:22.140790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:22.179002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:22.206674 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87942c31-29ec-42af-9fc9-b20debb277db None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:22.259886 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9ca04-b7b3-4242-9f1c-eb152db6b85b None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:22.261162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd8716-bfa7-4321-8aae-1aac8947bc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:22.262144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd8716-bfa7-4321-8aae-1aac8947bc81 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:22.262588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd8716-bfa7-4321-8aae-1aac8947bc81 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:22.263022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd8716-bfa7-4321-8aae-1aac8947bc81 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:22.263930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd8716-bfa7-4321-8aae-1aac8947bc81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:22.264410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd8716-bfa7-4321-8aae-1aac8947bc81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:22.266858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd8716-bfa7-4321-8aae-1aac8947bc81 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:22.291390 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 258/500] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:22.291390 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd8716-bfa7-4321-8aae-1aac8947bc81 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:22.320195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79240d73-3d69-4dc0-8805-f14f4498f3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:22.321008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79240d73-3d69-4dc0-8805-f14f4498f3a2 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:22.321460 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79240d73-3d69-4dc0-8805-f14f4498f3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:22.321875 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79240d73-3d69-4dc0-8805-f14f4498f3a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:22.338309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79240d73-3d69-4dc0-8805-f14f4498f3a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:22.340662 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79240d73-3d69-4dc0-8805-f14f4498f3a2 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:22.359154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-79240d73-3d69-4dc0-8805-f14f4498f3a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:22.359154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:22.359154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:22.359154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:22.359154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:22.359154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:22.359154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:22.359154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:22.359154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:22.359154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:22.359154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:22.359154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:22.359154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:22.359154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:22.359154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:22.359154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:22.361012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:22.361012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:22.361012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:22.361012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:22.361012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:22.361012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:22.361012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:22.361012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:22.361012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:22.361012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:22.361012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:22.361012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:22.361012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:22.361012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:22.361012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:22.361012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:22.361012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:22.363192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:22.363192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:22.363192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:22.363192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 243/501] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:22.363192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79240d73-3d69-4dc0-8805-f14f4498f3a2 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:22.447883 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd8716-bfa7-4321-8aae-1aac8947bc81 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:22.459546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:22.487789 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b02860-70cb-43a7-84b1-b189d65a7301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:22.488413 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b02860-70cb-43a7-84b1-b189d65a7301 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:22.488689 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b02860-70cb-43a7-84b1-b189d65a7301 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:22.488958 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b02860-70cb-43a7-84b1-b189d65a7301 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:22.489679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b02860-70cb-43a7-84b1-b189d65a7301 None admin] RBAC: Adding query filter params (name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:22.489978 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b02860-70cb-43a7-84b1-b189d65a7301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:22.491359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b02860-70cb-43a7-84b1-b189d65a7301 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:22.507678 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 259/502] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:39:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:22.507678 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b02860-70cb-43a7-84b1-b189d65a7301 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:22.508084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79240d73-3d69-4dc0-8805-f14f4498f3a2 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:22.510030 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:22.542203 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d9046-5c17-445d-864a-6f3a53faf52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:22.542822 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d9046-5c17-445d-864a-6f3a53faf52f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:22.543096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d9046-5c17-445d-864a-6f3a53faf52f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:22.543366 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d9046-5c17-445d-864a-6f3a53faf52f None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:22.544102 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d9046-5c17-445d-864a-6f3a53faf52f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:22.544405 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d9046-5c17-445d-864a-6f3a53faf52f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:22.545896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d9046-5c17-445d-864a-6f3a53faf52f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:22.603462 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 244/503] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 12 23:39:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:22.603462 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d9046-5c17-445d-864a-6f3a53faf52f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:22.630720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b02860-70cb-43a7-84b1-b189d65a7301 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:22.668494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544be400-3b89-4588-9896-2ffbe8598b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:22.669294 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544be400-3b89-4588-9896-2ffbe8598b5e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:22.669777 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544be400-3b89-4588-9896-2ffbe8598b5e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:22.670218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544be400-3b89-4588-9896-2ffbe8598b5e None admin] PATH_INFO: `/v3/users/nova` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:22.679754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544be400-3b89-4588-9896-2ffbe8598b5e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:22.681510 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544be400-3b89-4588-9896-2ffbe8598b5e None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:22.697149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-544be400-3b89-4588-9896-2ffbe8598b5e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:39:22.697149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:22.697149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:22.697149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:22.697149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:22.697149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:22.697149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:22.697149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:22.697149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:22.697149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:22.697149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:22.697149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:22.697149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:22.697149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:22.697149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:22.697149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:22.698129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:22.698996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:22.698996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:22.698996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:22.698996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:22.698996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:22.698996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:22.698996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:22.698996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:22.698996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:39:22.698996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:22.699505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 260/504] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 23:39:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:22.700360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544be400-3b89-4588-9896-2ffbe8598b5e None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:22.735755 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d9046-5c17-445d-864a-6f3a53faf52f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:22.769979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:22.780616 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8d79c-4405-429f-bd7d-4f37043236d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:22.781453 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8d79c-4405-429f-bd7d-4f37043236d2 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:22.781865 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8d79c-4405-429f-bd7d-4f37043236d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:22.782251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8d79c-4405-429f-bd7d-4f37043236d2 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:22.783053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8d79c-4405-429f-bd7d-4f37043236d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:22.783538 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8d79c-4405-429f-bd7d-4f37043236d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:22.783705 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:22.785520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8d79c-4405-429f-bd7d-4f37043236d2 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:22.798962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 245/505] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:22.799830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8d79c-4405-429f-bd7d-4f37043236d2 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:22.827440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544be400-3b89-4588-9896-2ffbe8598b5e None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:22.866122 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771694b-f9cf-4be9-b222-48621f7a1df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:22.866777 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771694b-f9cf-4be9-b222-48621f7a1df9 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:22.867054 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771694b-f9cf-4be9-b222-48621f7a1df9 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:22.867318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771694b-f9cf-4be9-b222-48621f7a1df9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:22.880172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771694b-f9cf-4be9-b222-48621f7a1df9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:22.885754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-7771694b-f9cf-4be9-b222-48621f7a1df9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:22.885754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:22.885754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:22.885754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:22.885754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:22.885754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:22.885754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:22.885754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:22.885754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:22.885754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:22.885754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:22.885754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:22.885754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:22.885754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:22.885754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:22.885754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:22.887810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:22.887810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:22.887810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:22.887810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:22.887810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:22.887810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:22.887810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:22.887810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:22.887810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:22.887810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:22.887810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:22.887810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:22.887810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:22.887810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:22.887810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:22.887810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:22.889333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:22.889333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:22.889333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:22.889333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:22.889333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:22.889333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:22.889333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:22.889333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:22.889333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:22.889333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:22.889333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:22.889333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:22.889333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 261/506] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:22.889333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771694b-f9cf-4be9-b222-48621f7a1df9 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:22.939727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8d79c-4405-429f-bd7d-4f37043236d2 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:22.993583 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f92597-8797-4461-87cf-91d776c65f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:22.994391 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f92597-8797-4461-87cf-91d776c65f0b None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:22.994782 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f92597-8797-4461-87cf-91d776c65f0b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:22.995158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f92597-8797-4461-87cf-91d776c65f0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:23.003250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771694b-f9cf-4be9-b222-48621f7a1df9 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:23.007699 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f92597-8797-4461-87cf-91d776c65f0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:23.009174 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f92597-8797-4461-87cf-91d776c65f0b None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:23.030006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-e4f92597-8797-4461-87cf-91d776c65f0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:23.030006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:23.030006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:23.030006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:23.030006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:23.030006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:23.030006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:23.030006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:23.030006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:23.030006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:23.030006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:23.030006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:23.030006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:23.030006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:23.030006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:23.030006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:23.030950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:23.030950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:23.030950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:23.030950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:23.030950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:23.030950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:23.030950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:23.030950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:23.030950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:23.030950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:23.030950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:23.030950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:23.030950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:23.030950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:23.030950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:23.030950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:23.030950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:23.031857 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:23.031857 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:23.031857 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:23.032444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 246/507] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:23.033510 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f92597-8797-4461-87cf-91d776c65f0b None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:23.037245 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:23.056267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb1f44-010d-44ec-9ae8-e494fabc5736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:23.056895 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb1f44-010d-44ec-9ae8-e494fabc5736 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:23.057169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb1f44-010d-44ec-9ae8-e494fabc5736 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:23.057483 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb1f44-010d-44ec-9ae8-e494fabc5736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:23.082139 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:23.148605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb1f44-010d-44ec-9ae8-e494fabc5736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:23.151080 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb1f44-010d-44ec-9ae8-e494fabc5736 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:23.158976 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f92597-8797-4461-87cf-91d776c65f0b None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:23.211179 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f1d30-6c13-474e-a74b-64f1c7519109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:23.212130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f1d30-6c13-474e-a74b-64f1c7519109 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:23.212418 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f1d30-6c13-474e-a74b-64f1c7519109 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:23.212693 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f1d30-6c13-474e-a74b-64f1c7519109 None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:23.213644 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f1d30-6c13-474e-a74b-64f1c7519109 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:23.213951 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f1d30-6c13-474e-a74b-64f1c7519109 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:23.215435 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f1d30-6c13-474e-a74b-64f1c7519109 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:23.238027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 247/508] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 23:39:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:23.238027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f1d30-6c13-474e-a74b-64f1c7519109 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:23.293807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 262/509] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:39:23.295138 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb1f44-010d-44ec-9ae8-e494fabc5736 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:23.321163 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:23.361943 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:23.374316 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f1d30-6c13-474e-a74b-64f1c7519109 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:23.410700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb1f44-010d-44ec-9ae8-e494fabc5736 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:23.433764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c000ba-62b0-47ad-8fc2-0b0e75ae4aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:23.434493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c000ba-62b0-47ad-8fc2-0b0e75ae4aaa None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:23.434773 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c000ba-62b0-47ad-8fc2-0b0e75ae4aaa None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:23.435141 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c000ba-62b0-47ad-8fc2-0b0e75ae4aaa None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:23.435847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c000ba-62b0-47ad-8fc2-0b0e75ae4aaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:23.438016 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c000ba-62b0-47ad-8fc2-0b0e75ae4aaa None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:23.457805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29169933-6810-4b06-a639-7779f4e9d831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:23.458854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29169933-6810-4b06-a639-7779f4e9d831 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:23.459317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29169933-6810-4b06-a639-7779f4e9d831 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:23.459805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29169933-6810-4b06-a639-7779f4e9d831 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:23.460886 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29169933-6810-4b06-a639-7779f4e9d831 None admin] RBAC: Adding query filter params (name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:23.461471 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29169933-6810-4b06-a639-7779f4e9d831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:23.463154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 248/510] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:39:23 2022] POST /identity/v3/users => generated 247 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:39:23.464044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29169933-6810-4b06-a639-7779f4e9d831 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:23.464527 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c000ba-62b0-47ad-8fc2-0b0e75ae4aaa None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:23.486273 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 263/511] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:39:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:23.486273 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29169933-6810-4b06-a639-7779f4e9d831 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:23.600385 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c000ba-62b0-47ad-8fc2-0b0e75ae4aaa None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:23.621292 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:23.646864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4023c44-ede5-4469-ad94-2166c73edad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:23.647513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4023c44-ede5-4469-ad94-2166c73edad0 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:23.647799 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4023c44-ede5-4469-ad94-2166c73edad0 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:23.648071 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4023c44-ede5-4469-ad94-2166c73edad0 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:23.648756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4023c44-ede5-4469-ad94-2166c73edad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:23.649064 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4023c44-ede5-4469-ad94-2166c73edad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:23.649400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29169933-6810-4b06-a639-7779f4e9d831 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:23.650596 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4023c44-ede5-4469-ad94-2166c73edad0 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:23.666604 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 249/512] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:23.667491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4023c44-ede5-4469-ad94-2166c73edad0 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:23.697200 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:23.716244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5e399-b2fc-40e3-9abe-5af7e4ae650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:23.717381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5e399-b2fc-40e3-9abe-5af7e4ae650a None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:23.717582 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5e399-b2fc-40e3-9abe-5af7e4ae650a None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:23.717727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5e399-b2fc-40e3-9abe-5af7e4ae650a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:23.820352 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5e399-b2fc-40e3-9abe-5af7e4ae650a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:23.823259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4023c44-ede5-4469-ad94-2166c73edad0 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:23.823412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5e399-b2fc-40e3-9abe-5af7e4ae650a None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:23.869021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db7e8f-03d0-4136-8a9a-18312d14a9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:23.870335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db7e8f-03d0-4136-8a9a-18312d14a9bb None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:23.870492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db7e8f-03d0-4136-8a9a-18312d14a9bb None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:23.870906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db7e8f-03d0-4136-8a9a-18312d14a9bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:23.885629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db7e8f-03d0-4136-8a9a-18312d14a9bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:23.887897 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db7e8f-03d0-4136-8a9a-18312d14a9bb None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:23.908176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-b8db7e8f-03d0-4136-8a9a-18312d14a9bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:23.908176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:23.908176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:23.908176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:23.908176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:23.908176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:23.908176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:23.908176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:23.908176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:23.908176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:23.908176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:23.908176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:23.908176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:23.908176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:23.908176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:23.908176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:23.909226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:23.909226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:23.909226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:23.909226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:23.909226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:23.909226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:23.909226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:23.909226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:23.909226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:23.909226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:23.909226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:23.909226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:23.909226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:23.909226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:23.909226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:23.909226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:23.909226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:23.910477 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:23.910477 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:23.910477 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:23.910477 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 250/513] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:23.910685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db7e8f-03d0-4136-8a9a-18312d14a9bb None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:23.933848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:23.957698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 264/514] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:39:23.957698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5e399-b2fc-40e3-9abe-5af7e4ae650a None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:23.982989 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:24.040850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db7e8f-03d0-4136-8a9a-18312d14a9bb None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:24.087935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56ba01-b6e0-4840-a630-85ce8373acad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:24.088990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56ba01-b6e0-4840-a630-85ce8373acad None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:24.089506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56ba01-b6e0-4840-a630-85ce8373acad None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:24.090134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56ba01-b6e0-4840-a630-85ce8373acad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:24.100943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5e399-b2fc-40e3-9abe-5af7e4ae650a None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:24.103229 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56ba01-b6e0-4840-a630-85ce8373acad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:24.105549 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56ba01-b6e0-4840-a630-85ce8373acad None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:24.122236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-5e56ba01-b6e0-4840-a630-85ce8373acad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:24.122236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:24.122236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:24.122236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:24.122236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:24.122236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:24.122236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:24.122236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:24.122236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:24.122236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:24.122236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:24.122236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:24.122236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:24.122236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:24.122236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:24.122236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:24.124080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:24.124080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:24.124080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:24.124080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:24.124080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:24.124080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:24.124080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:24.124080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:24.124080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:24.124080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:24.124080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:24.124080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:24.124080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:24.124080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:24.124080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:24.124080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:24.124080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:24.125683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:24.125683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:24.125683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:24.125683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 251/515] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:24.125683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56ba01-b6e0-4840-a630-85ce8373acad None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:24.167649 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36628cc-d411-4cc0-b721-66519013aff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:24.168711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36628cc-d411-4cc0-b721-66519013aff1 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:24.169204 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36628cc-d411-4cc0-b721-66519013aff1 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:24.169700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36628cc-d411-4cc0-b721-66519013aff1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:24.182627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36628cc-d411-4cc0-b721-66519013aff1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:24.184777 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36628cc-d411-4cc0-b721-66519013aff1 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:24.200737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-b36628cc-d411-4cc0-b721-66519013aff1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 23:39:24.200737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:24.200737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:24.200737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:24.200737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:24.200737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:24.200737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:24.200737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:24.200737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:24.200737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:24.200737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:24.200737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:24.200737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:24.200737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:24.200737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:24.200737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:24.202531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:24.204237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:24.204237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:24.204237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:24.204237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:24.204237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:24.204237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:24.204237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:24.204237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:24.204237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 23:39:24.204237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:24.204237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 265/516] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:39:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:24.204237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36628cc-d411-4cc0-b721-66519013aff1 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:24.270761 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56ba01-b6e0-4840-a630-85ce8373acad None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:24.279796 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:24.296677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:24.328830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8c846-e7cf-4fa9-a395-88ee098f6514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:24.329855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8c846-e7cf-4fa9-a395-88ee098f6514 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:24.330356 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8c846-e7cf-4fa9-a395-88ee098f6514 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:24.331069 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8c846-e7cf-4fa9-a395-88ee098f6514 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:24.331918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8c846-e7cf-4fa9-a395-88ee098f6514 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:24.332818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8c846-e7cf-4fa9-a395-88ee098f6514 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:24.334463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8c846-e7cf-4fa9-a395-88ee098f6514 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:24.347762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 252/517] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:24.348980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8c846-e7cf-4fa9-a395-88ee098f6514 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:24.365793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36628cc-d411-4cc0-b721-66519013aff1 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:24.428015 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cc43c-d8db-4ea6-8ab9-c37f01280472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:24.429054 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cc43c-d8db-4ea6-8ab9-c37f01280472 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:24.429522 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cc43c-d8db-4ea6-8ab9-c37f01280472 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:24.429932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cc43c-d8db-4ea6-8ab9-c37f01280472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:24.448974 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cc43c-d8db-4ea6-8ab9-c37f01280472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:24.451923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cc43c-d8db-4ea6-8ab9-c37f01280472 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:24.468148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-905cc43c-d8db-4ea6-8ab9-c37f01280472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:24.468148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:24.468148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:24.468148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:24.468148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:24.468148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:24.468148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:24.468148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:24.468148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:24.468148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:24.468148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:24.468148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:24.468148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:24.468148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:24.468148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:24.468148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:24.469564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:24.469564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:24.469564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:24.469564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:24.469564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:24.469564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:24.469564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:24.469564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:24.469564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:24.469564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:24.469564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:24.469564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:24.469564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:24.469564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:24.469564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:24.469564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:24.469564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:24.471963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:24.471963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:24.471963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:24.471963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 266/518] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:24.471963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cc43c-d8db-4ea6-8ab9-c37f01280472 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:24.519616 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8c846-e7cf-4fa9-a395-88ee098f6514 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:24.565358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95d3b0-a43a-44e7-9f6f-4ed323a73dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:24.566095 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95d3b0-a43a-44e7-9f6f-4ed323a73dd4 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:24.566440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95d3b0-a43a-44e7-9f6f-4ed323a73dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:24.566783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95d3b0-a43a-44e7-9f6f-4ed323a73dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:24.567510 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95d3b0-a43a-44e7-9f6f-4ed323a73dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:24.567878 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95d3b0-a43a-44e7-9f6f-4ed323a73dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:24.569365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95d3b0-a43a-44e7-9f6f-4ed323a73dd4 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:24.592208 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 253/519] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:24.592208 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95d3b0-a43a-44e7-9f6f-4ed323a73dd4 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:24.606344 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:24.617244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cc43c-d8db-4ea6-8ab9-c37f01280472 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:24.638086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:24.680953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656f441-5c37-4392-ac88-11ac7e3a43f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:24.682216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656f441-5c37-4392-ac88-11ac7e3a43f0 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:24.682707 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656f441-5c37-4392-ac88-11ac7e3a43f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:24.683106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656f441-5c37-4392-ac88-11ac7e3a43f0 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:24.684482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656f441-5c37-4392-ac88-11ac7e3a43f0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:24.685039 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656f441-5c37-4392-ac88-11ac7e3a43f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:24.688385 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656f441-5c37-4392-ac88-11ac7e3a43f0 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:24.714359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95d3b0-a43a-44e7-9f6f-4ed323a73dd4 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:24.741167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 267/520] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 12 23:39:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:24.742077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656f441-5c37-4392-ac88-11ac7e3a43f0 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:24.757587 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab6841-1570-44f5-8e69-7d294d89db27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:24.758230 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab6841-1570-44f5-8e69-7d294d89db27 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:24.758509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab6841-1570-44f5-8e69-7d294d89db27 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:24.758776 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab6841-1570-44f5-8e69-7d294d89db27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:24.766103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab6841-1570-44f5-8e69-7d294d89db27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:24.767566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab6841-1570-44f5-8e69-7d294d89db27 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:24.781167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-feab6841-1570-44f5-8e69-7d294d89db27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:24.781167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:24.781167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:24.781167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:24.781167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:24.781167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:24.781167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:24.781167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:24.781167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:24.781167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:24.781167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:24.781167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:24.781167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:24.781167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:24.781167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:24.783388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:24.783388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:24.783388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:24.783388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:24.783388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:24.783388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:24.783388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:24.783388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:24.783388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:24.783388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:24.783388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:24.783388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:24.783388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:24.783388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:24.783388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:24.783388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:24.783388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:24.784659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:24.784659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:24.784659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:24.784659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:24.784659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:24.784659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:24.784659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:24.784659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:24.787113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 254/521] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:24.788017 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab6841-1570-44f5-8e69-7d294d89db27 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:24.871615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656f441-5c37-4392-ac88-11ac7e3a43f0 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:24.910498 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:24.913661 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eea31-569f-4b85-9664-6ced439fe754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:24.914294 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eea31-569f-4b85-9664-6ced439fe754 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:24.914568 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eea31-569f-4b85-9664-6ced439fe754 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:24.915202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eea31-569f-4b85-9664-6ced439fe754 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:24.915865 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0eea31-569f-4b85-9664-6ced439fe754 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:24.916166 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0eea31-569f-4b85-9664-6ced439fe754 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:24.917571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0eea31-569f-4b85-9664-6ced439fe754 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:24.917805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab6841-1570-44f5-8e69-7d294d89db27 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:24.931133 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 268/522] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:24.931941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eea31-569f-4b85-9664-6ced439fe754 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:24.951013 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:24.965684 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce00d7-b926-4ff5-bc26-1243cef0ce87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:24.966345 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce00d7-b926-4ff5-bc26-1243cef0ce87 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:24.966780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce00d7-b926-4ff5-bc26-1243cef0ce87 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:24.966993 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce00d7-b926-4ff5-bc26-1243cef0ce87 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:24.979277 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce00d7-b926-4ff5-bc26-1243cef0ce87 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:24.982487 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce00d7-b926-4ff5-bc26-1243cef0ce87 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:24.996434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-d8ce00d7-b926-4ff5-bc26-1243cef0ce87 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 23:39:24.996434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:24.996434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:24.996434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:24.996434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:24.996434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:24.996434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:24.996434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:24.996434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:24.996434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:24.996434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:24.996434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:24.996434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:24.996434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:24.996434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:24.996434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:24.997925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:24.999025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:24.999025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:24.999025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:24.999025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:24.999025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:24.999025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:24.999025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:24.999025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:24.999025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 23:39:24.999025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:24.999025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 255/523] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:24.999025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce00d7-b926-4ff5-bc26-1243cef0ce87 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:25.088166 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eea31-569f-4b85-9664-6ced439fe754 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:25.121239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce00d7-b926-4ff5-bc26-1243cef0ce87 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:25.133758 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc83f88-342c-4618-951a-17a3e32b7e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:25.134500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc83f88-342c-4618-951a-17a3e32b7e2f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:25.135274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc83f88-342c-4618-951a-17a3e32b7e2f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:25.135808 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc83f88-342c-4618-951a-17a3e32b7e2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:25.170531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800c3a3-dd52-4fab-9be2-8de2b40dbe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:25.171536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800c3a3-dd52-4fab-9be2-8de2b40dbe15 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:25.171910 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800c3a3-dd52-4fab-9be2-8de2b40dbe15 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:25.172433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800c3a3-dd52-4fab-9be2-8de2b40dbe15 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:25.173820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800c3a3-dd52-4fab-9be2-8de2b40dbe15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:25.174315 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800c3a3-dd52-4fab-9be2-8de2b40dbe15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:25.176938 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800c3a3-dd52-4fab-9be2-8de2b40dbe15 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:25.202266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 256/524] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:25.203034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800c3a3-dd52-4fab-9be2-8de2b40dbe15 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:25.224665 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc83f88-342c-4618-951a-17a3e32b7e2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:25.225453 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:25.226165 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc83f88-342c-4618-951a-17a3e32b7e2f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:25.244298 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:25.329814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800c3a3-dd52-4fab-9be2-8de2b40dbe15 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:25.372796 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 269/525] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:39:25.373660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc83f88-342c-4618-951a-17a3e32b7e2f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:25.383571 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab298693-e673-4b3f-9c00-9c9a4f085d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:25.384228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab298693-e673-4b3f-9c00-9c9a4f085d70 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:25.384501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab298693-e673-4b3f-9c00-9c9a4f085d70 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:25.384890 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab298693-e673-4b3f-9c00-9c9a4f085d70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:25.392902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab298693-e673-4b3f-9c00-9c9a4f085d70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:25.394608 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab298693-e673-4b3f-9c00-9c9a4f085d70 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:25.412621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-ab298693-e673-4b3f-9c00-9c9a4f085d70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:25.412621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:25.412621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:25.412621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:25.412621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:25.412621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:25.412621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:25.412621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:25.412621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:25.412621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:25.412621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:25.412621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:25.412621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:25.412621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:25.412621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:25.413891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:25.413891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:25.413891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:25.413891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:25.413891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:25.413891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:25.413891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:25.413891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:25.413891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:25.413891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:25.413891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:25.413891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:25.413891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:25.413891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:25.413891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:25.413891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:25.413891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:25.415452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:25.415452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:25.415452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:25.415452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:25.415452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:25.415452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:25.415452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:25.415452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:25.415452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 257/526] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:25.415452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab298693-e673-4b3f-9c00-9c9a4f085d70 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:25.524292 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc83f88-342c-4618-951a-17a3e32b7e2f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:25.534432 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:25.546133 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:25.564906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab298693-e673-4b3f-9c00-9c9a4f085d70 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:25.570748 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe0525-c48b-4f6c-b252-22d25745f09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:25.571506 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe0525-c48b-4f6c-b252-22d25745f09c None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:25.571877 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe0525-c48b-4f6c-b252-22d25745f09c None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:25.572247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe0525-c48b-4f6c-b252-22d25745f09c None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:25.573100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe0525-c48b-4f6c-b252-22d25745f09c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:25.573557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe0525-c48b-4f6c-b252-22d25745f09c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:25.575023 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe0525-c48b-4f6c-b252-22d25745f09c None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:25.606099 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 270/527] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Sep 12 23:39:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:25.606331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c6ce8-3d23-4efe-869b-468d2df9d5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:25.606331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c6ce8-3d23-4efe-869b-468d2df9d5bc None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:25.606331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c6ce8-3d23-4efe-869b-468d2df9d5bc None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:25.606554 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe0525-c48b-4f6c-b252-22d25745f09c None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:25.606623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c6ce8-3d23-4efe-869b-468d2df9d5bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:25.606623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c6ce8-3d23-4efe-869b-468d2df9d5bc None admin] RBAC: Adding query filter params (role.id=8cf7b72483b94512b497317ab1d11192, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=9d21a0c72223417d92e3d8b30ef6bc3e) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:25.606623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c6ce8-3d23-4efe-869b-468d2df9d5bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:25.608605 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c6ce8-3d23-4efe-869b-468d2df9d5bc None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:25.621581 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 258/528] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:39:25 2022] GET /identity/v3/role_assignments?user.id=9d21a0c72223417d92e3d8b30ef6bc3e&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=8cf7b72483b94512b497317ab1d11192 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:25.621581 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c6ce8-3d23-4efe-869b-468d2df9d5bc None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:25.810152 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c6ce8-3d23-4efe-869b-468d2df9d5bc None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:25.822438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe0525-c48b-4f6c-b252-22d25745f09c None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:25.874910 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f8abc-7a8c-4f0a-bc22-e977a2317625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:25.875745 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f8abc-7a8c-4f0a-bc22-e977a2317625 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:25.876098 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f8abc-7a8c-4f0a-bc22-e977a2317625 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:25.876441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f8abc-7a8c-4f0a-bc22-e977a2317625 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:25.877241 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f8abc-7a8c-4f0a-bc22-e977a2317625 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:25.877794 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f8abc-7a8c-4f0a-bc22-e977a2317625 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:25.879394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f8abc-7a8c-4f0a-bc22-e977a2317625 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:25.895405 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:25.896010 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec3372-5b08-4ddb-bbcd-4a4fc3032701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:25.896851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec3372-5b08-4ddb-bbcd-4a4fc3032701 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:25.897171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec3372-5b08-4ddb-bbcd-4a4fc3032701 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:25.897574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec3372-5b08-4ddb-bbcd-4a4fc3032701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:25.902241 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 259/529] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:25.903583 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f8abc-7a8c-4f0a-bc22-e977a2317625 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:25.919902 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec3372-5b08-4ddb-bbcd-4a4fc3032701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:25.921415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec3372-5b08-4ddb-bbcd-4a4fc3032701 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:25.940584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-bfec3372-5b08-4ddb-bbcd-4a4fc3032701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:25.940584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:25.940584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:25.940584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:25.940584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:25.940584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:25.940584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:25.940584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:25.940584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:25.940584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:25.940584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:25.940584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:25.940584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:25.940584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:25.940584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:25.940584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:25.941592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:25.941592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:25.941592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:25.941592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:25.941592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:25.941592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:25.941592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:25.941592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:25.941592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:25.941592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:25.941592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:25.941592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:25.941592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:25.941592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:25.941592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:25.941592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:25.941592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:25.942418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:25.942418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:25.942418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:25.942418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 271/530] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:25.942660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec3372-5b08-4ddb-bbcd-4a4fc3032701 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:25.980263 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:26.033707 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f8abc-7a8c-4f0a-bc22-e977a2317625 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:26.071928 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec3372-5b08-4ddb-bbcd-4a4fc3032701 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:26.073797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff5e69-d147-4d22-bc3c-a65e48ff1f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:26.074440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff5e69-d147-4d22-bc3c-a65e48ff1f99 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:26.074705 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff5e69-d147-4d22-bc3c-a65e48ff1f99 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:26.074969 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff5e69-d147-4d22-bc3c-a65e48ff1f99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:26.122402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63744d48-2fe1-4831-9c26-9d081b145903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:26.123405 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63744d48-2fe1-4831-9c26-9d081b145903 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:26.123853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63744d48-2fe1-4831-9c26-9d081b145903 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:26.124293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63744d48-2fe1-4831-9c26-9d081b145903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:26.125669 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63744d48-2fe1-4831-9c26-9d081b145903 None admin] RBAC: Adding query filter params (role.id=8cf7b72483b94512b497317ab1d11192, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=4a87e18c89ff419f8e428e376d33462c) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:26.126168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63744d48-2fe1-4831-9c26-9d081b145903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:26.128769 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63744d48-2fe1-4831-9c26-9d081b145903 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:26.141929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 272/531] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:39:25 2022] GET /identity/v3/role_assignments?user.id=4a87e18c89ff419f8e428e376d33462c&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=8cf7b72483b94512b497317ab1d11192 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:26.144810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19860b-acaa-4b66-b329-4979ef5397fa None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:26.145436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19860b-acaa-4b66-b329-4979ef5397fa None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:26.145924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19860b-acaa-4b66-b329-4979ef5397fa None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:26.148482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 273/532] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:26.152811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19860b-acaa-4b66-b329-4979ef5397fa None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:26.210032 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff5e69-d147-4d22-bc3c-a65e48ff1f99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:26.213400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff5e69-d147-4d22-bc3c-a65e48ff1f99 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:26.221499 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:26.320014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:26.356676 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19860b-acaa-4b66-b329-4979ef5397fa None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:26.383295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 260/533] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:39:26.383295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57d881-52c3-4c81-b419-ace9a188e345 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:26.383295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57d881-52c3-4c81-b419-ace9a188e345 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:26.383295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57d881-52c3-4c81-b419-ace9a188e345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:26.410038 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-7f57d881-52c3-4c81-b419-ace9a188e345 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:26.411274 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7f57d881-52c3-4c81-b419-ace9a188e345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:26.456209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a6277-2296-453f-ba8f-d4beaf764ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:26.456209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6277-2296-453f-ba8f-d4beaf764ae1 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:26.456209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6277-2296-453f-ba8f-d4beaf764ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:26.456209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a6277-2296-453f-ba8f-d4beaf764ae1 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:26.456973 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a6277-2296-453f-ba8f-d4beaf764ae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:26.456973 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a6277-2296-453f-ba8f-d4beaf764ae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:26.456973 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a6277-2296-453f-ba8f-d4beaf764ae1 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:26.470394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 274/534] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:26.471292 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a6277-2296-453f-ba8f-d4beaf764ae1 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:26.530501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 261/535] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:26.532183 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57d881-52c3-4c81-b419-ace9a188e345 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:26.589329 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:26.592701 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a6277-2296-453f-ba8f-d4beaf764ae1 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:26.638883 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f344b-7046-42a7-97c2-065a1884d67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:26.639417 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f344b-7046-42a7-97c2-065a1884d67a None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:26.639696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f344b-7046-42a7-97c2-065a1884d67a None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:26.639968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f344b-7046-42a7-97c2-065a1884d67a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:26.665700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f344b-7046-42a7-97c2-065a1884d67a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:26.667198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f344b-7046-42a7-97c2-065a1884d67a None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:26.689209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:26.699312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-ed4f344b-7046-42a7-97c2-065a1884d67a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:26.699312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:26.699312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:26.699312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:26.699312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:26.699312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:26.699312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:26.699312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:26.699312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:26.699312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:26.699312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:26.699312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:26.699312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:26.699312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:26.699312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:26.699312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:26.701055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:26.701055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:26.701055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:26.701055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:26.701055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:26.701055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:26.701055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:26.701055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:26.701055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:26.701055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:26.701055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:26.701055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:26.701055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:26.701055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:26.701055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:26.701055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:26.701055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:26.703073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:26.703073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:26.703073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:26.703073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 275/536] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:26.708616 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f344b-7046-42a7-97c2-065a1884d67a None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:26.765279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57d881-52c3-4c81-b419-ace9a188e345 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:26.844936 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e948b0d-e5ac-4dee-b45e-b52872749fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:26.847074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948b0d-e5ac-4dee-b45e-b52872749fb3 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:26.848818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948b0d-e5ac-4dee-b45e-b52872749fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:26.849301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948b0d-e5ac-4dee-b45e-b52872749fb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:26.867283 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e948b0d-e5ac-4dee-b45e-b52872749fb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:26.870144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e948b0d-e5ac-4dee-b45e-b52872749fb3 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:26.903481 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f344b-7046-42a7-97c2-065a1884d67a None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:26.912787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-5e948b0d-e5ac-4dee-b45e-b52872749fb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:26.912787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:26.912787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:26.912787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:26.912787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:26.912787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:26.912787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:26.912787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:26.912787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:26.912787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:26.912787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:26.912787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:26.912787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:26.912787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:26.912787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:26.913795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:26.913795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:26.913795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:26.913795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:26.913795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:26.913795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:26.913795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:26.913795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:26.913795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:26.913795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:26.913795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:26.913795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:26.913795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:26.913795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:26.913795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:26.913795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:26.913795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:26.914623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:26.914623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:26.914623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:26.914623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:26.914623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:26.914623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:26.914623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:26.914623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:26.926437 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 262/537] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:26.936441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e948b0d-e5ac-4dee-b45e-b52872749fb3 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:26.947897 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef02d3-03fa-4a0d-846d-a6a34ea55c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:26.949288 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef02d3-03fa-4a0d-846d-a6a34ea55c0f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:26.949833 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef02d3-03fa-4a0d-846d-a6a34ea55c0f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:26.950313 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef02d3-03fa-4a0d-846d-a6a34ea55c0f None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:26.951170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef02d3-03fa-4a0d-846d-a6a34ea55c0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:26.951668 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef02d3-03fa-4a0d-846d-a6a34ea55c0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:26.954055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef02d3-03fa-4a0d-846d-a6a34ea55c0f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:26.972620 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 276/538] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:26.978425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef02d3-03fa-4a0d-846d-a6a34ea55c0f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:27.102716 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:27.142601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:27.166494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e948b0d-e5ac-4dee-b45e-b52872749fb3 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:27.191781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef02d3-03fa-4a0d-846d-a6a34ea55c0f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:27.242189 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ff924-c8a2-4796-881f-974e497dda51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:27.243254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff924-c8a2-4796-881f-974e497dda51 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:27.243757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff924-c8a2-4796-881f-974e497dda51 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:27.244343 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ff924-c8a2-4796-881f-974e497dda51 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:27.245757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ff924-c8a2-4796-881f-974e497dda51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:27.246287 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ff924-c8a2-4796-881f-974e497dda51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:27.249119 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ff924-c8a2-4796-881f-974e497dda51 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:27.268374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbc098-0a1b-4836-a7ed-4f41a7c2d3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:27.269789 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbc098-0a1b-4836-a7ed-4f41a7c2d3b0 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:27.270406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbc098-0a1b-4836-a7ed-4f41a7c2d3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:27.271029 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbc098-0a1b-4836-a7ed-4f41a7c2d3b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:27.282253 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 263/539] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:27.284552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ff924-c8a2-4796-881f-974e497dda51 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:27.294836 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbc098-0a1b-4836-a7ed-4f41a7c2d3b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:27.306484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-6abbc098-0a1b-4836-a7ed-4f41a7c2d3b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:27.306484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:27.306484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:27.306484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:27.306484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:27.306484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:27.306484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:27.306484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:27.306484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:27.306484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:27.306484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:27.306484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:27.306484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:27.306484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:27.306484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:27.306484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:27.308284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:27.308284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:27.308284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:27.308284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:27.308284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:27.308284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:27.308284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:27.308284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:27.308284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:27.308284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:27.308284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:27.308284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:27.308284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:27.308284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:27.308284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:27.308284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:27.309921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:27.309921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:27.309921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:27.309921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:27.309921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:27.309921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:27.309921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:27.309921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:27.309921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:27.309921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:27.309921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:27.309921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:27.309921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 277/540] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:27.313311 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbc098-0a1b-4836-a7ed-4f41a7c2d3b0 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:27.539741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbc098-0a1b-4836-a7ed-4f41a7c2d3b0 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:27.544242 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ff924-c8a2-4796-881f-974e497dda51 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:27.584164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:27.613518 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a2e64-3666-4a27-9533-916888617a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:27.614958 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a2e64-3666-4a27-9533-916888617a91 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:27.615634 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a2e64-3666-4a27-9533-916888617a91 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:27.616332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a2e64-3666-4a27-9533-916888617a91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:27.618110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a2e64-3666-4a27-9533-916888617a91 None admin] RBAC: Adding query filter params (role.id=8cf7b72483b94512b497317ab1d11192, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=51d2d1c76c3040dd9e57f83c3860e8fa) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:27.618892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a2e64-3666-4a27-9533-916888617a91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:27.619187 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f8f2a-b89f-4d23-894d-1797c96829f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:27.620357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f8f2a-b89f-4d23-894d-1797c96829f3 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:27.620943 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f8f2a-b89f-4d23-894d-1797c96829f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:27.621547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f8f2a-b89f-4d23-894d-1797c96829f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:27.622818 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a2e64-3666-4a27-9533-916888617a91 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:27.633988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 278/541] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:39:27 2022] GET /identity/v3/role_assignments?user.id=51d2d1c76c3040dd9e57f83c3860e8fa&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=8cf7b72483b94512b497317ab1d11192 => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:27.635572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a2e64-3666-4a27-9533-916888617a91 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:27.637035 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f8f2a-b89f-4d23-894d-1797c96829f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:27.640240 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f8f2a-b89f-4d23-894d-1797c96829f3 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:27.667785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-5d5f8f2a-b89f-4d23-894d-1797c96829f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:27.667785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:27.667785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:27.667785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:27.667785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:27.667785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:27.667785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:27.667785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:27.667785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:27.667785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:27.667785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:27.667785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:27.667785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:27.667785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:27.667785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:27.669415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:27.669415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:27.669415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:27.669415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:27.669415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:27.669415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:27.669415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:27.669415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:27.669415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:27.669415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:27.669415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:27.669415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:27.669415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:27.669415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:27.669415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:27.669415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:27.669415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:27.671066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:27.671066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:27.671066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:27.671066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:27.671066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:27.671066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:27.671066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:27.671066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:27.676421 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 264/542] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:27.682600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f8f2a-b89f-4d23-894d-1797c96829f3 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:27.710739 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:27.917311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f8f2a-b89f-4d23-894d-1797c96829f3 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:27.976006 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a2e64-3666-4a27-9533-916888617a91 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:27.995711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb8815-f651-4fce-9b81-b593337ebf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:27.996634 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb8815-f651-4fce-9b81-b593337ebf31 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:27.997239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb8815-f651-4fce-9b81-b593337ebf31 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:27.998516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb8815-f651-4fce-9b81-b593337ebf31 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:28.000069 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb8815-f651-4fce-9b81-b593337ebf31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:28.000599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb8815-f651-4fce-9b81-b593337ebf31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:28.003739 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb8815-f651-4fce-9b81-b593337ebf31 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:28.035607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 265/543] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:28.042424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb8815-f651-4fce-9b81-b593337ebf31 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:28.048015 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67188c13-f6a5-410c-a80d-8fc84325a552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:28.049621 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67188c13-f6a5-410c-a80d-8fc84325a552 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:28.050111 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67188c13-f6a5-410c-a80d-8fc84325a552 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:28.050595 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67188c13-f6a5-410c-a80d-8fc84325a552 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:28.051876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67188c13-f6a5-410c-a80d-8fc84325a552 None admin] RBAC: Adding query filter params (name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:28.052425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67188c13-f6a5-410c-a80d-8fc84325a552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:28.055091 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67188c13-f6a5-410c-a80d-8fc84325a552 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:28.096812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 279/544] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:39:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:28.103424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67188c13-f6a5-410c-a80d-8fc84325a552 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:28.202235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:28.317773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67188c13-f6a5-410c-a80d-8fc84325a552 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:28.321303 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:28.381391 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1132048-ad48-4ba6-aba5-6f69de62d190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:28.381391 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1132048-ad48-4ba6-aba5-6f69de62d190 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:28.381391 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1132048-ad48-4ba6-aba5-6f69de62d190 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:28.381391 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1132048-ad48-4ba6-aba5-6f69de62d190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:28.396692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1132048-ad48-4ba6-aba5-6f69de62d190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:28.404246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1132048-ad48-4ba6-aba5-6f69de62d190 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:28.422842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-e1132048-ad48-4ba6-aba5-6f69de62d190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:28.422842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:28.422842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:28.422842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:28.422842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:28.422842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:28.422842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:28.422842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:28.422842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:28.422842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:28.422842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:28.422842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:28.422842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:28.422842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:28.422842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:28.422842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:28.423932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:28.423932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:28.423932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:28.423932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:28.423932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:28.423932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:28.423932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:28.423932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:28.423932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:28.423932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:28.423932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:28.423932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:28.423932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:28.423932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:28.423932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:28.423932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:28.423932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:28.424878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:28.424878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:28.424878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:28.427233 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 280/545] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:39:28.435713 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1132048-ad48-4ba6-aba5-6f69de62d190 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:28.442454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb8815-f651-4fce-9b81-b593337ebf31 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:28.560008 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1132048-ad48-4ba6-aba5-6f69de62d190 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:28.570318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:28.577728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0840f0-fca0-42fb-bf50-6056c7cb94bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:28.578798 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0840f0-fca0-42fb-bf50-6056c7cb94bd None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:28.578798 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0840f0-fca0-42fb-bf50-6056c7cb94bd None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:28.579094 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0840f0-fca0-42fb-bf50-6056c7cb94bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:28.579816 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0840f0-fca0-42fb-bf50-6056c7cb94bd None admin] RBAC: Adding query filter params (role.id=8cf7b72483b94512b497317ab1d11192, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=a5814ac53752455697e050944b6d32b7) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:28.580130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0840f0-fca0-42fb-bf50-6056c7cb94bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:28.581667 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0840f0-fca0-42fb-bf50-6056c7cb94bd None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:28.607578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 266/546] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:39:28 2022] GET /identity/v3/role_assignments?user.id=a5814ac53752455697e050944b6d32b7&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=8cf7b72483b94512b497317ab1d11192 => generated 259 bytes in 566 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:28.661096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3ec09-22ee-4cac-a9e3-25459da85f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:28.662182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ec09-22ee-4cac-a9e3-25459da85f87 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:28.662653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ec09-22ee-4cac-a9e3-25459da85f87 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:28.663180 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ec09-22ee-4cac-a9e3-25459da85f87 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:28.664418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3ec09-22ee-4cac-a9e3-25459da85f87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:28.664948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3ec09-22ee-4cac-a9e3-25459da85f87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:28.667728 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3ec09-22ee-4cac-a9e3-25459da85f87 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:28.701526 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 281/547] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:28.710323 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0840f0-fca0-42fb-bf50-6056c7cb94bd None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:28.923460 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0840f0-fca0-42fb-bf50-6056c7cb94bd None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:28.994893 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391fd50-c46f-4f9b-b447-86934c64ae13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:28.995933 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391fd50-c46f-4f9b-b447-86934c64ae13 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:28.996395 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391fd50-c46f-4f9b-b447-86934c64ae13 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:28.996860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391fd50-c46f-4f9b-b447-86934c64ae13 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:29.000588 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:29.012258 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391fd50-c46f-4f9b-b447-86934c64ae13 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:29.015148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391fd50-c46f-4f9b-b447-86934c64ae13 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:29.038339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-3391fd50-c46f-4f9b-b447-86934c64ae13 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:39:29.038339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:29.038339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:29.038339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:29.038339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:29.038339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:29.038339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:29.038339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:29.038339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:29.038339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:29.038339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:29.038339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:29.038339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:29.038339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:29.038339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:29.038339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:29.039515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:29.040417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:29.040417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:29.040417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:29.040417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:29.040417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:29.040417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:29.040417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:29.040417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:29.040417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:39:29.040417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:29.041021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 267/548] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:39:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:29.048377 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3ec09-22ee-4cac-a9e3-25459da85f87 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:29.187364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4180aad-c3ff-4768-9fca-72b1df0d215a None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:29.187777 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4180aad-c3ff-4768-9fca-72b1df0d215a None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:29.188232 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4180aad-c3ff-4768-9fca-72b1df0d215a None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:29.190710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 268/549] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:29.198687 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431c167-5f4f-4717-8f16-c3287cb6d24d None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:29.199102 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431c167-5f4f-4717-8f16-c3287cb6d24d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:29.199513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431c167-5f4f-4717-8f16-c3287cb6d24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:29.252937 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-3431c167-5f4f-4717-8f16-c3287cb6d24d None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:29.255010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-3431c167-5f4f-4717-8f16-c3287cb6d24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:29.333594 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3ec09-22ee-4cac-a9e3-25459da85f87 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:29.409846 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeba66a-e634-4774-8948-e4f25917c36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:29.410859 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeba66a-e634-4774-8948-e4f25917c36e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:29.411318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeba66a-e634-4774-8948-e4f25917c36e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:29.412136 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeba66a-e634-4774-8948-e4f25917c36e None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:29.414154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeba66a-e634-4774-8948-e4f25917c36e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:29.414873 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeba66a-e634-4774-8948-e4f25917c36e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:29.418072 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeba66a-e634-4774-8948-e4f25917c36e None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:29.421395 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 269/550] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:29.425188 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115f080-c1ee-444f-9b75-658f7ec6c54d None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:29.425697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115f080-c1ee-444f-9b75-658f7ec6c54d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:29.426168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115f080-c1ee-444f-9b75-658f7ec6c54d None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:29.429142 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 270/551] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:29.442206 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd7c8e-2132-46ee-97a1-249bf47023a6 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:29.443009 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd7c8e-2132-46ee-97a1-249bf47023a6 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:29.443473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd7c8e-2132-46ee-97a1-249bf47023a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:29.466729 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 282/552] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 12 23:39:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:29.475226 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeba66a-e634-4774-8948-e4f25917c36e None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:29.478181 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-50fd7c8e-2132-46ee-97a1-249bf47023a6 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:29.480176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-50fd7c8e-2132-46ee-97a1-249bf47023a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:29.531183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:29.613631 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 271/553] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:29.723919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd7c8e-2132-46ee-97a1-249bf47023a6 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:29.752928 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeba66a-e634-4774-8948-e4f25917c36e None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:29.828779 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522711b0-3fbc-4308-89ab-062a329702ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:29.829903 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522711b0-3fbc-4308-89ab-062a329702ba None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:29.830348 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522711b0-3fbc-4308-89ab-062a329702ba None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:29.830801 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522711b0-3fbc-4308-89ab-062a329702ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:29.857290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:29.944101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd7c8e-2132-46ee-97a1-249bf47023a6 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:30.020182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e24892-ccbb-4140-88a6-bf6ceb41bf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:30.021206 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e24892-ccbb-4140-88a6-bf6ceb41bf5c None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:30.021710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e24892-ccbb-4140-88a6-bf6ceb41bf5c None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:30.022145 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e24892-ccbb-4140-88a6-bf6ceb41bf5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:30.057617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e24892-ccbb-4140-88a6-bf6ceb41bf5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:30.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-a9e24892-ccbb-4140-88a6-bf6ceb41bf5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:30.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:30.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:30.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:30.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:30.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:30.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:30.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:30.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:30.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:30.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:30.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:30.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:30.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:30.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:30.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:30.078028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:30.078028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:30.078028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:30.078028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:30.078028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:30.078028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:30.078028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:30.078028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:30.078028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:30.078028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:30.078028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:30.078028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:30.078028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:30.078028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:30.078028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:30.078028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:30.080965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:30.080965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:30.080965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:30.080965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:30.080965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:30.080965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:30.080965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:30.080965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:30.080965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:30.080965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:30.080965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:30.080965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:30.080965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 272/554] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:39:30.089455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522711b0-3fbc-4308-89ab-062a329702ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:30.089455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522711b0-3fbc-4308-89ab-062a329702ba None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:30.089800 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e24892-ccbb-4140-88a6-bf6ceb41bf5c None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:30.139850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:30.320739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 283/555] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 846 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:39:30.322301 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522711b0-3fbc-4308-89ab-062a329702ba None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:30.332413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e24892-ccbb-4140-88a6-bf6ceb41bf5c None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:30.361978 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:30.399582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dcb21-19aa-4ac8-985c-8131e4ce86ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:30.400590 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dcb21-19aa-4ac8-985c-8131e4ce86ca None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:30.402699 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dcb21-19aa-4ac8-985c-8131e4ce86ca None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:30.403379 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dcb21-19aa-4ac8-985c-8131e4ce86ca None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:30.404832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679dcb21-19aa-4ac8-985c-8131e4ce86ca None admin] RBAC: Adding query filter params (name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:30.405382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679dcb21-19aa-4ac8-985c-8131e4ce86ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:30.408235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679dcb21-19aa-4ac8-985c-8131e4ce86ca None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:30.432271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 273/556] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:39:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:30.434204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dcb21-19aa-4ac8-985c-8131e4ce86ca None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:30.522623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522711b0-3fbc-4308-89ab-062a329702ba None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:30.554186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:30.589247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c590c87-18e5-4b50-bb07-a1b71ba4f7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:30.590511 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c590c87-18e5-4b50-bb07-a1b71ba4f7b0 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:30.590839 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c590c87-18e5-4b50-bb07-a1b71ba4f7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:30.591310 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c590c87-18e5-4b50-bb07-a1b71ba4f7b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:30.611946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c590c87-18e5-4b50-bb07-a1b71ba4f7b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:30.622005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-1c590c87-18e5-4b50-bb07-a1b71ba4f7b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:30.622005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:30.622005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:30.622005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:30.622005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:30.622005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:30.622005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:30.622005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:30.622005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:30.622005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:30.622005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:30.622005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:30.622005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:30.622005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:30.622005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:30.622005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:30.624032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:30.624032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:30.624032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:30.624032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:30.624032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:30.624032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:30.624032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:30.624032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:30.624032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:30.624032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:30.624032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:30.624032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:30.624032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:30.624032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:30.624032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:30.624032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:30.626132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:30.626132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:30.626132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:30.626132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:30.626132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:30.626132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:30.626132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:30.626132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:30.626132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:30.626132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:30.626132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:30.626132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:30.626132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 284/557] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:30.633656 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c590c87-18e5-4b50-bb07-a1b71ba4f7b0 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:30.649405 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dcb21-19aa-4ac8-985c-8131e4ce86ca None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:30.716930 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10d3d4-002d-4263-b416-962176e7e232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:30.717986 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10d3d4-002d-4263-b416-962176e7e232 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:30.718550 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10d3d4-002d-4263-b416-962176e7e232 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:30.719505 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10d3d4-002d-4263-b416-962176e7e232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:30.743516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10d3d4-002d-4263-b416-962176e7e232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:30.746282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10d3d4-002d-4263-b416-962176e7e232 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:30.776413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-3c10d3d4-002d-4263-b416-962176e7e232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:30.776413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:30.776413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:30.776413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:30.776413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:30.776413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:30.776413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:30.776413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:30.776413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:30.776413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:30.776413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:30.776413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:30.776413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:30.776413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:30.776413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:30.776413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:30.778339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:30.778339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:30.778339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:30.778339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:30.778339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:30.778339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:30.778339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:30.778339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:30.778339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:30.778339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:30.778339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:30.778339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:30.778339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:30.778339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:30.778339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:30.778339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:30.778339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:30.780110 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:30.780110 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:30.780110 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:30.783887 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 274/558] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:30.785438 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10d3d4-002d-4263-b416-962176e7e232 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:30.827021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c590c87-18e5-4b50-bb07-a1b71ba4f7b0 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:30.843177 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:30.889678 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a476d-6cd1-4a6f-8fe5-9eed9ba17dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:30.891317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a476d-6cd1-4a6f-8fe5-9eed9ba17dcc None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:30.891822 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a476d-6cd1-4a6f-8fe5-9eed9ba17dcc None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:30.892264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a476d-6cd1-4a6f-8fe5-9eed9ba17dcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:30.909572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a476d-6cd1-4a6f-8fe5-9eed9ba17dcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:30.911059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a476d-6cd1-4a6f-8fe5-9eed9ba17dcc None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:30.926708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-521a476d-6cd1-4a6f-8fe5-9eed9ba17dcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:30.926708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:30.926708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:30.926708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:30.926708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:30.926708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:30.926708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:30.926708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:30.926708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:30.926708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:30.926708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:30.926708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:30.926708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:30.926708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:30.926708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:30.926708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:30.929022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:30.929022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:30.929022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:30.929022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:30.929022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:30.929022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:30.929022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:30.929022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:30.929022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:30.929022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:30.929022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:30.929022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:30.929022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:30.929022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:30.929022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:30.929022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:30.929022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:30.930521 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:30.930521 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:30.930521 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:30.930521 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 285/559] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:30.930521 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a476d-6cd1-4a6f-8fe5-9eed9ba17dcc None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:30.941442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10d3d4-002d-4263-b416-962176e7e232 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:30.964248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:30.982337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96b21b-5f90-4436-86e3-070b2a2c8d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:30.983579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96b21b-5f90-4436-86e3-070b2a2c8d93 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:30.983691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96b21b-5f90-4436-86e3-070b2a2c8d93 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:30.984069 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96b21b-5f90-4436-86e3-070b2a2c8d93 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:30.985066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96b21b-5f90-4436-86e3-070b2a2c8d93 None admin] RBAC: Adding query filter params (name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:30.985830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96b21b-5f90-4436-86e3-070b2a2c8d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:30.987418 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96b21b-5f90-4436-86e3-070b2a2c8d93 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:31.004598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 275/560] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:39:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:31.004598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840390ac-f7cc-4940-82d6-1748046cc463 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:31.004598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840390ac-f7cc-4940-82d6-1748046cc463 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:31.004598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840390ac-f7cc-4940-82d6-1748046cc463 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:31.004598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 276/561] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:31.004598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840390ac-f7cc-4940-82d6-1748046cc463 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:31.098132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a476d-6cd1-4a6f-8fe5-9eed9ba17dcc None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:31.132204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:31.140934 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7eec0-0e49-47e0-b677-a1be69c8ec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:31.141604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7eec0-0e49-47e0-b677-a1be69c8ec63 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:31.141883 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7eec0-0e49-47e0-b677-a1be69c8ec63 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:31.142154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7eec0-0e49-47e0-b677-a1be69c8ec63 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:31.142827 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7eec0-0e49-47e0-b677-a1be69c8ec63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:31.143134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7eec0-0e49-47e0-b677-a1be69c8ec63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:31.144514 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7eec0-0e49-47e0-b677-a1be69c8ec63 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:31.146272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840390ac-f7cc-4940-82d6-1748046cc463 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:31.159034 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 286/562] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:31.160718 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82736b4-1d00-4b28-bd39-3662d076da47 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:31.161032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82736b4-1d00-4b28-bd39-3662d076da47 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:31.161255 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82736b4-1d00-4b28-bd39-3662d076da47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:31.182315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-a82736b4-1d00-4b28-bd39-3662d076da47 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:31.183556 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a82736b4-1d00-4b28-bd39-3662d076da47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:31.192840 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa035194-f1b3-4d9b-9fed-460b5b392475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:31.193838 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa035194-f1b3-4d9b-9fed-460b5b392475 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:31.194300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa035194-f1b3-4d9b-9fed-460b5b392475 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:31.194741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa035194-f1b3-4d9b-9fed-460b5b392475 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:31.195589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa035194-f1b3-4d9b-9fed-460b5b392475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:31.196018 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa035194-f1b3-4d9b-9fed-460b5b392475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:31.197921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa035194-f1b3-4d9b-9fed-460b5b392475 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:31.213471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 277/563] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:31.214612 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa035194-f1b3-4d9b-9fed-460b5b392475 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:31.269811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 287/564] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:31.270519 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82736b4-1d00-4b28-bd39-3662d076da47 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:31.293070 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:31.383803 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82736b4-1d00-4b28-bd39-3662d076da47 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:31.399927 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa035194-f1b3-4d9b-9fed-460b5b392475 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:31.422879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec401929-5fe4-43f7-93ec-5016cf340164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:31.423539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec401929-5fe4-43f7-93ec-5016cf340164 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:31.423823 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec401929-5fe4-43f7-93ec-5016cf340164 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:31.424159 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec401929-5fe4-43f7-93ec-5016cf340164 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:31.434975 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec401929-5fe4-43f7-93ec-5016cf340164 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:31.437097 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec401929-5fe4-43f7-93ec-5016cf340164 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:31.450727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-ec401929-5fe4-43f7-93ec-5016cf340164 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:31.450727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:31.450727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:31.450727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:31.450727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:31.450727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:31.450727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:31.450727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:31.450727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:31.450727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:31.450727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:31.450727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:31.450727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:31.450727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:31.450727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:31.452266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:31.452266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:31.452266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:31.452266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:31.452266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:31.452266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:31.452266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:31.452266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:31.452266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:31.452266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:31.452266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:31.452266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:31.452266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:31.452266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:31.452266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:31.452266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:31.452266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:31.454031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:31.454031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:31.454031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:31.454031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:31.454031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:31.454031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:31.454031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:31.454031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:31.454031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 288/565] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:31.454031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec401929-5fe4-43f7-93ec-5016cf340164 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:31.481260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190f32f-c175-4dee-87b8-519877371e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:31.482858 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190f32f-c175-4dee-87b8-519877371e14 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:31.483526 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190f32f-c175-4dee-87b8-519877371e14 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:31.484311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190f32f-c175-4dee-87b8-519877371e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:31.507518 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190f32f-c175-4dee-87b8-519877371e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:31.510779 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190f32f-c175-4dee-87b8-519877371e14 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:31.542615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-e190f32f-c175-4dee-87b8-519877371e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:31.542615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:31.542615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:31.542615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:31.542615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:31.542615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:31.542615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:31.542615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:31.542615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:31.542615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:31.542615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:31.542615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:31.542615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:31.542615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:31.542615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:31.542615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:31.544346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:31.544346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:31.544346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:31.544346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:31.544346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:31.544346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:31.544346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:31.544346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:31.544346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:31.544346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:31.544346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:31.544346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:31.544346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:31.544346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:31.544346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:31.544346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:31.544346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:31.546353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:31.546353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:31.546353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:31.549951 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 278/566] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:31.551897 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190f32f-c175-4dee-87b8-519877371e14 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:31.556764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:31.557620 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:31.583361 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec401929-5fe4-43f7-93ec-5016cf340164 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:31.622053 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9b58f-a4ef-4f95-b875-4e4a2d9bf0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:31.622700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9b58f-a4ef-4f95-b875-4e4a2d9bf0f8 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:31.622977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9b58f-a4ef-4f95-b875-4e4a2d9bf0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:31.623249 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9b58f-a4ef-4f95-b875-4e4a2d9bf0f8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:31.631953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9b58f-a4ef-4f95-b875-4e4a2d9bf0f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:31.633590 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9b58f-a4ef-4f95-b875-4e4a2d9bf0f8 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:31.647272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-cbf9b58f-a4ef-4f95-b875-4e4a2d9bf0f8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 12 23:39:31.647272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:31.647272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:31.647272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:31.647272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:31.647272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:31.647272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:31.647272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:31.647272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:31.647272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:31.647272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:31.647272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:31.647272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:31.647272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:31.647272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:31.647272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:31.648948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:31.650650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:31.650650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:31.650650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:31.650650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:31.650650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:31.650650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:31.650650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:31.650650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:31.650650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 12 23:39:31.650650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:31.653385 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 289/567] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:39:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:31.654544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9b58f-a4ef-4f95-b875-4e4a2d9bf0f8 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:31.761778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190f32f-c175-4dee-87b8-519877371e14 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:31.766227 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9b58f-a4ef-4f95-b875-4e4a2d9bf0f8 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:31.806234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8ba65-e674-481b-93b8-a75cff47d98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:31.806862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8ba65-e674-481b-93b8-a75cff47d98c None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:31.807145 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8ba65-e674-481b-93b8-a75cff47d98c None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:31.807417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8ba65-e674-481b-93b8-a75cff47d98c None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:31.808139 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8ba65-e674-481b-93b8-a75cff47d98c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:31.808448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8ba65-e674-481b-93b8-a75cff47d98c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:31.809964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8ba65-e674-481b-93b8-a75cff47d98c None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:31.812400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31eb6fb-78ea-4e89-a285-375fbcf16789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:31.813763 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eb6fb-78ea-4e89-a285-375fbcf16789 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:31.814277 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eb6fb-78ea-4e89-a285-375fbcf16789 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:31.814751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eb6fb-78ea-4e89-a285-375fbcf16789 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:31.815631 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31eb6fb-78ea-4e89-a285-375fbcf16789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:31.816146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31eb6fb-78ea-4e89-a285-375fbcf16789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:31.817749 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31eb6fb-78ea-4e89-a285-375fbcf16789 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:31.827680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:31.829995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 279/568] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:31.831140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8ba65-e674-481b-93b8-a75cff47d98c None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:31.838775 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 290/569] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:31.839717 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31eb6fb-78ea-4e89-a285-375fbcf16789 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:31.942250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:31.963849 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31eb6fb-78ea-4e89-a285-375fbcf16789 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:31.998383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ec9e0-c382-462e-9831-a3c3a90bed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:31.999022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ec9e0-c382-462e-9831-a3c3a90bed1b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:31.999298 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ec9e0-c382-462e-9831-a3c3a90bed1b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:31.999566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ec9e0-c382-462e-9831-a3c3a90bed1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:32.001825 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8ba65-e674-481b-93b8-a75cff47d98c None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:32.010851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ec9e0-c382-462e-9831-a3c3a90bed1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:32.015648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-d23ec9e0-c382-462e-9831-a3c3a90bed1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:32.015648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:32.015648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:32.015648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:32.015648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:32.015648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:32.015648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:32.015648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:32.015648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:32.015648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:32.015648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:32.015648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:32.015648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:32.015648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:32.015648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:32.015648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:32.016720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:32.016720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:32.016720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:32.016720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:32.016720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:32.016720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:32.016720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:32.016720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:32.016720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:32.016720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:32.016720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:32.016720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:32.016720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:32.016720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:32.016720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:32.016720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:32.017579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:32.017579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:32.017579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:32.017579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:32.017579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:32.017579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:32.017579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:32.017579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:32.017579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:32.017579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:32.017579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:32.017579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:32.017579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 291/570] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:32.018254 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ec9e0-c382-462e-9831-a3c3a90bed1b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:32.050688 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74c789-78a8-4454-9f98-fe7b7773aad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:32.051302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74c789-78a8-4454-9f98-fe7b7773aad4 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:32.051580 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74c789-78a8-4454-9f98-fe7b7773aad4 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:32.051853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74c789-78a8-4454-9f98-fe7b7773aad4 None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:32.052599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74c789-78a8-4454-9f98-fe7b7773aad4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:32.052901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74c789-78a8-4454-9f98-fe7b7773aad4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:32.054389 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74c789-78a8-4454-9f98-fe7b7773aad4 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:32.075739 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 280/571] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 12 23:39:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:32.076398 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74c789-78a8-4454-9f98-fe7b7773aad4 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:32.088383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:32.142262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ec9e0-c382-462e-9831-a3c3a90bed1b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:32.179895 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9ff34-4ef2-4425-ad7e-f51b9dd007e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:32.180516 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9ff34-4ef2-4425-ad7e-f51b9dd007e7 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:32.180797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9ff34-4ef2-4425-ad7e-f51b9dd007e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:32.181065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9ff34-4ef2-4425-ad7e-f51b9dd007e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:32.181832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9ff34-4ef2-4425-ad7e-f51b9dd007e7 None admin] RBAC: Adding query filter params (role.id=8cf7b72483b94512b497317ab1d11192, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=43c45ae3144b4fe8ab4e921fda30164a) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:32.182138 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9ff34-4ef2-4425-ad7e-f51b9dd007e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:32.183580 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9ff34-4ef2-4425-ad7e-f51b9dd007e7 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:32.184232 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74c789-78a8-4454-9f98-fe7b7773aad4 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:32.191263 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 292/572] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:39:32 2022] GET /identity/v3/role_assignments?user.id=43c45ae3144b4fe8ab4e921fda30164a&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=8cf7b72483b94512b497317ab1d11192 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:32.192893 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ba3ba-3464-4c39-8dfe-6e2f55eab782 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:32.194233 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ba3ba-3464-4c39-8dfe-6e2f55eab782 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:32.194233 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ba3ba-3464-4c39-8dfe-6e2f55eab782 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:32.200978 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 293/573] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:32.200978 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ba3ba-3464-4c39-8dfe-6e2f55eab782 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:32.223566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:32.248428 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60110db7-7af2-49e1-afe5-4e6519641c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:32.249441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60110db7-7af2-49e1-afe5-4e6519641c39 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:32.249957 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60110db7-7af2-49e1-afe5-4e6519641c39 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:32.250564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60110db7-7af2-49e1-afe5-4e6519641c39 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:32.264041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60110db7-7af2-49e1-afe5-4e6519641c39 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:32.266736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60110db7-7af2-49e1-afe5-4e6519641c39 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:32.283692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-60110db7-7af2-49e1-afe5-4e6519641c39 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:39:32.283692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:32.283692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:32.283692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:32.283692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:32.283692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:32.283692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:32.283692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:32.283692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:32.283692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:32.283692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:32.283692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:32.283692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:32.283692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:32.283692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:32.283692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:32.285584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:32.287318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:32.287318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:32.287318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:32.287318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:32.287318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:32.287318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:32.287318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:32.287318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:32.287318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:39:32.287318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:32.287318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 281/574] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 23:39:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:32.287318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60110db7-7af2-49e1-afe5-4e6519641c39 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:32.373368 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ba3ba-3464-4c39-8dfe-6e2f55eab782 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:32.414337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:32.429798 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126571d1-01f9-4895-9b56-7677c966538b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:32.432842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126571d1-01f9-4895-9b56-7677c966538b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:32.432842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126571d1-01f9-4895-9b56-7677c966538b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:32.432842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126571d1-01f9-4895-9b56-7677c966538b None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:32.432842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126571d1-01f9-4895-9b56-7677c966538b None admin] RBAC: Adding query filter params (name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:32.432842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126571d1-01f9-4895-9b56-7677c966538b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:32.433415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126571d1-01f9-4895-9b56-7677c966538b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:32.434450 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60110db7-7af2-49e1-afe5-4e6519641c39 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:32.448175 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 294/575] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:39:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:32.448175 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866646e-9d98-4320-9a48-0649f4e42edd None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:32.448175 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866646e-9d98-4320-9a48-0649f4e42edd None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:32.448175 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866646e-9d98-4320-9a48-0649f4e42edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:32.466124 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-6866646e-9d98-4320-9a48-0649f4e42edd None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:32.467442 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6866646e-9d98-4320-9a48-0649f4e42edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:32.494781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacf1e3-966c-4fe8-bbdb-50337e8e4f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:32.495812 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacf1e3-966c-4fe8-bbdb-50337e8e4f52 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:32.496290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacf1e3-966c-4fe8-bbdb-50337e8e4f52 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:32.496729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacf1e3-966c-4fe8-bbdb-50337e8e4f52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:32.516396 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacf1e3-966c-4fe8-bbdb-50337e8e4f52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:32.519067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacf1e3-966c-4fe8-bbdb-50337e8e4f52 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:32.549398 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 295/576] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:32.549398 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866646e-9d98-4320-9a48-0649f4e42edd None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:32.549658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-9aacf1e3-966c-4fe8-bbdb-50337e8e4f52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:32.549658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:32.549658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:32.549658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:32.549658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:32.549658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:32.549658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:32.549658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:32.549658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:32.549658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:32.549658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:32.549658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:32.549658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:32.549658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:32.549658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:32.549658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:32.550636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:32.550636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:32.550636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:32.550636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:32.550636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:32.550636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:32.550636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:32.550636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:32.550636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:32.550636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:32.550636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:32.550636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:32.550636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:32.550636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:32.550636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:32.550636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:32.550636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:32.551507 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:32.551507 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:32.551507 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:32.551507 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 282/577] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:32.551507 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacf1e3-966c-4fe8-bbdb-50337e8e4f52 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:32.590665 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:32.707453 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacf1e3-966c-4fe8-bbdb-50337e8e4f52 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:32.711402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866646e-9d98-4320-9a48-0649f4e42edd None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:32.728919 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:32.753022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15a24d-b48a-4301-86db-ddab2c206b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:32.753868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15a24d-b48a-4301-86db-ddab2c206b12 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:32.754145 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15a24d-b48a-4301-86db-ddab2c206b12 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:32.754411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15a24d-b48a-4301-86db-ddab2c206b12 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:32.755156 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15a24d-b48a-4301-86db-ddab2c206b12 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:32.755597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15a24d-b48a-4301-86db-ddab2c206b12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:32.757197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15a24d-b48a-4301-86db-ddab2c206b12 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:32.784464 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 296/578] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 23:39:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:32.784464 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15a24d-b48a-4301-86db-ddab2c206b12 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:32.785770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d051c7-6650-49cf-825a-dd8d5f0a872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:32.787625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d051c7-6650-49cf-825a-dd8d5f0a872a None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:32.788576 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d051c7-6650-49cf-825a-dd8d5f0a872a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:32.789327 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d051c7-6650-49cf-825a-dd8d5f0a872a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:32.810622 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d051c7-6650-49cf-825a-dd8d5f0a872a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:32.814599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d051c7-6650-49cf-825a-dd8d5f0a872a None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:32.842431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-03d051c7-6650-49cf-825a-dd8d5f0a872a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:32.842431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:32.842431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:32.842431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:32.842431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:32.842431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:32.842431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:32.842431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:32.842431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:32.842431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:32.842431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:32.842431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:32.842431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:32.842431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:32.842431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:32.842431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:32.843753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:32.843753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:32.843753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:32.843753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:32.843753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:32.843753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:32.843753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:32.843753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:32.843753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:32.843753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:32.843753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:32.843753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:32.843753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:32.843753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:32.843753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:32.843753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:32.843753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:32.844757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:32.844757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:32.844757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:32.844929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 283/579] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:32.846237 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d051c7-6650-49cf-825a-dd8d5f0a872a None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:32.920071 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15a24d-b48a-4301-86db-ddab2c206b12 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:32.960196 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281c70d-d310-47a9-a2de-233e005015cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:32.960733 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281c70d-d310-47a9-a2de-233e005015cc None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:32.961005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281c70d-d310-47a9-a2de-233e005015cc None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:32.961360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281c70d-d310-47a9-a2de-233e005015cc None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:32.961948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281c70d-d310-47a9-a2de-233e005015cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:32.962242 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281c70d-d310-47a9-a2de-233e005015cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:32.963607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281c70d-d310-47a9-a2de-233e005015cc None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:32.969851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:32.981818 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 297/580] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:32.981818 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281c70d-d310-47a9-a2de-233e005015cc None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:32.998010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d051c7-6650-49cf-825a-dd8d5f0a872a None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:33.022652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:33.038324 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca73435-747a-4620-829f-553d5a6747c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:33.038979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73435-747a-4620-829f-553d5a6747c3 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:33.039402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73435-747a-4620-829f-553d5a6747c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:33.039810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73435-747a-4620-829f-553d5a6747c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:33.053826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca73435-747a-4620-829f-553d5a6747c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:33.055272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca73435-747a-4620-829f-553d5a6747c3 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:33.072520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-7ca73435-747a-4620-829f-553d5a6747c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:33.072520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:33.072520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:33.072520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:33.072520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:33.072520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:33.072520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:33.072520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:33.072520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:33.072520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:33.072520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:33.072520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:33.072520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:33.072520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:33.072520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:33.072520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:33.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:33.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:33.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:33.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:33.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:33.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:33.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:33.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:33.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:33.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:33.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:33.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:33.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:33.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:33.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:33.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:33.074516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:33.076248 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:33.076248 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:33.076248 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:33.076248 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 284/581] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:33.076248 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca73435-747a-4620-829f-553d5a6747c3 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:33.126032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281c70d-d310-47a9-a2de-233e005015cc None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:33.179086 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f39be-3dc3-49b0-bf14-813d42e1b3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:33.180096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f39be-3dc3-49b0-bf14-813d42e1b3d4 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:33.180543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f39be-3dc3-49b0-bf14-813d42e1b3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:33.180978 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f39be-3dc3-49b0-bf14-813d42e1b3d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:33.200802 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f39be-3dc3-49b0-bf14-813d42e1b3d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:33.209495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-e35f39be-3dc3-49b0-bf14-813d42e1b3d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:33.209495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:33.209495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:33.209495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:33.209495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:33.209495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:33.209495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:33.209495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:33.209495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:33.209495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:33.209495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:33.209495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:33.209495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:33.209495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:33.209495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:33.209495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:33.211174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:33.211174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:33.211174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:33.211174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:33.211174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:33.211174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:33.211174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:33.211174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:33.211174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:33.211174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:33.211174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:33.211174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:33.211174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:33.211174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:33.211174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:33.211174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:33.212169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:33.212169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:33.212169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:33.212169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:33.212169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:33.212169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:33.212169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:33.212169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:33.212169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:33.212169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:33.212169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:33.212169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:33.212169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 298/582] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:33.212169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f39be-3dc3-49b0-bf14-813d42e1b3d4 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:33.242041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca73435-747a-4620-829f-553d5a6747c3 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:33.281420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca91c6-9759-48b6-be16-d875fc3c01e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:33.282040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca91c6-9759-48b6-be16-d875fc3c01e6 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:33.282309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca91c6-9759-48b6-be16-d875fc3c01e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:33.282690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca91c6-9759-48b6-be16-d875fc3c01e6 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:33.283227 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca91c6-9759-48b6-be16-d875fc3c01e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:33.283526 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca91c6-9759-48b6-be16-d875fc3c01e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:33.284930 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca91c6-9759-48b6-be16-d875fc3c01e6 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:33.287803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:33.306373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 285/583] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:33.308404 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca91c6-9759-48b6-be16-d875fc3c01e6 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:33.365697 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:33.376449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f39be-3dc3-49b0-bf14-813d42e1b3d4 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:33.422536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c0a45-ae4e-4a24-90c8-d29b544b38da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:33.424056 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c0a45-ae4e-4a24-90c8-d29b544b38da None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:33.424918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c0a45-ae4e-4a24-90c8-d29b544b38da None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:33.425498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c0a45-ae4e-4a24-90c8-d29b544b38da None admin] PATH_INFO: `/v3/projects/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:33.439059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c0a45-ae4e-4a24-90c8-d29b544b38da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:33.441873 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c0a45-ae4e-4a24-90c8-d29b544b38da None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:33.455247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-e60c0a45-ae4e-4a24-90c8-d29b544b38da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:33.455247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:33.455247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:33.455247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:33.455247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:33.455247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:33.455247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:33.455247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:33.455247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:33.455247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:33.455247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:33.455247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:33.455247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:33.455247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:33.455247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:33.464882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:33.464882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:33.464882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:33.464882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:33.464882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:33.464882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:33.464882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:33.464882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:33.464882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:33.464882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:33.464882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:33.464882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:33.464882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:33.464882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:33.464882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:33.464882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:33.464882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:33.466997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:33.466997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:33.466997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:33.466997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:33.466997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:33.466997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:33.466997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:33.466997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:33.466997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 299/584] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:33.466997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c0a45-ae4e-4a24-90c8-d29b544b38da None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:33.480496 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca91c6-9759-48b6-be16-d875fc3c01e6 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:33.522212 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec830eb-8b26-47d5-9bb9-c61dc449cb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:33.523154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec830eb-8b26-47d5-9bb9-c61dc449cb44 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:33.523546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec830eb-8b26-47d5-9bb9-c61dc449cb44 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:33.524428 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec830eb-8b26-47d5-9bb9-c61dc449cb44 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:33.525751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec830eb-8b26-47d5-9bb9-c61dc449cb44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:33.526327 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec830eb-8b26-47d5-9bb9-c61dc449cb44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:33.528396 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec830eb-8b26-47d5-9bb9-c61dc449cb44 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:33.542704 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 286/585] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:33.543285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec830eb-8b26-47d5-9bb9-c61dc449cb44 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:33.610223 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:33.641391 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c0a45-ae4e-4a24-90c8-d29b544b38da None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:33.677690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec830eb-8b26-47d5-9bb9-c61dc449cb44 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:33.680854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4d724-ced6-4c2f-9f3d-70683e9d6b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:33.681649 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4d724-ced6-4c2f-9f3d-70683e9d6b6e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:33.682020 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4d724-ced6-4c2f-9f3d-70683e9d6b6e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:33.682397 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4d724-ced6-4c2f-9f3d-70683e9d6b6e None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:33.683169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4d724-ced6-4c2f-9f3d-70683e9d6b6e None admin] RBAC: Adding query filter params (name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:33.683472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4d724-ced6-4c2f-9f3d-70683e9d6b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:33.684854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4d724-ced6-4c2f-9f3d-70683e9d6b6e None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:33.696422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 300/586] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:39:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:33.698699 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4d724-ced6-4c2f-9f3d-70683e9d6b6e None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:33.724126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:33.733289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a954e2d-cd27-423f-800d-5020fe8a5a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:33.734289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a954e2d-cd27-423f-800d-5020fe8a5a1d None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:33.734793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a954e2d-cd27-423f-800d-5020fe8a5a1d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:33.735206 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a954e2d-cd27-423f-800d-5020fe8a5a1d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:33.744821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a954e2d-cd27-423f-800d-5020fe8a5a1d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:33.746842 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a954e2d-cd27-423f-800d-5020fe8a5a1d None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:33.759983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-4a954e2d-cd27-423f-800d-5020fe8a5a1d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 23:39:33.759983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:33.759983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:33.759983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:33.759983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:33.759983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:33.759983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:33.759983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:33.759983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:33.759983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:33.759983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:33.759983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:33.759983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:33.759983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:33.759983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:33.759983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:33.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:33.763348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:33.763348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:33.763348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:33.763348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:33.763348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:33.763348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:33.763348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:33.763348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:33.763348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 23:39:33.763348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:33.763348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 287/587] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:39:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:33.763348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a954e2d-cd27-423f-800d-5020fe8a5a1d None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:33.839545 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4d724-ced6-4c2f-9f3d-70683e9d6b6e None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:33.885192 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b60d08-08c4-48c2-aa90-b05c0a2be56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:33.886007 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b60d08-08c4-48c2-aa90-b05c0a2be56a None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:33.886400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b60d08-08c4-48c2-aa90-b05c0a2be56a None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:33.886777 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b60d08-08c4-48c2-aa90-b05c0a2be56a None admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:33.887595 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b60d08-08c4-48c2-aa90-b05c0a2be56a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:33.888008 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b60d08-08c4-48c2-aa90-b05c0a2be56a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:33.889688 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b60d08-08c4-48c2-aa90-b05c0a2be56a None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:33.916949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 301/588] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:33.916949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b60d08-08c4-48c2-aa90-b05c0a2be56a None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:33.939592 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a954e2d-cd27-423f-800d-5020fe8a5a1d None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:33.968464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:34.000468 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4199eb-04d7-40de-beed-445907cea53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:34.000946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4199eb-04d7-40de-beed-445907cea53f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:34.001488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4199eb-04d7-40de-beed-445907cea53f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:34.001986 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4199eb-04d7-40de-beed-445907cea53f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:34.017793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4199eb-04d7-40de-beed-445907cea53f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:34.019753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4199eb-04d7-40de-beed-445907cea53f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:34.034407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-db4199eb-04d7-40de-beed-445907cea53f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:34.034407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:34.034407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:34.034407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:34.034407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:34.034407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:34.034407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:34.034407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:34.034407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:34.034407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:34.034407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:34.034407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:34.034407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:34.034407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:34.034407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:34.035610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:34.035610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:34.035610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:34.035610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:34.035610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:34.035610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:34.035610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:34.035610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:34.035610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:34.035610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:34.035610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:34.035610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:34.035610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:34.035610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:34.035610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:34.035610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:34.035610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:34.036683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:34.036683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:34.036683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:34.036683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:34.036683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:34.036683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:34.036683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:34.036683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:34.042937 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 288/589] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:34.043948 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4199eb-04d7-40de-beed-445907cea53f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:34.047111 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:34.084102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b60d08-08c4-48c2-aa90-b05c0a2be56a None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:34.128396 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96fc88-f1c9-4ce8-8541-f4877be8d6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:34.129128 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96fc88-f1c9-4ce8-8541-f4877be8d6c2 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:34.129879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96fc88-f1c9-4ce8-8541-f4877be8d6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:34.129879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96fc88-f1c9-4ce8-8541-f4877be8d6c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:34.142380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96fc88-f1c9-4ce8-8541-f4877be8d6c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:34.143882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96fc88-f1c9-4ce8-8541-f4877be8d6c2 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:34.162469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-db96fc88-f1c9-4ce8-8541-f4877be8d6c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:34.162469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:34.162469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:34.162469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:34.162469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:34.162469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:34.162469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:34.162469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:34.162469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:34.162469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:34.162469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:34.162469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:34.162469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:34.162469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:34.162469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:34.162469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:34.163724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:34.163724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:34.163724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:34.163724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:34.163724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:34.163724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:34.163724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:34.163724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:34.163724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:34.163724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:34.163724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:34.163724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:34.163724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:34.163724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:34.163724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:34.163724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:34.163724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:34.170770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:34.170770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:34.170770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:34.170770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 302/590] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:34.170770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96fc88-f1c9-4ce8-8541-f4877be8d6c2 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:34.200369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4199eb-04d7-40de-beed-445907cea53f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:34.247524 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7a0d8-e480-4839-b7f2-1ee1ccfcc974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:34.248645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7a0d8-e480-4839-b7f2-1ee1ccfcc974 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:34.249194 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7a0d8-e480-4839-b7f2-1ee1ccfcc974 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:34.249760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7a0d8-e480-4839-b7f2-1ee1ccfcc974 None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:34.251205 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7a0d8-e480-4839-b7f2-1ee1ccfcc974 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:34.251599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7a0d8-e480-4839-b7f2-1ee1ccfcc974 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:34.254003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7a0d8-e480-4839-b7f2-1ee1ccfcc974 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:34.275881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 289/591] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 12 23:39:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:34.276767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7a0d8-e480-4839-b7f2-1ee1ccfcc974 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:34.322111 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96fc88-f1c9-4ce8-8541-f4877be8d6c2 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:34.334534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:34.370720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:34.386887 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201089c7-4a26-46ec-9276-14d4000d31b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:34.387982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201089c7-4a26-46ec-9276-14d4000d31b9 None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:34.388562 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201089c7-4a26-46ec-9276-14d4000d31b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:34.389126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201089c7-4a26-46ec-9276-14d4000d31b9 None admin] PATH_INFO: `/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/9d21a0c72223417d92e3d8b30ef6bc3e/roles/8cf7b72483b94512b497317ab1d11192` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:34.422875 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201089c7-4a26-46ec-9276-14d4000d31b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=21118e9e4fa94603b2c0880dd0d5f5ba, user_id=9d21a0c72223417d92e3d8b30ef6bc3e, role_id=8cf7b72483b94512b497317ab1d11192)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:34.426202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201089c7-4a26-46ec-9276-14d4000d31b9 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:34.428584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7a0d8-e480-4839-b7f2-1ee1ccfcc974 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:34.446594 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 303/592] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:39:34 2022] PUT /identity/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/9d21a0c72223417d92e3d8b30ef6bc3e/roles/8cf7b72483b94512b497317ab1d11192 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:39:34.447767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201089c7-4a26-46ec-9276-14d4000d31b9 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:34.480645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f6141-7bed-4559-a1ed-a0f7593cda70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:34.481525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f6141-7bed-4559-a1ed-a0f7593cda70 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:34.481900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f6141-7bed-4559-a1ed-a0f7593cda70 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:34.482303 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f6141-7bed-4559-a1ed-a0f7593cda70 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:34.483104 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f6141-7bed-4559-a1ed-a0f7593cda70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:34.483544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f6141-7bed-4559-a1ed-a0f7593cda70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:34.485423 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f6141-7bed-4559-a1ed-a0f7593cda70 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:34.508274 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 290/593] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:34.509397 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f6141-7bed-4559-a1ed-a0f7593cda70 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:34.650868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201089c7-4a26-46ec-9276-14d4000d31b9 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:34.690029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:34.703685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f6141-7bed-4559-a1ed-a0f7593cda70 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:34.705236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0760fa-c45a-4f0e-8d25-dd9adbd66975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:34.706527 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0760fa-c45a-4f0e-8d25-dd9adbd66975 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:34.706527 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0760fa-c45a-4f0e-8d25-dd9adbd66975 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:34.706844 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0760fa-c45a-4f0e-8d25-dd9adbd66975 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:34.707677 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0760fa-c45a-4f0e-8d25-dd9adbd66975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:34.708148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0760fa-c45a-4f0e-8d25-dd9adbd66975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:34.710408 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0760fa-c45a-4f0e-8d25-dd9adbd66975 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:34.731965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 304/594] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:34.733517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0760fa-c45a-4f0e-8d25-dd9adbd66975 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:34.768663 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92147f71-4f4d-402d-951f-47677a822f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:34.769723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92147f71-4f4d-402d-951f-47677a822f8d None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:34.770181 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92147f71-4f4d-402d-951f-47677a822f8d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:34.770661 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92147f71-4f4d-402d-951f-47677a822f8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:34.791902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92147f71-4f4d-402d-951f-47677a822f8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:34.794583 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92147f71-4f4d-402d-951f-47677a822f8d None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:34.796613 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:34.824394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-92147f71-4f4d-402d-951f-47677a822f8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:34.824394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:34.824394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:34.824394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:34.824394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:34.824394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:34.824394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:34.824394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:34.824394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:34.824394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:34.824394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:34.824394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:34.824394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:34.824394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:34.824394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:34.824394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:34.825902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:34.825902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:34.825902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:34.825902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:34.825902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:34.825902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:34.825902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:34.825902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:34.825902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:34.825902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:34.825902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:34.825902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:34.825902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:34.825902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:34.825902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:34.825902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:34.825902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:34.826806 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:34.826806 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:34.826806 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:34.833721 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 291/595] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:34.836068 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c84850-a416-46b2-8466-4d929dac59d3 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:34.837007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c84850-a416-46b2-8466-4d929dac59d3 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:34.837475 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c84850-a416-46b2-8466-4d929dac59d3 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:34.840138 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 292/596] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:34.845577 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c84850-a416-46b2-8466-4d929dac59d3 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:34.920759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0760fa-c45a-4f0e-8d25-dd9adbd66975 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:34.989690 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f5eda-7437-409f-99c4-b68e2174981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:34.991054 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f5eda-7437-409f-99c4-b68e2174981c None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:34.991489 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f5eda-7437-409f-99c4-b68e2174981c None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:34.991924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f5eda-7437-409f-99c4-b68e2174981c None admin] PATH_INFO: `/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/4a87e18c89ff419f8e428e376d33462c/roles/8cf7b72483b94512b497317ab1d11192` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:35.021606 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c84850-a416-46b2-8466-4d929dac59d3 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:35.029629 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f5eda-7437-409f-99c4-b68e2174981c None admin] RBAC: Authorizing `identity:create_grant(project_id=21118e9e4fa94603b2c0880dd0d5f5ba, user_id=4a87e18c89ff419f8e428e376d33462c, role_id=8cf7b72483b94512b497317ab1d11192)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:35.032164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f5eda-7437-409f-99c4-b68e2174981c None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:35.065406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 305/597] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:39:34 2022] PUT /identity/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/4a87e18c89ff419f8e428e376d33462c/roles/8cf7b72483b94512b497317ab1d11192 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:39:35.065406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f5eda-7437-409f-99c4-b68e2174981c None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:35.096766 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfdbde3-f217-4b9c-9e36-519079dca294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:35.098360 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdbde3-f217-4b9c-9e36-519079dca294 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:35.098875 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdbde3-f217-4b9c-9e36-519079dca294 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:35.099373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfdbde3-f217-4b9c-9e36-519079dca294 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:35.120238 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdbde3-f217-4b9c-9e36-519079dca294 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:35.123092 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfdbde3-f217-4b9c-9e36-519079dca294 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:35.150224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-5bfdbde3-f217-4b9c-9e36-519079dca294 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 23:39:35.150224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:35.150224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:35.150224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:35.150224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:35.150224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:35.150224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:35.150224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:35.150224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:35.150224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:35.150224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:35.150224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:35.150224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:35.150224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:35.150224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:35.150224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:35.152021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:35.154953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:35.154953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:35.154953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:35.154953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:35.154953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:35.154953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:35.154953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:35.154953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:35.154953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 23:39:35.154953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:35.154953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 293/598] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:35.154953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd77300-4418-4dc3-ac7a-76f809e6f399 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:35.157666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd77300-4418-4dc3-ac7a-76f809e6f399 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:35.157666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd77300-4418-4dc3-ac7a-76f809e6f399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:35.179292 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:35.188558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-afd77300-4418-4dc3-ac7a-76f809e6f399 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:35.190522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-afd77300-4418-4dc3-ac7a-76f809e6f399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:35.237181 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:35.262266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f5eda-7437-409f-99c4-b68e2174981c None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:35.310234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d99439-1b4f-4c15-a149-3b57cdd35b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:35.311377 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99439-1b4f-4c15-a149-3b57cdd35b49 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:35.312270 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99439-1b4f-4c15-a149-3b57cdd35b49 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:35.312847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d99439-1b4f-4c15-a149-3b57cdd35b49 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:35.313805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d99439-1b4f-4c15-a149-3b57cdd35b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:35.314315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d99439-1b4f-4c15-a149-3b57cdd35b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:35.316028 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d99439-1b4f-4c15-a149-3b57cdd35b49 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:35.331313 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 306/599] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:35.332555 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d99439-1b4f-4c15-a149-3b57cdd35b49 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:35.369395 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 294/600] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:35.369395 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd77300-4418-4dc3-ac7a-76f809e6f399 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:35.541188 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd77300-4418-4dc3-ac7a-76f809e6f399 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:35.602637 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cae6e9-2b28-4edd-b2ea-34fa6dd33dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:35.603648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cae6e9-2b28-4edd-b2ea-34fa6dd33dde None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:35.604117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cae6e9-2b28-4edd-b2ea-34fa6dd33dde None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:35.604593 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cae6e9-2b28-4edd-b2ea-34fa6dd33dde None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:35.615758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:35.625088 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cae6e9-2b28-4edd-b2ea-34fa6dd33dde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:35.633421 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cae6e9-2b28-4edd-b2ea-34fa6dd33dde None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:35.653494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d99439-1b4f-4c15-a149-3b57cdd35b49 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:35.667311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-21cae6e9-2b28-4edd-b2ea-34fa6dd33dde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:35.667311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:35.667311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:35.667311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:35.667311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:35.667311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:35.667311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:35.667311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:35.667311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:35.667311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:35.667311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:35.667311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:35.667311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:35.667311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:35.667311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:35.668266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:35.668266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:35.668266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:35.668266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:35.668266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:35.668266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:35.668266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:35.668266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:35.668266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:35.668266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:35.668266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:35.668266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:35.668266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:35.668266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:35.668266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:35.668266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:35.668266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:35.669148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:35.669148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:35.669148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:35.669148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:35.669148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:35.669148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:35.669148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:35.669148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:35.671763 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 295/601] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:35.677576 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cae6e9-2b28-4edd-b2ea-34fa6dd33dde None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:35.700983 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77942a38-454d-4643-93f9-7d6dfbd35093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:35.701639 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77942a38-454d-4643-93f9-7d6dfbd35093 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:35.701964 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77942a38-454d-4643-93f9-7d6dfbd35093 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:35.702233 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77942a38-454d-4643-93f9-7d6dfbd35093 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:35.702979 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77942a38-454d-4643-93f9-7d6dfbd35093 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:35.703362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77942a38-454d-4643-93f9-7d6dfbd35093 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:35.709368 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77942a38-454d-4643-93f9-7d6dfbd35093 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:35.732825 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 307/602] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Sep 12 23:39:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:35.738553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77942a38-454d-4643-93f9-7d6dfbd35093 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:35.746831 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:35.870011 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cae6e9-2b28-4edd-b2ea-34fa6dd33dde None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:35.889714 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77942a38-454d-4643-93f9-7d6dfbd35093 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:35.936801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d7f6f-5ea3-445a-9933-6816d50b5adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:35.937861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e523ea8-cabd-4503-9487-a6d2cd34156a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:35.938271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d7f6f-5ea3-445a-9933-6816d50b5adf None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:35.938513 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e523ea8-cabd-4503-9487-a6d2cd34156a None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:35.938790 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e523ea8-cabd-4503-9487-a6d2cd34156a None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:35.939057 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e523ea8-cabd-4503-9487-a6d2cd34156a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:35.939161 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d7f6f-5ea3-445a-9933-6816d50b5adf None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:35.939747 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d7f6f-5ea3-445a-9933-6816d50b5adf None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:35.940864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d7f6f-5ea3-445a-9933-6816d50b5adf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:35.941554 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d7f6f-5ea3-445a-9933-6816d50b5adf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:35.944341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d7f6f-5ea3-445a-9933-6816d50b5adf None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:35.950797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e523ea8-cabd-4503-9487-a6d2cd34156a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:35.952276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e523ea8-cabd-4503-9487-a6d2cd34156a None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:35.968420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-6e523ea8-cabd-4503-9487-a6d2cd34156a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:35.968420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:35.968420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:35.968420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:35.968420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:35.968420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:35.968420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:35.968420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:35.968420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:35.968420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:35.968420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:35.968420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:35.968420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:35.968420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:35.968420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:35.968420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:35.969642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:35.969642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:35.969642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:35.969642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:35.969642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:35.969642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:35.969642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:35.969642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:35.969642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:35.969642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:35.969642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:35.969642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:35.969642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:35.969642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:35.969642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:35.969642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:35.969642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:35.970697 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:35.970697 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:35.970697 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:35.970888 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 296/603] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:35.971918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d7f6f-5ea3-445a-9933-6816d50b5adf None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:35.973434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 308/604] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:39:35.976048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e523ea8-cabd-4503-9487-a6d2cd34156a None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:36.043689 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:36.054944 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:36.107355 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e523ea8-cabd-4503-9487-a6d2cd34156a None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:36.140823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d7f6f-5ea3-445a-9933-6816d50b5adf None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:36.151945 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0d160-ac7f-4ad2-a0bd-9bb7d72c5550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:36.152571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0d160-ac7f-4ad2-a0bd-9bb7d72c5550 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:36.152862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0d160-ac7f-4ad2-a0bd-9bb7d72c5550 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:36.153104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0d160-ac7f-4ad2-a0bd-9bb7d72c5550 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:36.155050 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0d160-ac7f-4ad2-a0bd-9bb7d72c5550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:36.155359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0d160-ac7f-4ad2-a0bd-9bb7d72c5550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:36.156943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0d160-ac7f-4ad2-a0bd-9bb7d72c5550 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:36.182940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 309/605] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:36.182940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0d160-ac7f-4ad2-a0bd-9bb7d72c5550 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:36.225211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e3b26-d283-4c2f-9a5d-1aef3a9ccaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:36.226694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e3b26-d283-4c2f-9a5d-1aef3a9ccaa6 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:36.228359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e3b26-d283-4c2f-9a5d-1aef3a9ccaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:36.229078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e3b26-d283-4c2f-9a5d-1aef3a9ccaa6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:36.253311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e3b26-d283-4c2f-9a5d-1aef3a9ccaa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:36.268589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-438e3b26-d283-4c2f-9a5d-1aef3a9ccaa6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:36.268589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:36.268589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:36.268589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:36.268589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:36.268589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:36.268589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:36.268589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:36.268589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:36.268589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:36.268589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:36.268589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:36.268589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:36.268589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:36.268589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:36.268589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:36.269814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:36.269814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:36.269814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:36.269814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:36.269814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:36.269814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:36.269814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:36.269814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:36.269814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:36.269814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:36.269814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:36.269814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:36.269814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:36.269814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:36.269814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:36.269814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:36.270849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:36.270849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:36.270849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:36.270849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:36.270849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:36.270849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:36.270849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:36.270849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:36.270849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:36.270849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:36.270849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:36.270849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:36.280320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 297/606] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:36.280320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e3b26-d283-4c2f-9a5d-1aef3a9ccaa6 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:36.417313 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0d160-ac7f-4ad2-a0bd-9bb7d72c5550 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:36.464803 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:36.483181 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e3b26-d283-4c2f-9a5d-1aef3a9ccaa6 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:36.504234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ff787-75bb-4875-b75f-3daf4a75e700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:36.505319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ff787-75bb-4875-b75f-3daf4a75e700 None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:36.505868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ff787-75bb-4875-b75f-3daf4a75e700 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:36.506275 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ff787-75bb-4875-b75f-3daf4a75e700 None admin] PATH_INFO: `/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/51d2d1c76c3040dd9e57f83c3860e8fa/roles/8cf7b72483b94512b497317ab1d11192` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:36.512493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:36.539640 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ff787-75bb-4875-b75f-3daf4a75e700 None admin] RBAC: Authorizing `identity:create_grant(project_id=21118e9e4fa94603b2c0880dd0d5f5ba, user_id=51d2d1c76c3040dd9e57f83c3860e8fa, role_id=8cf7b72483b94512b497317ab1d11192)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:36.542534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d73e2-7e07-4264-af19-f94cb2b853c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:36.543124 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ff787-75bb-4875-b75f-3daf4a75e700 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:36.543543 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d73e2-7e07-4264-af19-f94cb2b853c7 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:36.543920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d73e2-7e07-4264-af19-f94cb2b853c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:36.544302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d73e2-7e07-4264-af19-f94cb2b853c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:36.557849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d73e2-7e07-4264-af19-f94cb2b853c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:36.562060 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d73e2-7e07-4264-af19-f94cb2b853c7 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:36.571299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 310/607] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:39:36 2022] PUT /identity/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/51d2d1c76c3040dd9e57f83c3860e8fa/roles/8cf7b72483b94512b497317ab1d11192 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:39:36.573390 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ff787-75bb-4875-b75f-3daf4a75e700 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:36.582434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-0c9d73e2-7e07-4264-af19-f94cb2b853c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:36.582434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:36.582434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:36.582434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:36.582434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:36.582434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:36.582434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:36.582434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:36.582434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:36.582434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:36.582434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:36.582434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:36.582434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:36.582434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:36.582434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:36.584625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:36.584625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:36.584625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:36.584625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:36.584625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:36.584625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:36.584625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:36.584625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:36.584625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:36.584625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:36.584625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:36.584625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:36.584625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:36.584625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:36.584625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:36.584625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:36.584625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:36.589772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:36.589772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:36.589772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:36.589772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:36.589772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:36.589772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:36.589772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:36.589772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:36.589772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 298/608] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:36.593331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d73e2-7e07-4264-af19-f94cb2b853c7 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:36.721785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d73e2-7e07-4264-af19-f94cb2b853c7 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:36.768213 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66ba2d-a8cc-47e5-806b-61d7c8146258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:36.768865 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66ba2d-a8cc-47e5-806b-61d7c8146258 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:36.769141 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66ba2d-a8cc-47e5-806b-61d7c8146258 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:36.769468 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66ba2d-a8cc-47e5-806b-61d7c8146258 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:36.770238 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66ba2d-a8cc-47e5-806b-61d7c8146258 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:36.770540 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66ba2d-a8cc-47e5-806b-61d7c8146258 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:36.772061 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66ba2d-a8cc-47e5-806b-61d7c8146258 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:36.788326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 299/609] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:36.794565 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66ba2d-a8cc-47e5-806b-61d7c8146258 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:36.838859 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:36.861269 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ff787-75bb-4875-b75f-3daf4a75e700 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:36.919520 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb7d25-111e-4a7b-bc04-2abcb4eb4b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:36.920416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb7d25-111e-4a7b-bc04-2abcb4eb4b6e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:36.920771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb7d25-111e-4a7b-bc04-2abcb4eb4b6e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:36.921561 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb7d25-111e-4a7b-bc04-2abcb4eb4b6e None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:36.922299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb7d25-111e-4a7b-bc04-2abcb4eb4b6e None admin] RBAC: Adding query filter params (name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:36.922449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb7d25-111e-4a7b-bc04-2abcb4eb4b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:36.924412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb7d25-111e-4a7b-bc04-2abcb4eb4b6e None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:36.938799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 311/610] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:39:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:36.946879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66ba2d-a8cc-47e5-806b-61d7c8146258 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:36.948847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb7d25-111e-4a7b-bc04-2abcb4eb4b6e None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:37.014252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b09cff-f0c6-4c0a-a039-ebac5f7bc16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:37.015110 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b09cff-f0c6-4c0a-a039-ebac5f7bc16c None admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:37.015404 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b09cff-f0c6-4c0a-a039-ebac5f7bc16c None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:37.015726 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b09cff-f0c6-4c0a-a039-ebac5f7bc16c None admin] PATH_INFO: `/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/a5814ac53752455697e050944b6d32b7/roles/8cf7b72483b94512b497317ab1d11192` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:37.016412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:37.036722 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b09cff-f0c6-4c0a-a039-ebac5f7bc16c None admin] RBAC: Authorizing `identity:create_grant(project_id=21118e9e4fa94603b2c0880dd0d5f5ba, user_id=a5814ac53752455697e050944b6d32b7, role_id=8cf7b72483b94512b497317ab1d11192)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:37.038856 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b09cff-f0c6-4c0a-a039-ebac5f7bc16c None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:37.059495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 300/611] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:39:36 2022] PUT /identity/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/a5814ac53752455697e050944b6d32b7/roles/8cf7b72483b94512b497317ab1d11192 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:39:37.061273 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f69ca-ec5c-44dc-bfca-96ae5eaea77b None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:37.062085 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f69ca-ec5c-44dc-bfca-96ae5eaea77b None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:37.062557 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f69ca-ec5c-44dc-bfca-96ae5eaea77b None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:37.066378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 301/612] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:37.075691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc62cc-850a-460a-b205-12ecb9a12069 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:37.076141 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc62cc-850a-460a-b205-12ecb9a12069 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:37.076688 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc62cc-850a-460a-b205-12ecb9a12069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:37.105105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-b6dc62cc-850a-460a-b205-12ecb9a12069 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:37.106939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-b6dc62cc-850a-460a-b205-12ecb9a12069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:37.171542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb7d25-111e-4a7b-bc04-2abcb4eb4b6e None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:37.237537 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 302/613] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:39:37.252681 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb8529-5b2f-40e6-9d89-75e7643b1a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:37.253390 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb8529-5b2f-40e6-9d89-75e7643b1a34 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:37.253682 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb8529-5b2f-40e6-9d89-75e7643b1a34 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:37.253959 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb8529-5b2f-40e6-9d89-75e7643b1a34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:37.268781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb8529-5b2f-40e6-9d89-75e7643b1a34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:37.270318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb8529-5b2f-40e6-9d89-75e7643b1a34 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:37.288474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-58fb8529-5b2f-40e6-9d89-75e7643b1a34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:37.288474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:37.288474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:37.288474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:37.288474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:37.288474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:37.288474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:37.288474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:37.288474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:37.288474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:37.288474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:37.288474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:37.288474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:37.288474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:37.288474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:37.288474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:37.290853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:37.290853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:37.290853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:37.290853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:37.290853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:37.290853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:37.290853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:37.290853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:37.290853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:37.290853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:37.290853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:37.290853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:37.290853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:37.290853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:37.290853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:37.290853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:37.290853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:37.292394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:37.292394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:37.292394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:37.292394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 312/614] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:37.299501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc62cc-850a-460a-b205-12ecb9a12069 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:37.331614 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:37.493495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc62cc-850a-460a-b205-12ecb9a12069 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:37.556431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d947db-b4e2-45dd-a442-15b2f0c494f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:37.557002 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d947db-b4e2-45dd-a442-15b2f0c494f7 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:37.557276 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d947db-b4e2-45dd-a442-15b2f0c494f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:37.557581 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d947db-b4e2-45dd-a442-15b2f0c494f7 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:37.558267 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d947db-b4e2-45dd-a442-15b2f0c494f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:37.558569 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d947db-b4e2-45dd-a442-15b2f0c494f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:37.560132 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d947db-b4e2-45dd-a442-15b2f0c494f7 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:37.577839 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 303/615] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:37.584148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb8529-5b2f-40e6-9d89-75e7643b1a34 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:37.619910 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d947db-b4e2-45dd-a442-15b2f0c494f7 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:37.777779 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:37.796990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:37.817571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb8529-5b2f-40e6-9d89-75e7643b1a34 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:37.851089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d947db-b4e2-45dd-a442-15b2f0c494f7 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:37.868442 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f62db-9107-4ba2-8c1b-10fe2552aad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:37.869109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f62db-9107-4ba2-8c1b-10fe2552aad3 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:37.869416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f62db-9107-4ba2-8c1b-10fe2552aad3 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:37.869688 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f62db-9107-4ba2-8c1b-10fe2552aad3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:37.884417 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f62db-9107-4ba2-8c1b-10fe2552aad3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:37.886414 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f62db-9107-4ba2-8c1b-10fe2552aad3 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:37.905002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-397f62db-9107-4ba2-8c1b-10fe2552aad3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:39:37.905002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:37.905002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:37.905002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:37.905002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:37.905002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:37.905002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:37.905002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:37.905002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:37.905002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:37.905002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:37.905002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:37.905002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:37.905002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:37.905002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:37.905002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:37.906049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:37.907189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:37.907189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:37.907189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:37.907189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:37.907189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:37.907189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:37.907189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:37.907189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:37.907189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:39:37.907189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:37.915032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 313/616] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:39:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:37.918424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f62db-9107-4ba2-8c1b-10fe2552aad3 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:37.935596 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3e886-e698-4730-9c69-0ec678b02fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:37.936249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3e886-e698-4730-9c69-0ec678b02fbb None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:37.936885 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3e886-e698-4730-9c69-0ec678b02fbb None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:37.937145 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3e886-e698-4730-9c69-0ec678b02fbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:37.963228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3e886-e698-4730-9c69-0ec678b02fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:37.968521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-60d3e886-e698-4730-9c69-0ec678b02fbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:37.968521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:37.968521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:37.968521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:37.968521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:37.968521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:37.968521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:37.968521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:37.968521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:37.968521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:37.968521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:37.968521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:37.968521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:37.968521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:37.968521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:37.968521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:37.970803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:37.970803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:37.970803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:37.970803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:37.970803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:37.970803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:37.970803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:37.970803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:37.970803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:37.970803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:37.970803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:37.970803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:37.970803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:37.970803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:37.970803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:37.970803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:37.972769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:37.972769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:37.972769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:37.972769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:37.972769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:37.972769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:37.972769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:37.972769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:37.972769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:37.972769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:37.972769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:37.972769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:37.972769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 304/617] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:39:37.980336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3e886-e698-4730-9c69-0ec678b02fbb None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:38.107091 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f62db-9107-4ba2-8c1b-10fe2552aad3 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:38.148484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480acc3d-997a-4a61-b989-6c099b18e3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:38.149117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480acc3d-997a-4a61-b989-6c099b18e3d8 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:38.149620 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480acc3d-997a-4a61-b989-6c099b18e3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:38.149896 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480acc3d-997a-4a61-b989-6c099b18e3d8 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:38.150654 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480acc3d-997a-4a61-b989-6c099b18e3d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:38.150959 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480acc3d-997a-4a61-b989-6c099b18e3d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:38.152402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480acc3d-997a-4a61-b989-6c099b18e3d8 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:38.189724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:38.199444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 314/618] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 12 23:39:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:38.202588 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3e886-e698-4730-9c69-0ec678b02fbb None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:38.205113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480acc3d-997a-4a61-b989-6c099b18e3d8 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:38.284195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c5edd-711b-408d-b581-b718132e764a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:38.284819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c5edd-711b-408d-b581-b718132e764a None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:38.285088 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c5edd-711b-408d-b581-b718132e764a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:38.285377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c5edd-711b-408d-b581-b718132e764a None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:38.286047 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c5edd-711b-408d-b581-b718132e764a None admin] RBAC: Adding query filter params (name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:38.286345 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c5edd-711b-408d-b581-b718132e764a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:38.287742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c5edd-711b-408d-b581-b718132e764a None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:38.294224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:38.310403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 305/619] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:39:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:38.316054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c5edd-711b-408d-b581-b718132e764a None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:38.435747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480acc3d-997a-4a61-b989-6c099b18e3d8 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:38.499948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f7b46-3a72-4d28-9da8-396e986f096a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:38.500678 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f7b46-3a72-4d28-9da8-396e986f096a None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:38.500952 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f7b46-3a72-4d28-9da8-396e986f096a None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:38.501216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f7b46-3a72-4d28-9da8-396e986f096a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:38.519116 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f7b46-3a72-4d28-9da8-396e986f096a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:38.523561 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f7b46-3a72-4d28-9da8-396e986f096a None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:38.543740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-928f7b46-3a72-4d28-9da8-396e986f096a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:38.543740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:38.543740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:38.543740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:38.543740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:38.543740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:38.543740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:38.543740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:38.543740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:38.543740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:38.543740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:38.543740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:38.543740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:38.543740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:38.543740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:38.543740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:38.544759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:38.544759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:38.544759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:38.544759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:38.544759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:38.544759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:38.544759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:38.544759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:38.544759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:38.544759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:38.544759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:38.544759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:38.544759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:38.544759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:38.544759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:38.544759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:38.544759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:38.545670 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:38.545670 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:38.545670 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:38.545670 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 315/620] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:39:38.551307 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c5edd-711b-408d-b581-b718132e764a None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:38.558485 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f7b46-3a72-4d28-9da8-396e986f096a None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:38.590445 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9fc4d-d1fa-4d53-891c-3e90ba42b2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:38.591109 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9fc4d-d1fa-4d53-891c-3e90ba42b2f6 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:38.591387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9fc4d-d1fa-4d53-891c-3e90ba42b2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:38.591660 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9fc4d-d1fa-4d53-891c-3e90ba42b2f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:38.603639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9fc4d-d1fa-4d53-891c-3e90ba42b2f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:38.605469 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9fc4d-d1fa-4d53-891c-3e90ba42b2f6 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:38.622338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-4cb9fc4d-d1fa-4d53-891c-3e90ba42b2f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:38.622338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:38.622338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:38.622338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:38.622338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:38.622338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:38.622338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:38.622338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:38.622338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:38.622338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:38.622338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:38.622338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:38.622338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:38.622338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:38.622338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:38.622338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:38.623359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:38.623359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:38.623359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:38.623359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:38.623359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:38.623359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:38.623359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:38.623359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:38.623359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:38.623359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:38.623359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:38.623359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:38.623359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:38.623359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:38.623359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:38.623359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:38.623359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:38.624259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:38.624259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:38.624259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:38.624259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 306/621] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:38.626040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58140d-fdd5-4106-9b66-319445cff69d None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:38.626040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58140d-fdd5-4106-9b66-319445cff69d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:38.626040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58140d-fdd5-4106-9b66-319445cff69d None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:38.627410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 307/622] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:38.631386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58140d-fdd5-4106-9b66-319445cff69d None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:38.675414 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:38.689663 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:38.758966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f7b46-3a72-4d28-9da8-396e986f096a None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:38.759500 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58140d-fdd5-4106-9b66-319445cff69d None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:38.805809 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b365d9-9d25-4681-9a80-6fa92c416d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:38.806791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b365d9-9d25-4681-9a80-6fa92c416d0c None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:38.807235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b365d9-9d25-4681-9a80-6fa92c416d0c None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:38.807610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b365d9-9d25-4681-9a80-6fa92c416d0c None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:38.807773 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36fb1f-7ddd-4e41-95ae-dce7743dbc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:38.808239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36fb1f-7ddd-4e41-95ae-dce7743dbc18 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:38.808513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36fb1f-7ddd-4e41-95ae-dce7743dbc18 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:38.808672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b365d9-9d25-4681-9a80-6fa92c416d0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:38.808827 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36fb1f-7ddd-4e41-95ae-dce7743dbc18 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:38.809161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b365d9-9d25-4681-9a80-6fa92c416d0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:38.809437 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36fb1f-7ddd-4e41-95ae-dce7743dbc18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:38.809737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36fb1f-7ddd-4e41-95ae-dce7743dbc18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:38.810869 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b365d9-9d25-4681-9a80-6fa92c416d0c None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:38.811095 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36fb1f-7ddd-4e41-95ae-dce7743dbc18 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:38.825144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 308/623] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:38.826624 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4561f6-6367-4274-bc19-463ba535950e None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:38.826906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4561f6-6367-4274-bc19-463ba535950e None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:38.827181 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4561f6-6367-4274-bc19-463ba535950e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:38.827679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 316/624] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:38.835288 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b365d9-9d25-4681-9a80-6fa92c416d0c None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:38.863862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-3e4561f6-6367-4274-bc19-463ba535950e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:38.866031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-3e4561f6-6367-4274-bc19-463ba535950e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:38.963466 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b365d9-9d25-4681-9a80-6fa92c416d0c None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:38.985455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:38.988392 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 309/625] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:38.989639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4561f6-6367-4274-bc19-463ba535950e None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:39.044210 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:39.055467 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a9967-d1ce-42a0-8cdb-49fd50a1606f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:39.056579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a9967-d1ce-42a0-8cdb-49fd50a1606f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:39.057069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a9967-d1ce-42a0-8cdb-49fd50a1606f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:39.057613 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a9967-d1ce-42a0-8cdb-49fd50a1606f None admin] PATH_INFO: `/v3/users/glance` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:39.081166 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a9967-d1ce-42a0-8cdb-49fd50a1606f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:39.083130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a9967-d1ce-42a0-8cdb-49fd50a1606f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:39.098393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-3b2a9967-d1ce-42a0-8cdb-49fd50a1606f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 12 23:39:39.098393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:39.098393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:39.098393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:39.098393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:39.098393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:39.098393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:39.098393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:39.098393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:39.098393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:39.098393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:39.098393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:39.098393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:39.098393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:39.098393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:39.098393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:39.099439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:39.100362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:39.100362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:39.100362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:39.100362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:39.100362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:39.100362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:39.100362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:39.100362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:39.100362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 12 23:39:39.100362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:39.103798 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 317/626] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:39:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:39.112561 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a9967-d1ce-42a0-8cdb-49fd50a1606f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:39.136310 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4561f6-6367-4274-bc19-463ba535950e None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:39.181966 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3306df-9074-4b1f-8cb6-02ca2fca48a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:39.182675 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3306df-9074-4b1f-8cb6-02ca2fca48a4 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:39.182954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3306df-9074-4b1f-8cb6-02ca2fca48a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:39.183224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3306df-9074-4b1f-8cb6-02ca2fca48a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:39.198779 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3306df-9074-4b1f-8cb6-02ca2fca48a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:39.200353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3306df-9074-4b1f-8cb6-02ca2fca48a4 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:39.221382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-df3306df-9074-4b1f-8cb6-02ca2fca48a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:39.221382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:39.221382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:39.221382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:39.221382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:39.221382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:39.221382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:39.221382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:39.221382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:39.221382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:39.221382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:39.221382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:39.221382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:39.221382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:39.221382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:39.222821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:39.222821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:39.222821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:39.222821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:39.222821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:39.222821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:39.222821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:39.222821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:39.222821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:39.222821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:39.222821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:39.222821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:39.222821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:39.222821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:39.222821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:39.222821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:39.222821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:39.223687 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:39.223687 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:39.223687 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:39.223687 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:39.223687 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:39.223687 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:39.223687 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:39.223687 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:39.223687 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 310/627] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:39.228746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3306df-9074-4b1f-8cb6-02ca2fca48a4 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:39.289379 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a9967-d1ce-42a0-8cdb-49fd50a1606f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:39.339144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:39.342445 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3306df-9074-4b1f-8cb6-02ca2fca48a4 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:39.353464 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af772bea-5292-4bba-8e54-a57814e2f78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:39.354502 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af772bea-5292-4bba-8e54-a57814e2f78e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:39.355026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af772bea-5292-4bba-8e54-a57814e2f78e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:39.355503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af772bea-5292-4bba-8e54-a57814e2f78e None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:39.356509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af772bea-5292-4bba-8e54-a57814e2f78e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:39.357077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af772bea-5292-4bba-8e54-a57814e2f78e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:39.358839 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af772bea-5292-4bba-8e54-a57814e2f78e None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:39.407692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae848b75-26ab-450b-a6ff-194bbd1cfa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:39.408341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae848b75-26ab-450b-a6ff-194bbd1cfa07 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:39.408612 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae848b75-26ab-450b-a6ff-194bbd1cfa07 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:39.408882 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae848b75-26ab-450b-a6ff-194bbd1cfa07 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:39.409468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 318/628] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 12 23:39:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:39.410167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae848b75-26ab-450b-a6ff-194bbd1cfa07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:39.410473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae848b75-26ab-450b-a6ff-194bbd1cfa07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:39.412053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae848b75-26ab-450b-a6ff-194bbd1cfa07 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:39.414768 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af772bea-5292-4bba-8e54-a57814e2f78e None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:39.450997 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 311/629] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:39.455747 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae848b75-26ab-450b-a6ff-194bbd1cfa07 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:39.486406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:39.627622 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae848b75-26ab-450b-a6ff-194bbd1cfa07 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:39.662081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af772bea-5292-4bba-8e54-a57814e2f78e None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:39.675555 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c4709-879d-4f02-ae73-bba5edf9a33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:39.676655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c4709-879d-4f02-ae73-bba5edf9a33d None admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:39.677129 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c4709-879d-4f02-ae73-bba5edf9a33d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:39.677657 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c4709-879d-4f02-ae73-bba5edf9a33d None admin] PATH_INFO: `/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/43c45ae3144b4fe8ab4e921fda30164a/roles/8cf7b72483b94512b497317ab1d11192` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:39.705084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c4709-879d-4f02-ae73-bba5edf9a33d None admin] RBAC: Authorizing `identity:create_grant(project_id=21118e9e4fa94603b2c0880dd0d5f5ba, user_id=43c45ae3144b4fe8ab4e921fda30164a, role_id=8cf7b72483b94512b497317ab1d11192)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:39.707861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c4709-879d-4f02-ae73-bba5edf9a33d None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:39.710475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f225d-9dd4-4b78-a7cb-91154e871821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:39.711243 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f225d-9dd4-4b78-a7cb-91154e871821 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:39.711644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f225d-9dd4-4b78-a7cb-91154e871821 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:39.712318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f225d-9dd4-4b78-a7cb-91154e871821 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:39.731327 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 312/630] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:39:39 2022] PUT /identity/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/43c45ae3144b4fe8ab4e921fda30164a/roles/8cf7b72483b94512b497317ab1d11192 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:39:39.732860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c4709-879d-4f02-ae73-bba5edf9a33d None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:39.765544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:39.875060 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f225d-9dd4-4b78-a7cb-91154e871821 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:39.877770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f225d-9dd4-4b78-a7cb-91154e871821 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:39.937678 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:39.944992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c4709-879d-4f02-ae73-bba5edf9a33d None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:39.997486 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0609a25-f39a-4b9f-8177-b120723d51fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:39.998154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0609a25-f39a-4b9f-8177-b120723d51fc None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:39.998520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0609a25-f39a-4b9f-8177-b120723d51fc None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:39.998804 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0609a25-f39a-4b9f-8177-b120723d51fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:40.011633 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0609a25-f39a-4b9f-8177-b120723d51fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:40.016757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-e0609a25-f39a-4b9f-8177-b120723d51fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:40.016757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:40.016757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:40.016757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:40.016757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:40.016757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:40.016757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:40.016757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:40.016757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:40.016757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:40.016757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:40.016757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:40.016757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:40.016757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:40.016757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:40.016757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:40.018506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:40.018506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:40.018506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:40.018506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:40.018506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:40.018506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:40.018506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:40.018506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:40.018506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:40.018506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:40.018506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:40.018506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:40.018506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:40.018506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:40.018506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:40.018506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:40.020096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:40.020096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:40.020096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:40.020096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:40.020096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:40.020096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:40.020096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:40.020096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:40.020096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:40.020096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:40.020096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:40.020096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:40.020096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 313/631] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:40.020096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18163f2d-2f3b-4c37-9d85-57d6a01b2dcf None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:40.021564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18163f2d-2f3b-4c37-9d85-57d6a01b2dcf None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:40.021564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18163f2d-2f3b-4c37-9d85-57d6a01b2dcf None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:40.022788 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 314/632] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:40.023750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f352067-e6fc-423f-abc0-4e94019ffc50 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:40.023750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f352067-e6fc-423f-abc0-4e94019ffc50 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:40.023750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f352067-e6fc-423f-abc0-4e94019ffc50 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:40.033417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 315/633] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:40.033417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12ec29-bac1-475c-a16d-78aea5153f7f None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:40.033417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12ec29-bac1-475c-a16d-78aea5153f7f None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:40.033417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12ec29-bac1-475c-a16d-78aea5153f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:40.058846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-5b12ec29-bac1-475c-a16d-78aea5153f7f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:40.060108 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5b12ec29-bac1-475c-a16d-78aea5153f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:40.074464 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 319/634] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 23:39:40.076960 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97006c4-ecb1-4cc9-9c4c-ee587354b132 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:40.078148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97006c4-ecb1-4cc9-9c4c-ee587354b132 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:40.078954 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97006c4-ecb1-4cc9-9c4c-ee587354b132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:40.104985 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-c97006c4-ecb1-4cc9-9c4c-ee587354b132 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:40.106337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c97006c4-ecb1-4cc9-9c4c-ee587354b132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:40.140399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:40.146406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 316/635] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:40.147281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12ec29-bac1-475c-a16d-78aea5153f7f None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:40.224461 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 320/636] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:40.225987 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97006c4-ecb1-4cc9-9c4c-ee587354b132 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:40.427733 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:40.435127 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12ec29-bac1-475c-a16d-78aea5153f7f None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:40.509269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f4f4e-9b1e-438a-a605-d5a71feb9c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:40.509935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f4f4e-9b1e-438a-a605-d5a71feb9c70 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:40.510218 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f4f4e-9b1e-438a-a605-d5a71feb9c70 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:40.510490 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f4f4e-9b1e-438a-a605-d5a71feb9c70 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:40.511183 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f4f4e-9b1e-438a-a605-d5a71feb9c70 None admin] RBAC: Adding query filter params (name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:40.511485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f4f4e-9b1e-438a-a605-d5a71feb9c70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:40.514672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97006c4-ecb1-4cc9-9c4c-ee587354b132 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:40.516704 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f4f4e-9b1e-438a-a605-d5a71feb9c70 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:40.535098 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 317/637] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:39:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:40.540582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f4f4e-9b1e-438a-a605-d5a71feb9c70 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:40.587143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2177bb9-bf8e-42d5-a8ec-02b3947fc6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:40.587801 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2177bb9-bf8e-42d5-a8ec-02b3947fc6af None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:40.588081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2177bb9-bf8e-42d5-a8ec-02b3947fc6af None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:40.588352 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2177bb9-bf8e-42d5-a8ec-02b3947fc6af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:40.605911 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2177bb9-bf8e-42d5-a8ec-02b3947fc6af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:40.607424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2177bb9-bf8e-42d5-a8ec-02b3947fc6af None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:40.624151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-a2177bb9-bf8e-42d5-a8ec-02b3947fc6af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:40.624151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:40.624151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:40.624151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:40.624151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:40.624151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:40.624151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:40.624151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:40.624151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:40.624151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:40.624151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:40.624151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:40.624151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:40.624151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:40.624151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:40.624151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:40.625217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:40.625217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:40.625217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:40.625217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:40.625217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:40.625217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:40.625217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:40.625217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:40.625217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:40.625217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:40.625217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:40.625217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:40.625217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:40.625217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:40.625217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:40.625217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:40.625217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:40.626441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:40.626441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:40.626441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:40.626441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 321/638] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:40.626781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2177bb9-bf8e-42d5-a8ec-02b3947fc6af None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:40.656413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:40.731909 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f4f4e-9b1e-438a-a605-d5a71feb9c70 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:40.790955 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbda683-03b0-4ffc-892c-5eaa8d700a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:40.792071 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbda683-03b0-4ffc-892c-5eaa8d700a33 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:40.792433 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2177bb9-bf8e-42d5-a8ec-02b3947fc6af None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:40.792567 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbda683-03b0-4ffc-892c-5eaa8d700a33 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:40.792988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbda683-03b0-4ffc-892c-5eaa8d700a33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:40.814398 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbda683-03b0-4ffc-892c-5eaa8d700a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:40.817079 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:40.817268 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbda683-03b0-4ffc-892c-5eaa8d700a33 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:40.844222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-0dbda683-03b0-4ffc-892c-5eaa8d700a33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:40.844222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:40.844222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:40.844222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:40.844222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:40.844222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:40.844222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:40.844222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:40.844222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:40.844222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:40.844222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:40.844222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:40.844222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:40.844222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:40.844222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:40.844222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:40.845272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:40.845272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:40.845272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:40.845272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:40.845272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:40.845272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:40.845272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:40.845272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:40.845272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:40.845272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:40.845272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:40.845272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:40.845272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:40.845272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:40.845272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:40.845272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:40.845272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:40.846320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:40.846320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:40.846320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:40.846320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 318/639] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:39:40.847636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbda683-03b0-4ffc-892c-5eaa8d700a33 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:40.863187 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b015e73-ecfe-44c0-8800-48325080550a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:40.863874 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b015e73-ecfe-44c0-8800-48325080550a None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:40.864155 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b015e73-ecfe-44c0-8800-48325080550a None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:40.864437 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b015e73-ecfe-44c0-8800-48325080550a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:40.878905 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b015e73-ecfe-44c0-8800-48325080550a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:40.884360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-6b015e73-ecfe-44c0-8800-48325080550a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:40.884360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:40.884360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:40.884360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:40.884360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:40.884360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:40.884360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:40.884360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:40.884360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:40.884360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:40.884360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:40.884360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:40.884360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:40.884360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:40.884360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:40.884360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:40.886274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:40.886274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:40.886274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:40.886274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:40.886274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:40.886274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:40.886274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:40.886274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:40.886274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:40.886274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:40.886274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:40.886274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:40.886274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:40.886274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:40.886274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:40.886274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:40.887610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:40.887610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:40.887610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:40.887610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:40.887610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:40.887610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:40.887610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:40.887610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:40.887610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:40.887610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:40.887610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:40.887610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:40.887610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 322/640] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:40.887610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b015e73-ecfe-44c0-8800-48325080550a None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:41.024759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b015e73-ecfe-44c0-8800-48325080550a None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:41.058276 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbda683-03b0-4ffc-892c-5eaa8d700a33 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:41.065684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a4f7c-6c43-472d-ba32-a5a9acf58704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:41.066328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a4f7c-6c43-472d-ba32-a5a9acf58704 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:41.066608 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a4f7c-6c43-472d-ba32-a5a9acf58704 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:41.066883 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a4f7c-6c43-472d-ba32-a5a9acf58704 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:41.067549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a4f7c-6c43-472d-ba32-a5a9acf58704 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:41.067852 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a4f7c-6c43-472d-ba32-a5a9acf58704 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:41.069283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a4f7c-6c43-472d-ba32-a5a9acf58704 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:41.085229 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:41.097572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 323/641] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:41.097572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a4f7c-6c43-472d-ba32-a5a9acf58704 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:41.125993 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81208a2-44ac-4e0c-8c0c-5be8ea66e8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:41.127007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81208a2-44ac-4e0c-8c0c-5be8ea66e8e5 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:41.127405 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81208a2-44ac-4e0c-8c0c-5be8ea66e8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:41.127847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81208a2-44ac-4e0c-8c0c-5be8ea66e8e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:41.144874 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81208a2-44ac-4e0c-8c0c-5be8ea66e8e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:41.149703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:41.153946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-a81208a2-44ac-4e0c-8c0c-5be8ea66e8e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:41.153946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:41.153946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:41.153946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:41.153946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:41.153946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:41.153946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:41.153946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:41.153946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:41.153946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:41.153946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:41.153946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:41.153946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:41.153946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:41.153946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:41.153946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:41.155854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:41.155854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:41.155854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:41.155854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:41.155854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:41.155854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:41.155854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:41.155854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:41.155854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:41.155854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:41.155854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:41.155854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:41.155854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:41.155854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:41.155854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:41.155854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:41.158448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:41.158448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:41.158448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:41.158448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:41.158448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:41.158448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:41.158448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:41.158448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:41.158448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:41.158448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:41.158448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:41.158448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:41.158448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 319/642] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:41.158448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81208a2-44ac-4e0c-8c0c-5be8ea66e8e5 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:41.259914 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a4f7c-6c43-472d-ba32-a5a9acf58704 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:41.308789 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a833-9ed0-4243-95ca-4abf983be711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:41.309299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a833-9ed0-4243-95ca-4abf983be711 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:41.309641 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a833-9ed0-4243-95ca-4abf983be711 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:41.309882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70a833-9ed0-4243-95ca-4abf983be711 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:41.310540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70a833-9ed0-4243-95ca-4abf983be711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:41.310845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70a833-9ed0-4243-95ca-4abf983be711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:41.312843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70a833-9ed0-4243-95ca-4abf983be711 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:41.331175 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81208a2-44ac-4e0c-8c0c-5be8ea66e8e5 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:41.342679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 324/643] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:41.342679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a833-9ed0-4243-95ca-4abf983be711 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:41.378742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b8619-04fb-44c9-b431-c646128d3cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:41.379364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b8619-04fb-44c9-b431-c646128d3cf3 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:41.379642 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b8619-04fb-44c9-b431-c646128d3cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:41.379915 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b8619-04fb-44c9-b431-c646128d3cf3 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:41.380604 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b8619-04fb-44c9-b431-c646128d3cf3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:41.380906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b8619-04fb-44c9-b431-c646128d3cf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:41.382376 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b8619-04fb-44c9-b431-c646128d3cf3 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:41.391752 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 320/644] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:39:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:41.392647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b8619-04fb-44c9-b431-c646128d3cf3 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:41.439541 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:41.473696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:41.486689 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70a833-9ed0-4243-95ca-4abf983be711 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:41.526865 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b8619-04fb-44c9-b431-c646128d3cf3 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:41.541299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32092b-4e9c-481f-af10-2d77dc420ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:41.542703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32092b-4e9c-481f-af10-2d77dc420ad8 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:41.543207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32092b-4e9c-481f-af10-2d77dc420ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:41.543578 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32092b-4e9c-481f-af10-2d77dc420ad8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:41.556320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32092b-4e9c-481f-af10-2d77dc420ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:41.559246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32092b-4e9c-481f-af10-2d77dc420ad8 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:41.567274 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf143d3f-d523-4ff0-bde6-4d6bd9d9d47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:41.567898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143d3f-d523-4ff0-bde6-4d6bd9d9d47e None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:41.568179 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143d3f-d523-4ff0-bde6-4d6bd9d9d47e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:41.568457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143d3f-d523-4ff0-bde6-4d6bd9d9d47e None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:41.569111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf143d3f-d523-4ff0-bde6-4d6bd9d9d47e None admin] RBAC: Adding query filter params (name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:41.569443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf143d3f-d523-4ff0-bde6-4d6bd9d9d47e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:41.571030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf143d3f-d523-4ff0-bde6-4d6bd9d9d47e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:41.580893 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 321/645] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:39:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:41.581285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-5f32092b-4e9c-481f-af10-2d77dc420ad8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:41.581285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:41.581285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:41.581285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:41.581285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:41.581285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:41.581285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:41.581285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:41.581285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:41.581285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:41.581285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:41.581285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:41.581285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:41.581285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:41.581285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:41.582383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:41.582383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:41.582383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:41.582383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:41.582383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:41.582383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:41.582383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:41.582383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:41.582383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:41.582383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:41.582383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:41.582383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:41.582383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:41.582383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:41.582383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:41.582383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:41.582383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:41.583787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:41.583787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:41.583787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:41.583787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:41.583787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:41.583787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:41.583787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:41.583787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:41.586710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf143d3f-d523-4ff0-bde6-4d6bd9d9d47e None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:41.590844 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 325/646] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:41.592461 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32092b-4e9c-481f-af10-2d77dc420ad8 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:41.717133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:41.723290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf143d3f-d523-4ff0-bde6-4d6bd9d9d47e None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:41.737706 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32092b-4e9c-481f-af10-2d77dc420ad8 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:41.779192 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b728d-04aa-49e4-bfee-023ee71f487c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:41.779848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b728d-04aa-49e4-bfee-023ee71f487c None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:41.780121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b728d-04aa-49e4-bfee-023ee71f487c None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:41.780389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b728d-04aa-49e4-bfee-023ee71f487c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:41.794347 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b728d-04aa-49e4-bfee-023ee71f487c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:41.796119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b728d-04aa-49e4-bfee-023ee71f487c None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:41.799176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9067c8a-ed46-487e-923f-42bff8cd0c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:41.800850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9067c8a-ed46-487e-923f-42bff8cd0c69 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:41.801366 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9067c8a-ed46-487e-923f-42bff8cd0c69 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:41.801879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9067c8a-ed46-487e-923f-42bff8cd0c69 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:41.814174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-306b728d-04aa-49e4-bfee-023ee71f487c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:41.814174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:41.814174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:41.814174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:41.814174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:41.814174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:41.814174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:41.814174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:41.814174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:41.814174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:41.814174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:41.814174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:41.814174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:41.814174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:41.814174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:41.814174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:41.815499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:41.815499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:41.815499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:41.815499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:41.815499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:41.815499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:41.815499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:41.815499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:41.815499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:41.815499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:41.815499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:41.815499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:41.815499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:41.815499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:41.815499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:41.815499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:41.815499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:41.816696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:41.816696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:41.816696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:41.819349 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9067c8a-ed46-487e-923f-42bff8cd0c69 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:41.820000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 326/647] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:41.820746 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b728d-04aa-49e4-bfee-023ee71f487c None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:41.822302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9067c8a-ed46-487e-923f-42bff8cd0c69 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:41.823898 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:41.844638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-d9067c8a-ed46-487e-923f-42bff8cd0c69 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:39:41.844638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:41.844638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:41.844638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:41.844638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:41.844638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:41.844638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:41.844638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:41.844638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:41.844638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:41.844638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:41.844638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:41.844638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:41.844638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:41.844638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:41.844638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:41.845953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:41.846884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:41.846884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:41.846884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:41.846884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:41.846884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:41.846884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:41.846884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:41.846884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:41.846884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:39:41.846884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:41.846884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 322/648] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 23:39:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:41.848273 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9067c8a-ed46-487e-923f-42bff8cd0c69 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:41.962039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9067c8a-ed46-487e-923f-42bff8cd0c69 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:41.969283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b728d-04aa-49e4-bfee-023ee71f487c None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:42.005778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02aa38-69bd-41c4-8f83-68cc8dc309f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:42.006789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02aa38-69bd-41c4-8f83-68cc8dc309f9 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:42.007160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02aa38-69bd-41c4-8f83-68cc8dc309f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:42.007427 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02aa38-69bd-41c4-8f83-68cc8dc309f9 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:42.008140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02aa38-69bd-41c4-8f83-68cc8dc309f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:42.008447 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02aa38-69bd-41c4-8f83-68cc8dc309f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:42.009021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707e939-d740-4519-b05a-eaf137abde56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:42.009704 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e939-d740-4519-b05a-eaf137abde56 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:42.009940 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02aa38-69bd-41c4-8f83-68cc8dc309f9 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:42.010090 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e939-d740-4519-b05a-eaf137abde56 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:42.010237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e939-d740-4519-b05a-eaf137abde56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:42.023495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707e939-d740-4519-b05a-eaf137abde56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:42.024988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707e939-d740-4519-b05a-eaf137abde56 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:42.028633 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 323/649] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:42.029409 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02aa38-69bd-41c4-8f83-68cc8dc309f9 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:42.044494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-e707e939-d740-4519-b05a-eaf137abde56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:42.044494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:42.044494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:42.044494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:42.044494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:42.044494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:42.044494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:42.044494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:42.044494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:42.044494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:42.044494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:42.044494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:42.044494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:42.044494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:42.044494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:42.044494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:42.053930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:42.053930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:42.053930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:42.053930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:42.053930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:42.053930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:42.053930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:42.053930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:42.053930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:42.053930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:42.053930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:42.053930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:42.053930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:42.053930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:42.053930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:42.053930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:42.053930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:42.055788 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:42.055788 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:42.055788 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:42.055788 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 327/650] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:42.055788 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707e939-d740-4519-b05a-eaf137abde56 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:42.057969 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:42.122189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:42.155924 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02aa38-69bd-41c4-8f83-68cc8dc309f9 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:42.193807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707e939-d740-4519-b05a-eaf137abde56 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:42.194872 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fcd6f-5afd-46c7-bff5-78e19d1b02e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:42.195503 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fcd6f-5afd-46c7-bff5-78e19d1b02e0 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:42.195835 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fcd6f-5afd-46c7-bff5-78e19d1b02e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:42.196105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fcd6f-5afd-46c7-bff5-78e19d1b02e0 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:42.197235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fcd6f-5afd-46c7-bff5-78e19d1b02e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:42.198823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fcd6f-5afd-46c7-bff5-78e19d1b02e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:42.200684 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fcd6f-5afd-46c7-bff5-78e19d1b02e0 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:42.228959 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 324/651] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:42.228959 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fcd6f-5afd-46c7-bff5-78e19d1b02e0 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:42.258287 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c6bc1-52a8-47c1-87b2-ddab4e2b8d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:42.259235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c6bc1-52a8-47c1-87b2-ddab4e2b8d50 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:42.259685 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c6bc1-52a8-47c1-87b2-ddab4e2b8d50 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:42.260133 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c6bc1-52a8-47c1-87b2-ddab4e2b8d50 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:42.261399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c6bc1-52a8-47c1-87b2-ddab4e2b8d50 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:42.261835 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c6bc1-52a8-47c1-87b2-ddab4e2b8d50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:42.264109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c6bc1-52a8-47c1-87b2-ddab4e2b8d50 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:42.284126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 328/652] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 23:39:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:42.284986 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c6bc1-52a8-47c1-87b2-ddab4e2b8d50 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:42.334671 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:42.359132 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fcd6f-5afd-46c7-bff5-78e19d1b02e0 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:42.395309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daa464-5a18-495e-91ed-e8f442d17f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:42.395841 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daa464-5a18-495e-91ed-e8f442d17f58 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:42.396122 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daa464-5a18-495e-91ed-e8f442d17f58 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:42.396398 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9daa464-5a18-495e-91ed-e8f442d17f58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:42.397131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9daa464-5a18-495e-91ed-e8f442d17f58 None admin] RBAC: Adding query filter params (role.id=8cf7b72483b94512b497317ab1d11192, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=9d21a0c72223417d92e3d8b30ef6bc3e) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:42.397479 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9daa464-5a18-495e-91ed-e8f442d17f58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:42.399601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9daa464-5a18-495e-91ed-e8f442d17f58 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:42.407458 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 325/653] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:39:42 2022] GET /identity/v3/role_assignments?user.id=9d21a0c72223417d92e3d8b30ef6bc3e&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=8cf7b72483b94512b497317ab1d11192 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:42.408425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daa464-5a18-495e-91ed-e8f442d17f58 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:42.411991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c6bc1-52a8-47c1-87b2-ddab4e2b8d50 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:42.428672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:42.457621 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047571d-6b9f-4ce0-b154-a3c3f40c5d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:42.458260 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047571d-6b9f-4ce0-b154-a3c3f40c5d0f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:42.458539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047571d-6b9f-4ce0-b154-a3c3f40c5d0f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:42.459487 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047571d-6b9f-4ce0-b154-a3c3f40c5d0f None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:42.459487 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047571d-6b9f-4ce0-b154-a3c3f40c5d0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:42.459807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047571d-6b9f-4ce0-b154-a3c3f40c5d0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:42.461196 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047571d-6b9f-4ce0-b154-a3c3f40c5d0f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:42.480476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 329/654] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:42.480476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2ab77-d7f2-490d-a0b9-c06d4f507f11 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:42.480476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2ab77-d7f2-490d-a0b9-c06d4f507f11 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:42.480476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2ab77-d7f2-490d-a0b9-c06d4f507f11 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:42.480476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 330/655] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:42.480476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2ab77-d7f2-490d-a0b9-c06d4f507f11 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:42.551637 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9daa464-5a18-495e-91ed-e8f442d17f58 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:42.596169 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7e21d-0a9d-489b-82da-9f931288ad61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:42.596858 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7e21d-0a9d-489b-82da-9f931288ad61 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:42.597138 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7e21d-0a9d-489b-82da-9f931288ad61 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:42.597441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7e21d-0a9d-489b-82da-9f931288ad61 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:42.606788 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7e21d-0a9d-489b-82da-9f931288ad61 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:42.608332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7e21d-0a9d-489b-82da-9f931288ad61 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:42.621217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-2ae7e21d-0a9d-489b-82da-9f931288ad61 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 23:39:42.621217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:42.621217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:42.621217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:42.621217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:42.621217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:42.621217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:42.621217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:42.621217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:42.621217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:42.621217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:42.621217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:42.621217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:42.621217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:42.621217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:42.621217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:42.623042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:42.625402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:42.625402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:42.625402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:42.625402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:42.625402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:42.625402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:42.625402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:42.625402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:42.625402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 23:39:42.625402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:42.625402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 326/656] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:39:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:42.625402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7e21d-0a9d-489b-82da-9f931288ad61 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:42.637228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:42.643260 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2ab77-d7f2-490d-a0b9-c06d4f507f11 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:42.693217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678d937-df7a-4446-9381-74244a6cf7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:42.693828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678d937-df7a-4446-9381-74244a6cf7fa None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:42.694104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678d937-df7a-4446-9381-74244a6cf7fa None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:42.694378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678d937-df7a-4446-9381-74244a6cf7fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:42.747500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:42.794135 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678d937-df7a-4446-9381-74244a6cf7fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:42.796273 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678d937-df7a-4446-9381-74244a6cf7fa None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:42.797455 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7e21d-0a9d-489b-82da-9f931288ad61 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:42.837183 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99e97e-d04a-425e-882e-911655b56b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:42.837870 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99e97e-d04a-425e-882e-911655b56b27 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:42.838148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99e97e-d04a-425e-882e-911655b56b27 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:42.838416 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99e97e-d04a-425e-882e-911655b56b27 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:42.847598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99e97e-d04a-425e-882e-911655b56b27 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:42.849079 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99e97e-d04a-425e-882e-911655b56b27 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:42.865070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-7d99e97e-d04a-425e-882e-911655b56b27 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 23:39:42.865070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:42.865070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:42.865070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:42.865070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:42.865070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:42.865070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:42.865070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:42.865070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:42.865070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:42.865070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:42.865070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:42.865070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:42.865070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:42.865070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:42.865070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:42.866297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:42.867252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:42.867252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:42.867252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:42.867252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:42.867252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:42.867252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:42.867252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:42.867252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:42.867252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 12 23:39:42.867252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:42.869672 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 327/657] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:42.871353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f8eb9-7fed-4ac5-af7c-841645e46ec2 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:42.872479 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f8eb9-7fed-4ac5-af7c-841645e46ec2 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:42.872985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f8eb9-7fed-4ac5-af7c-841645e46ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:42.896440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-818f8eb9-7fed-4ac5-af7c-841645e46ec2 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:42.897927 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-818f8eb9-7fed-4ac5-af7c-841645e46ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:42.971337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:42.979263 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 331/658] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:39:42.980255 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678d937-df7a-4446-9381-74244a6cf7fa None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:42.992377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 328/659] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:42.993643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f8eb9-7fed-4ac5-af7c-841645e46ec2 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:43.103690 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:43.133595 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f8eb9-7fed-4ac5-af7c-841645e46ec2 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:43.146976 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678d937-df7a-4446-9381-74244a6cf7fa None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:43.182151 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb607c3a-8b70-404a-8a38-e1d1798856cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:43.183391 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb607c3a-8b70-404a-8a38-e1d1798856cf None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:43.184290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb607c3a-8b70-404a-8a38-e1d1798856cf None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:43.185018 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb607c3a-8b70-404a-8a38-e1d1798856cf None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:43.186025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb607c3a-8b70-404a-8a38-e1d1798856cf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:43.186874 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb607c3a-8b70-404a-8a38-e1d1798856cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:43.188577 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb607c3a-8b70-404a-8a38-e1d1798856cf None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:43.189161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb58b7-9f85-4de6-aee4-d587f1a3c70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:43.189938 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb58b7-9f85-4de6-aee4-d587f1a3c70b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:43.190284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb58b7-9f85-4de6-aee4-d587f1a3c70b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:43.190622 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb58b7-9f85-4de6-aee4-d587f1a3c70b None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:43.191487 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb58b7-9f85-4de6-aee4-d587f1a3c70b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:43.191808 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb58b7-9f85-4de6-aee4-d587f1a3c70b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:43.193586 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb58b7-9f85-4de6-aee4-d587f1a3c70b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:43.213114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 329/660] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Sep 12 23:39:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:43.213503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 332/661] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 12 23:39:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:43.214567 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb607c3a-8b70-404a-8a38-e1d1798856cf None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:43.218405 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb58b7-9f85-4de6-aee4-d587f1a3c70b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:43.281784 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:43.336415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb607c3a-8b70-404a-8a38-e1d1798856cf None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:43.350552 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb58b7-9f85-4de6-aee4-d587f1a3c70b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:43.389879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4ed48-d1fe-401d-a2f0-2b31808f4360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:43.391006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4ed48-d1fe-401d-a2f0-2b31808f4360 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:43.391449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4ed48-d1fe-401d-a2f0-2b31808f4360 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:43.391891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4ed48-d1fe-401d-a2f0-2b31808f4360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:43.404468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:43.414355 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4ed48-d1fe-401d-a2f0-2b31808f4360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:43.414836 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77d93e-d98a-4502-9a6b-35b58d8b5187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:43.415526 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77d93e-d98a-4502-9a6b-35b58d8b5187 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:43.415883 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77d93e-d98a-4502-9a6b-35b58d8b5187 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:43.416156 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77d93e-d98a-4502-9a6b-35b58d8b5187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:43.416689 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4ed48-d1fe-401d-a2f0-2b31808f4360 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:43.434815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-e0c4ed48-d1fe-401d-a2f0-2b31808f4360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:43.434815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:43.434815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:43.434815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:43.434815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:43.434815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:43.434815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:43.434815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:43.434815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:43.434815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:43.434815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:43.434815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:43.434815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:43.434815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:43.434815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:43.434815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:43.437006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:43.437006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:43.437006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:43.437006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:43.437006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:43.437006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:43.437006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:43.437006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:43.437006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:43.437006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:43.437006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:43.437006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:43.437006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:43.437006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:43.437006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:43.437006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:43.437006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:43.439339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:43.439339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:43.439339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:43.441366 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 330/662] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:43.442378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4ed48-d1fe-401d-a2f0-2b31808f4360 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:43.517982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77d93e-d98a-4502-9a6b-35b58d8b5187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:43.519548 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77d93e-d98a-4502-9a6b-35b58d8b5187 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:43.591382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4ed48-d1fe-401d-a2f0-2b31808f4360 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:43.594303 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:43.632947 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7beba3-bc59-4a7d-8a46-2f4a79a3e0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:43.633724 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7beba3-bc59-4a7d-8a46-2f4a79a3e0b1 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:43.633995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7beba3-bc59-4a7d-8a46-2f4a79a3e0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:43.634258 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7beba3-bc59-4a7d-8a46-2f4a79a3e0b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:43.671934 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 333/663] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:39:43.673223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77d93e-d98a-4502-9a6b-35b58d8b5187 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:43.715512 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7beba3-bc59-4a7d-8a46-2f4a79a3e0b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:43.717027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7beba3-bc59-4a7d-8a46-2f4a79a3e0b1 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:43.730818 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:43.831272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77d93e-d98a-4502-9a6b-35b58d8b5187 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:43.844674 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 331/664] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:39:43.844674 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7beba3-bc59-4a7d-8a46-2f4a79a3e0b1 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:43.844674 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:43.879326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f108c-9391-4b68-932f-fd40bb61a9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:43.880093 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f108c-9391-4b68-932f-fd40bb61a9df None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:43.880374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f108c-9391-4b68-932f-fd40bb61a9df None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:43.880644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f108c-9391-4b68-932f-fd40bb61a9df None admin] PATH_INFO: `/v3/roles/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:43.893880 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f108c-9391-4b68-932f-fd40bb61a9df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:43.898963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-a98f108c-9391-4b68-932f-fd40bb61a9df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:43.898963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:43.898963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:43.898963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:43.898963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:43.898963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:43.898963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:43.898963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:43.898963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:43.898963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:43.898963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:43.898963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:43.898963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:43.898963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:43.898963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:43.898963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:43.899963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:43.899963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:43.899963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:43.899963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:43.899963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:43.899963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:43.899963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:43.899963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:43.899963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:43.899963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:43.899963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:43.899963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:43.899963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:43.899963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:43.899963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:43.899963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:43.901055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:43.901055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:43.901055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:43.901055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:43.901055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:43.901055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:43.901055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:43.901055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:43.901055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:43.901055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:43.901055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:43.901055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:43.901055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 334/665] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:43.902390 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f108c-9391-4b68-932f-fd40bb61a9df None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:44.005769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7beba3-bc59-4a7d-8a46-2f4a79a3e0b1 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:44.031981 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:44.049509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f108c-9391-4b68-932f-fd40bb61a9df None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:44.071960 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5258f-b178-4a5c-8a52-c6bb9771b78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:44.072970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5258f-b178-4a5c-8a52-c6bb9771b78e None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:44.073455 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5258f-b178-4a5c-8a52-c6bb9771b78e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:44.073932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5258f-b178-4a5c-8a52-c6bb9771b78e None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:44.075088 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5258f-b178-4a5c-8a52-c6bb9771b78e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:44.075647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5258f-b178-4a5c-8a52-c6bb9771b78e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:44.078256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5258f-b178-4a5c-8a52-c6bb9771b78e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:44.097076 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 332/666] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:44.097606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38ceca-0246-4058-8783-b34528eb4518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:44.098470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38ceca-0246-4058-8783-b34528eb4518 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:44.098571 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5258f-b178-4a5c-8a52-c6bb9771b78e None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:44.098950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38ceca-0246-4058-8783-b34528eb4518 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:44.099377 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38ceca-0246-4058-8783-b34528eb4518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:44.121043 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38ceca-0246-4058-8783-b34528eb4518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:44.123641 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38ceca-0246-4058-8783-b34528eb4518 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:44.148456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-7d38ceca-0246-4058-8783-b34528eb4518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:44.148456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:44.148456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:44.148456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:44.148456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:44.148456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:44.148456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:44.148456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:44.148456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:44.148456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:44.148456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:44.148456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:44.148456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:44.148456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:44.148456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:44.148456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:44.150350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:44.150350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:44.150350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:44.150350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:44.150350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:44.150350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:44.150350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:44.150350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:44.150350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:44.150350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:44.150350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:44.150350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:44.150350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:44.150350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:44.150350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:44.150350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:44.150350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:44.152085 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:44.152085 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:44.152085 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:44.152085 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 335/667] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:44.152085 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38ceca-0246-4058-8783-b34528eb4518 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:44.212115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:44.277593 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5258f-b178-4a5c-8a52-c6bb9771b78e None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:44.326383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38ceca-0246-4058-8783-b34528eb4518 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:44.333983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebda6af-5299-4609-bda3-01515698ea98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:44.334968 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebda6af-5299-4609-bda3-01515698ea98 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:44.335403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebda6af-5299-4609-bda3-01515698ea98 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:44.335841 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebda6af-5299-4609-bda3-01515698ea98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:44.354484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebda6af-5299-4609-bda3-01515698ea98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:44.356866 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebda6af-5299-4609-bda3-01515698ea98 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:44.376451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-7ebda6af-5299-4609-bda3-01515698ea98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:44.376451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:44.376451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:44.376451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:44.376451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:44.376451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:44.376451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:44.376451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:44.376451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:44.376451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:44.376451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:44.376451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:44.376451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:44.376451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:44.376451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:44.376451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:44.377718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:44.377718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:44.377718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:44.377718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:44.377718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:44.377718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:44.377718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:44.377718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:44.377718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:44.377718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:44.377718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:44.377718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:44.377718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:44.377718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:44.377718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:44.377718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:44.377718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:44.379410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:44.379410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:44.379410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:44.379410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 333/668] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:44.379410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebda6af-5299-4609-bda3-01515698ea98 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:44.387224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68c1c6-8a67-4c77-a084-4065eaef54f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:44.388014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68c1c6-8a67-4c77-a084-4065eaef54f1 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:44.388444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68c1c6-8a67-4c77-a084-4065eaef54f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:44.388863 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68c1c6-8a67-4c77-a084-4065eaef54f1 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:44.389753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68c1c6-8a67-4c77-a084-4065eaef54f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:44.390183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68c1c6-8a67-4c77-a084-4065eaef54f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:44.392162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68c1c6-8a67-4c77-a084-4065eaef54f1 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:44.409389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 336/669] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:39:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:44.410612 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68c1c6-8a67-4c77-a084-4065eaef54f1 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:44.415743 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:44.521254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebda6af-5299-4609-bda3-01515698ea98 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:44.540391 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:44.548030 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68c1c6-8a67-4c77-a084-4065eaef54f1 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:44.569378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d973d56-e7b6-4be2-aafa-23ec9c9f9bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:44.570404 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d973d56-e7b6-4be2-aafa-23ec9c9f9bac None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:44.570789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d973d56-e7b6-4be2-aafa-23ec9c9f9bac None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:44.571098 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d973d56-e7b6-4be2-aafa-23ec9c9f9bac None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:44.579208 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d973d56-e7b6-4be2-aafa-23ec9c9f9bac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:44.580707 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d973d56-e7b6-4be2-aafa-23ec9c9f9bac None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:44.591485 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc62d11-c399-462b-883e-d06be900fd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:44.592365 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc62d11-c399-462b-883e-d06be900fd1d None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:44.592707 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc62d11-c399-462b-883e-d06be900fd1d None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:44.593261 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc62d11-c399-462b-883e-d06be900fd1d None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:44.593607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-5d973d56-e7b6-4be2-aafa-23ec9c9f9bac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:44.593607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:44.593607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:44.593607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:44.593607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:44.593607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:44.593607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:44.593607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:44.593607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:44.593607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:44.593607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:44.593607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:44.593607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:44.593607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:44.593607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:44.595578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:44.595578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:44.595578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:44.595578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:44.595578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:44.595578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:44.595578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:44.595578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:44.595578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:44.595578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:44.595578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:44.595578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:44.595578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:44.595578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:44.595578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:44.595578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:44.595578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:44.597153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:44.597153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:44.597153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:44.597153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:44.597153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:44.597153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:44.597153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:44.597153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:44.598469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc62d11-c399-462b-883e-d06be900fd1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:44.598469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc62d11-c399-462b-883e-d06be900fd1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:44.598901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 334/670] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:44.598901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d973d56-e7b6-4be2-aafa-23ec9c9f9bac None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:44.601911 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc62d11-c399-462b-883e-d06be900fd1d None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:44.616410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 337/671] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:44.617203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc62d11-c399-462b-883e-d06be900fd1d None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:44.734668 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:44.742047 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d973d56-e7b6-4be2-aafa-23ec9c9f9bac None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:44.787778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a89cf-f97c-4fc2-8585-1c1b43d8c41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:44.788932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a89cf-f97c-4fc2-8585-1c1b43d8c41a None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:44.789541 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a89cf-f97c-4fc2-8585-1c1b43d8c41a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:44.789856 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a89cf-f97c-4fc2-8585-1c1b43d8c41a None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:44.790888 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a89cf-f97c-4fc2-8585-1c1b43d8c41a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:44.791336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a89cf-f97c-4fc2-8585-1c1b43d8c41a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:44.793008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a89cf-f97c-4fc2-8585-1c1b43d8c41a None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:44.796797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc62d11-c399-462b-883e-d06be900fd1d None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:44.809162 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 335/672] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:44.810073 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a89cf-f97c-4fc2-8585-1c1b43d8c41a None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:44.853434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6588180-4147-4c39-b7e1-0d7181a17293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:44.853683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:44.854214 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6588180-4147-4c39-b7e1-0d7181a17293 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:44.854548 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6588180-4147-4c39-b7e1-0d7181a17293 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:44.855022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6588180-4147-4c39-b7e1-0d7181a17293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:44.867890 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6588180-4147-4c39-b7e1-0d7181a17293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:44.869264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6588180-4147-4c39-b7e1-0d7181a17293 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:44.887223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-e6588180-4147-4c39-b7e1-0d7181a17293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:44.887223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:44.887223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:44.887223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:44.887223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:44.887223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:44.887223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:44.887223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:44.887223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:44.887223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:44.887223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:44.887223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:44.887223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:44.887223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:44.887223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:44.887223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:44.896778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:44.896778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:44.896778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:44.896778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:44.896778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:44.896778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:44.896778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:44.896778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:44.896778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:44.896778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:44.896778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:44.896778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:44.896778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:44.896778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:44.896778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:44.896778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:44.896778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:44.898843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:44.898843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:44.898843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:44.898843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 338/673] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:44.898843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6588180-4147-4c39-b7e1-0d7181a17293 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:44.925627 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a89cf-f97c-4fc2-8585-1c1b43d8c41a None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:44.965602 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87b432-2882-48c3-b8f3-1a58843f7dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:44.966218 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87b432-2882-48c3-b8f3-1a58843f7dfe None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:44.966496 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87b432-2882-48c3-b8f3-1a58843f7dfe None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:44.966763 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87b432-2882-48c3-b8f3-1a58843f7dfe None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:44.967526 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87b432-2882-48c3-b8f3-1a58843f7dfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:44.967837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87b432-2882-48c3-b8f3-1a58843f7dfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:44.969263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87b432-2882-48c3-b8f3-1a58843f7dfe None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:44.981643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 336/674] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:44.982513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87b432-2882-48c3-b8f3-1a58843f7dfe None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:45.013311 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6588180-4147-4c39-b7e1-0d7181a17293 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:45.043742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:45.067434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a4a40-7331-4e91-80a2-3ca4977c07fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:45.068150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a4a40-7331-4e91-80a2-3ca4977c07fb None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:45.068492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a4a40-7331-4e91-80a2-3ca4977c07fb None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:45.068771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a4a40-7331-4e91-80a2-3ca4977c07fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:45.076404 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a4a40-7331-4e91-80a2-3ca4977c07fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:45.077908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a4a40-7331-4e91-80a2-3ca4977c07fb None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:45.090389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-558a4a40-7331-4e91-80a2-3ca4977c07fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:45.090389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:45.090389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:45.090389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:45.090389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:45.090389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:45.090389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:45.090389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:45.090389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:45.090389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:45.090389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:45.090389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:45.090389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:45.090389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:45.090389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:45.091644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:45.091644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:45.091644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:45.091644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:45.091644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:45.091644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:45.091644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:45.091644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:45.091644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:45.091644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:45.091644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:45.091644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:45.091644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:45.091644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:45.091644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:45.091644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:45.091644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:45.092791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:45.092791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:45.092791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:45.092791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:45.092791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:45.092791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:45.092791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:45.092791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:45.092791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 339/675] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:45.092791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593c2aa-b481-4c69-90ec-e2cf08c30556 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:45.093502 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593c2aa-b481-4c69-90ec-e2cf08c30556 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:45.093502 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593c2aa-b481-4c69-90ec-e2cf08c30556 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:45.094577 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 340/676] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:45.095283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593c2aa-b481-4c69-90ec-e2cf08c30556 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:45.117370 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:45.126633 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87b432-2882-48c3-b8f3-1a58843f7dfe None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:45.167090 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f5423-d66d-4e8f-8012-49e3da454726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:45.167874 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f5423-d66d-4e8f-8012-49e3da454726 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:45.168246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f5423-d66d-4e8f-8012-49e3da454726 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:45.168596 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f5423-d66d-4e8f-8012-49e3da454726 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:45.176761 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f5423-d66d-4e8f-8012-49e3da454726 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:45.178668 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f5423-d66d-4e8f-8012-49e3da454726 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:45.191931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-809f5423-d66d-4e8f-8012-49e3da454726 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:45.191931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:45.191931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:45.191931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:45.191931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:45.191931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:45.191931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:45.191931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:45.191931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:45.191931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:45.191931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:45.191931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:45.191931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:45.191931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:45.191931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:45.193516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:45.193516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:45.193516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:45.193516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:45.193516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:45.193516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:45.193516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:45.193516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:45.193516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:45.193516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:45.193516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:45.193516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:45.193516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:45.193516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:45.193516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:45.193516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:45.193516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:45.194652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:45.194652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:45.194652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:45.194652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:45.194652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:45.194652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:45.194652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:45.194652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:45.195622 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 337/677] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:45.197173 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f5423-d66d-4e8f-8012-49e3da454726 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:45.215345 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593c2aa-b481-4c69-90ec-e2cf08c30556 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:45.253535 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baae97d-d57e-418f-9ce7-074977866350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:45.254168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baae97d-d57e-418f-9ce7-074977866350 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:45.254451 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baae97d-d57e-418f-9ce7-074977866350 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:45.254716 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baae97d-d57e-418f-9ce7-074977866350 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:45.255381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baae97d-d57e-418f-9ce7-074977866350 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:45.255672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baae97d-d57e-418f-9ce7-074977866350 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:45.257056 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baae97d-d57e-418f-9ce7-074977866350 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:45.269301 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 341/678] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:45.270179 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baae97d-d57e-418f-9ce7-074977866350 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:45.310465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:45.326615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f5423-d66d-4e8f-8012-49e3da454726 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:45.372683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13c621-29fa-4933-ac44-4806a90ddb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:45.373504 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13c621-29fa-4933-ac44-4806a90ddb0c None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:45.373892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13c621-29fa-4933-ac44-4806a90ddb0c None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:45.374298 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13c621-29fa-4933-ac44-4806a90ddb0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:45.375239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13c621-29fa-4933-ac44-4806a90ddb0c None admin] RBAC: Adding query filter params (role.id=8cf7b72483b94512b497317ab1d11192, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=4a87e18c89ff419f8e428e376d33462c) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:45.375665 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13c621-29fa-4933-ac44-4806a90ddb0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:45.377443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13c621-29fa-4933-ac44-4806a90ddb0c None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:45.384102 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 338/679] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:39:45 2022] GET /identity/v3/role_assignments?user.id=4a87e18c89ff419f8e428e376d33462c&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=8cf7b72483b94512b497317ab1d11192 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:45.385401 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ef42d-04d3-4c87-8f4b-ed4747ce2584 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:45.385692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ef42d-04d3-4c87-8f4b-ed4747ce2584 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:45.385962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ef42d-04d3-4c87-8f4b-ed4747ce2584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:45.394554 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baae97d-d57e-418f-9ce7-074977866350 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:45.416449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-862ef42d-04d3-4c87-8f4b-ed4747ce2584 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:45.417765 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-862ef42d-04d3-4c87-8f4b-ed4747ce2584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:45.439670 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:45.444181 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d2d92-3350-41b0-8d0a-b300411e89f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:45.445101 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d2d92-3350-41b0-8d0a-b300411e89f2 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:45.445498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d2d92-3350-41b0-8d0a-b300411e89f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:45.445908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d2d92-3350-41b0-8d0a-b300411e89f2 None admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:45.446704 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d2d92-3350-41b0-8d0a-b300411e89f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:45.447086 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d2d92-3350-41b0-8d0a-b300411e89f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:45.448773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d2d92-3350-41b0-8d0a-b300411e89f2 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:45.465083 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 342/680] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:45.466128 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d2d92-3350-41b0-8d0a-b300411e89f2 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:45.544505 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 339/681] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:45.546130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ef42d-04d3-4c87-8f4b-ed4747ce2584 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:45.629186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:45.640461 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d2d92-3350-41b0-8d0a-b300411e89f2 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:45.712263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ef42d-04d3-4c87-8f4b-ed4747ce2584 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:45.721844 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751f6ca-bc18-49c0-9d49-3da922cb99ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:45.724163 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751f6ca-bc18-49c0-9d49-3da922cb99ce None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:45.724868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751f6ca-bc18-49c0-9d49-3da922cb99ce None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:45.726093 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751f6ca-bc18-49c0-9d49-3da922cb99ce None admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:45.727023 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751f6ca-bc18-49c0-9d49-3da922cb99ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:45.727727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751f6ca-bc18-49c0-9d49-3da922cb99ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:45.730791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751f6ca-bc18-49c0-9d49-3da922cb99ce None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:45.746996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 343/682] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:45.749055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751f6ca-bc18-49c0-9d49-3da922cb99ce None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:45.764002 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c81fe0-2b57-42c5-952b-1ef9ab79efd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:45.764810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c81fe0-2b57-42c5-952b-1ef9ab79efd3 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:45.765746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c81fe0-2b57-42c5-952b-1ef9ab79efd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:45.766352 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c81fe0-2b57-42c5-952b-1ef9ab79efd3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:45.781369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c81fe0-2b57-42c5-952b-1ef9ab79efd3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:45.781369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c81fe0-2b57-42c5-952b-1ef9ab79efd3 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:45.803143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-62c81fe0-2b57-42c5-952b-1ef9ab79efd3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:39:45.803143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:45.803143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:45.803143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:45.803143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:45.803143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:45.803143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:45.803143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:45.803143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:45.803143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:45.803143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:45.803143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:45.803143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:45.803143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:45.803143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:45.803143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:45.804377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:45.805600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:45.805600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:45.805600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:45.805600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:45.805600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:45.805600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:45.805600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:45.805600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:45.805600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:39:45.805600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:45.811840 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 340/683] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:39:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:45.813240 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c81fe0-2b57-42c5-952b-1ef9ab79efd3 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:45.831796 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:45.899963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751f6ca-bc18-49c0-9d49-3da922cb99ce None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:45.946113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50056ce-b5cd-4c42-8454-5741715a0bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:45.946736 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50056ce-b5cd-4c42-8454-5741715a0bde None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:45.947012 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50056ce-b5cd-4c42-8454-5741715a0bde None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:45.947279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50056ce-b5cd-4c42-8454-5741715a0bde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:45.948015 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50056ce-b5cd-4c42-8454-5741715a0bde None admin] RBAC: Adding query filter params (role.id=8cf7b72483b94512b497317ab1d11192, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=a5814ac53752455697e050944b6d32b7) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:45.948325 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50056ce-b5cd-4c42-8454-5741715a0bde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:45.949819 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50056ce-b5cd-4c42-8454-5741715a0bde None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:45.965369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c81fe0-2b57-42c5-952b-1ef9ab79efd3 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:45.965621 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 344/684] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:39:45 2022] GET /identity/v3/role_assignments?user.id=a5814ac53752455697e050944b6d32b7&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=8cf7b72483b94512b497317ab1d11192 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:45.965621 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50056ce-b5cd-4c42-8454-5741715a0bde None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:45.998622 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:46.002787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91c518-8deb-4f45-bee1-29e1b2332113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:46.004245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91c518-8deb-4f45-bee1-29e1b2332113 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:46.004767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91c518-8deb-4f45-bee1-29e1b2332113 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:46.005120 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91c518-8deb-4f45-bee1-29e1b2332113 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:46.005948 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91c518-8deb-4f45-bee1-29e1b2332113 None admin] RBAC: Adding query filter params (role.id=8cf7b72483b94512b497317ab1d11192, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=51d2d1c76c3040dd9e57f83c3860e8fa) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:46.006282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91c518-8deb-4f45-bee1-29e1b2332113 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:46.007930 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91c518-8deb-4f45-bee1-29e1b2332113 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:46.015296 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 341/685] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:39:45 2022] GET /identity/v3/role_assignments?user.id=51d2d1c76c3040dd9e57f83c3860e8fa&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=8cf7b72483b94512b497317ab1d11192 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:46.016348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91c518-8deb-4f45-bee1-29e1b2332113 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:46.118343 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50056ce-b5cd-4c42-8454-5741715a0bde None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:46.140965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:46.193215 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d24a4-43ef-4966-a43f-11ed0e55b0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:46.194296 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d24a4-43ef-4966-a43f-11ed0e55b0a5 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:46.194797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d24a4-43ef-4966-a43f-11ed0e55b0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:46.195288 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d24a4-43ef-4966-a43f-11ed0e55b0a5 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:46.196278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d24a4-43ef-4966-a43f-11ed0e55b0a5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:46.196899 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d24a4-43ef-4966-a43f-11ed0e55b0a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:46.198701 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d24a4-43ef-4966-a43f-11ed0e55b0a5 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:46.215650 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91c518-8deb-4f45-bee1-29e1b2332113 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:46.233556 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 345/686] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 12 23:39:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:46.236880 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d24a4-43ef-4966-a43f-11ed0e55b0a5 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:46.288245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f437f-ef71-4934-baac-c8d63335464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:46.289023 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f437f-ef71-4934-baac-c8d63335464b None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:46.289206 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f437f-ef71-4934-baac-c8d63335464b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:46.289485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f437f-ef71-4934-baac-c8d63335464b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:46.304417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f437f-ef71-4934-baac-c8d63335464b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:46.306407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f437f-ef71-4934-baac-c8d63335464b None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:46.344818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-ba2f437f-ef71-4934-baac-c8d63335464b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:46.344818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:46.344818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:46.344818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:46.344818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:46.344818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:46.344818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:46.344818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:46.344818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:46.344818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:46.344818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:46.344818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:46.344818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:46.344818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:46.344818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:46.344818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:46.345906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:46.345906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:46.345906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:46.345906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:46.345906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:46.345906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:46.345906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:46.345906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:46.345906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:46.345906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:46.345906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:46.345906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:46.345906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:46.345906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:46.345906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:46.345906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:46.345906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:46.346823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:46.346823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:46.346823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:46.346823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 342/687] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:46.353810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f437f-ef71-4934-baac-c8d63335464b None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:46.373076 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:46.400802 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d24a4-43ef-4966-a43f-11ed0e55b0a5 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:46.458138 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525a7fd-9c18-4bb1-b300-4b30083a01f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:46.459128 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525a7fd-9c18-4bb1-b300-4b30083a01f4 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:46.459576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525a7fd-9c18-4bb1-b300-4b30083a01f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:46.460027 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525a7fd-9c18-4bb1-b300-4b30083a01f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:46.550295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f437f-ef71-4934-baac-c8d63335464b None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:46.585316 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525a7fd-9c18-4bb1-b300-4b30083a01f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:46.588243 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525a7fd-9c18-4bb1-b300-4b30083a01f4 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:46.617946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:46.646609 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe357b97-565f-4de8-926c-b63084d5a364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:46.649641 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe357b97-565f-4de8-926c-b63084d5a364 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:46.650206 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe357b97-565f-4de8-926c-b63084d5a364 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:46.650744 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe357b97-565f-4de8-926c-b63084d5a364 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:46.652740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe357b97-565f-4de8-926c-b63084d5a364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:46.654830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe357b97-565f-4de8-926c-b63084d5a364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:46.656630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe357b97-565f-4de8-926c-b63084d5a364 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:46.691412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 343/688] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:46.699712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe357b97-565f-4de8-926c-b63084d5a364 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:46.766763 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:46.819555 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 346/689] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 23:39:46.831067 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525a7fd-9c18-4bb1-b300-4b30083a01f4 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:46.929199 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe357b97-565f-4de8-926c-b63084d5a364 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:46.988923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525a7fd-9c18-4bb1-b300-4b30083a01f4 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:47.011446 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779d8a3-47db-42ed-97f6-674877654362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:47.012975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779d8a3-47db-42ed-97f6-674877654362 None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:47.013820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779d8a3-47db-42ed-97f6-674877654362 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:47.014652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779d8a3-47db-42ed-97f6-674877654362 None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:47.016228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779d8a3-47db-42ed-97f6-674877654362 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:47.019231 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779d8a3-47db-42ed-97f6-674877654362 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:47.031017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bea112-68bc-4c14-b6f6-4e9f649c7489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:47.031765 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bea112-68bc-4c14-b6f6-4e9f649c7489 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:47.032037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bea112-68bc-4c14-b6f6-4e9f649c7489 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:47.032310 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bea112-68bc-4c14-b6f6-4e9f649c7489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:47.047962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bea112-68bc-4c14-b6f6-4e9f649c7489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:47.047962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bea112-68bc-4c14-b6f6-4e9f649c7489 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:47.063605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-e3bea112-68bc-4c14-b6f6-4e9f649c7489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:47.063605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:47.063605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:47.063605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:47.063605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:47.063605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:47.063605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:47.063605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:47.063605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:47.063605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:47.063605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:47.063605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:47.063605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:47.063605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:47.063605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:47.063605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:47.065207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:47.065207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:47.065207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:47.065207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:47.065207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:47.065207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:47.065207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:47.065207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:47.065207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:47.065207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:47.065207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:47.065207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:47.065207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:47.065207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:47.065207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:47.065207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:47.065207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:47.066719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:47.066719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:47.066719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:47.066719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 347/690] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:39:47.071064 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bea112-68bc-4c14-b6f6-4e9f649c7489 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:47.094278 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 344/691] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:39:46 2022] POST /identity/v3/users => generated 254 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:39:47.107279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:47.195172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bea112-68bc-4c14-b6f6-4e9f649c7489 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:47.236774 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8d06b-7768-4138-86de-f1a0fe73e9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:47.237460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8d06b-7768-4138-86de-f1a0fe73e9e6 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:47.237740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8d06b-7768-4138-86de-f1a0fe73e9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:47.238012 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8d06b-7768-4138-86de-f1a0fe73e9e6 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:47.238694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8d06b-7768-4138-86de-f1a0fe73e9e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:47.238997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8d06b-7768-4138-86de-f1a0fe73e9e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:47.240443 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8d06b-7768-4138-86de-f1a0fe73e9e6 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:47.255937 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 348/692] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:47.262130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779d8a3-47db-42ed-97f6-674877654362 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:47.332373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:47.434088 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779d8a3-47db-42ed-97f6-674877654362 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:47.495916 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b158aa-4804-4ff3-af65-25d131602a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:47.496585 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b158aa-4804-4ff3-af65-25d131602a73 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:47.496863 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b158aa-4804-4ff3-af65-25d131602a73 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:47.497132 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b158aa-4804-4ff3-af65-25d131602a73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:47.505822 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b158aa-4804-4ff3-af65-25d131602a73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:47.507331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b158aa-4804-4ff3-af65-25d131602a73 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:47.520805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-24b158aa-4804-4ff3-af65-25d131602a73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:47.520805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:47.520805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:47.520805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:47.520805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:47.520805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:47.520805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:47.520805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:47.520805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:47.520805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:47.520805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:47.520805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:47.520805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:47.520805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:47.520805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:47.522454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:47.522454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:47.522454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:47.522454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:47.522454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:47.522454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:47.522454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:47.522454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:47.522454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:47.522454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:47.522454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:47.522454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:47.522454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:47.522454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:47.522454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:47.522454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:47.522454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:47.524053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:47.524053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:47.524053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:47.524053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:47.524053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:47.524053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:47.524053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:47.524053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:47.524053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 345/693] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:39:47.528097 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8d06b-7768-4138-86de-f1a0fe73e9e6 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:47.638776 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:47.649916 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8d06b-7768-4138-86de-f1a0fe73e9e6 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:47.688769 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491520f4-e624-4ec2-8c3a-a5b9b6583584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:47.689454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491520f4-e624-4ec2-8c3a-a5b9b6583584 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:47.689738 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491520f4-e624-4ec2-8c3a-a5b9b6583584 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:47.690009 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491520f4-e624-4ec2-8c3a-a5b9b6583584 None admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:47.690722 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491520f4-e624-4ec2-8c3a-a5b9b6583584 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:47.691024 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491520f4-e624-4ec2-8c3a-a5b9b6583584 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:47.692490 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491520f4-e624-4ec2-8c3a-a5b9b6583584 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:47.706174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 349/694] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:47.712400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b158aa-4804-4ff3-af65-25d131602a73 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:47.895157 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:47.900592 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b158aa-4804-4ff3-af65-25d131602a73 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:47.953496 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f467bf-b923-4222-93df-943e1d50180d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:47.954441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f467bf-b923-4222-93df-943e1d50180d None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:47.954441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f467bf-b923-4222-93df-943e1d50180d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:47.954673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f467bf-b923-4222-93df-943e1d50180d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:47.955491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f467bf-b923-4222-93df-943e1d50180d None admin] RBAC: Adding query filter params (role.id=8cf7b72483b94512b497317ab1d11192, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=43c45ae3144b4fe8ab4e921fda30164a) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:47.955812 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f467bf-b923-4222-93df-943e1d50180d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:47.957283 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f467bf-b923-4222-93df-943e1d50180d None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:47.971057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 346/695] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:39:47 2022] GET /identity/v3/role_assignments?user.id=43c45ae3144b4fe8ab4e921fda30164a&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=8cf7b72483b94512b497317ab1d11192 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:48.569511 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33131cb6-912a-49d0-b709-988a13940a68 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:48.570035 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33131cb6-912a-49d0-b709-988a13940a68 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:48.570035 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33131cb6-912a-49d0-b709-988a13940a68 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:48.571778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 350/696] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:48.577910 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76ab30-efcc-49b8-89da-8de3e42fb433 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:48.578626 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76ab30-efcc-49b8-89da-8de3e42fb433 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:48.579099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76ab30-efcc-49b8-89da-8de3e42fb433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:48.605311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-cc76ab30-efcc-49b8-89da-8de3e42fb433 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:48.607133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-cc76ab30-efcc-49b8-89da-8de3e42fb433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:48.707276 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 347/697] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:49.055835 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f4807-65b2-4c4b-b1ae-c381347ce7da None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:49.056238 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f4807-65b2-4c4b-b1ae-c381347ce7da None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:49.056378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f4807-65b2-4c4b-b1ae-c381347ce7da None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:49.058085 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 351/698] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:49.062967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76ab30-efcc-49b8-89da-8de3e42fb433 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:49.068679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cf546-5623-475d-a26c-4e4115ef4d47 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:49.069069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cf546-5623-475d-a26c-4e4115ef4d47 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:49.069280 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4cf546-5623-475d-a26c-4e4115ef4d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:49.095101 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-4d4cf546-5623-475d-a26c-4e4115ef4d47 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:49.096342 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4d4cf546-5623-475d-a26c-4e4115ef4d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:49.207551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 352/699] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:49.253202 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:49.264004 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76ab30-efcc-49b8-89da-8de3e42fb433 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:49.320758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400f358-2a37-4162-92f8-2d07e499dd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:49.321430 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400f358-2a37-4162-92f8-2d07e499dd59 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:49.321719 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400f358-2a37-4162-92f8-2d07e499dd59 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:49.322038 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400f358-2a37-4162-92f8-2d07e499dd59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:49.338509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400f358-2a37-4162-92f8-2d07e499dd59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:49.343548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-1400f358-2a37-4162-92f8-2d07e499dd59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:39:49.343548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:49.343548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:49.343548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:49.343548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:49.343548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:49.343548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:49.343548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:49.343548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:49.343548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:49.343548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:49.343548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:49.343548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:49.343548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:49.343548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:49.343548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:49.345252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:49.345252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:49.345252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:49.345252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:49.345252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:49.345252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:49.345252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:49.345252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:49.345252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:49.345252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:49.345252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:49.345252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:49.345252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:49.345252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:49.345252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:49.345252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:49.346889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:49.346889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:49.346889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:49.346889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:49.346889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:49.346889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:49.346889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:49.346889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:49.346889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:49.346889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:49.346889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:39:49.346889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:49.346889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 348/700] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:39:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:49.353413 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cf546-5623-475d-a26c-4e4115ef4d47 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:49.485412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:49.515764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4cf546-5623-475d-a26c-4e4115ef4d47 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:49.566134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de5583-6d80-488c-8643-578f5d1ab6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:49.566782 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de5583-6d80-488c-8643-578f5d1ab6f8 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:49.567073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de5583-6d80-488c-8643-578f5d1ab6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:49.567344 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de5583-6d80-488c-8643-578f5d1ab6f8 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:49.568052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de5583-6d80-488c-8643-578f5d1ab6f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:49.568353 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de5583-6d80-488c-8643-578f5d1ab6f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:49.569871 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de5583-6d80-488c-8643-578f5d1ab6f8 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:49.582497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 353/701] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:39:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:49.583858 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15d2cb-5b18-4e5a-8f1a-54fd4bbe776e None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:49.584131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15d2cb-5b18-4e5a-8f1a-54fd4bbe776e None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:49.584637 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15d2cb-5b18-4e5a-8f1a-54fd4bbe776e None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:49.585563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de5583-6d80-488c-8643-578f5d1ab6f8 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:49.586327 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 349/702] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:49.593794 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e04ed-8ba8-4012-b8a2-267cd2f47418 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:49.594226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e04ed-8ba8-4012-b8a2-267cd2f47418 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:49.594470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e04ed-8ba8-4012-b8a2-267cd2f47418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:49.633790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-f23e04ed-8ba8-4012-b8a2-267cd2f47418 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:49.635028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f23e04ed-8ba8-4012-b8a2-267cd2f47418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:49.717922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de5583-6d80-488c-8643-578f5d1ab6f8 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:49.769064 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 350/703] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:39:49.770521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e04ed-8ba8-4012-b8a2-267cd2f47418 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:49.775929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e662910-bbcf-4543-8ce0-3458215df51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:49.776595 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e662910-bbcf-4543-8ce0-3458215df51f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:49.776875 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e662910-bbcf-4543-8ce0-3458215df51f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:49.777195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e662910-bbcf-4543-8ce0-3458215df51f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:49.798791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e662910-bbcf-4543-8ce0-3458215df51f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:49.800306 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e662910-bbcf-4543-8ce0-3458215df51f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:49.804945 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:49.829948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-4e662910-bbcf-4543-8ce0-3458215df51f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:49.829948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:49.829948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:49.829948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:49.829948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:49.829948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:49.829948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:49.829948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:49.829948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:49.829948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:49.829948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:49.829948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:49.829948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:49.829948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:49.829948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:49.829948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:49.833604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:49.833604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:49.833604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:49.833604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:49.833604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:49.833604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:49.833604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:49.833604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:49.833604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:49.833604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:49.833604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:49.833604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:49.833604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:49.833604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:49.833604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:49.833604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:49.833604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:49.837084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:49.837084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:49.837084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:49.837084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 354/704] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:39:49.843650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e662910-bbcf-4543-8ce0-3458215df51f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:49.963535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:49.997552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e04ed-8ba8-4012-b8a2-267cd2f47418 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:50.020060 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e662910-bbcf-4543-8ce0-3458215df51f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:50.059722 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979982a9-50db-4ea5-a995-f2f1e4a79311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:50.060366 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979982a9-50db-4ea5-a995-f2f1e4a79311 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:50.060869 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979982a9-50db-4ea5-a995-f2f1e4a79311 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:50.061791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979982a9-50db-4ea5-a995-f2f1e4a79311 None admin] PATH_INFO: `/v3/services/network` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:50.062649 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979982a9-50db-4ea5-a995-f2f1e4a79311 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:50.063182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84328bdd-5a14-4b06-9462-ab9f959defa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:50.063832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84328bdd-5a14-4b06-9462-ab9f959defa6 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:50.064113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84328bdd-5a14-4b06-9462-ab9f959defa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:50.064383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84328bdd-5a14-4b06-9462-ab9f959defa6 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:50.065020 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979982a9-50db-4ea5-a995-f2f1e4a79311 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:50.065497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84328bdd-5a14-4b06-9462-ab9f959defa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:50.065497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84328bdd-5a14-4b06-9462-ab9f959defa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:50.066770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84328bdd-5a14-4b06-9462-ab9f959defa6 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:50.080564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-979982a9-50db-4ea5-a995-f2f1e4a79311 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:39:50.080564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:50.080564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:39:50.080564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:39:50.080564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:39:50.080564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:39:50.080564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:39:50.080564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:39:50.080564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:39:50.080564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:50.080564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:39:50.080564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:50.080564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:50.080564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:50.080564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:50.080564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:50.080564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:50.081860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:50.081860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:50.081860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:50.081860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:50.081860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:50.081860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:50.081860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:39:50.081860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:39:50.081860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:39:50.081860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:39:50.081860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:50.081860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:50.081860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:50.081860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:50.081860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:50.081860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:50.082762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:50.082762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:50.082762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:50.082762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:50.082762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:50.082762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:50.082762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:50.082762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:50.082762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:50.082762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:50.082762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:39:50.082762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:39:50.082762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:39:50.082762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:50.083508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 355/705] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:50.083508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84328bdd-5a14-4b06-9462-ab9f959defa6 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:50.085284 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 351/706] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:49 2022] GET /identity/v3/services/network => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:50.090462 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979982a9-50db-4ea5-a995-f2f1e4a79311 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:50.155283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:50.213726 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979982a9-50db-4ea5-a995-f2f1e4a79311 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:50.214804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84328bdd-5a14-4b06-9462-ab9f959defa6 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:50.256029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb25ce-4189-4b57-93ef-beb6d9a43fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:50.256985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb25ce-4189-4b57-93ef-beb6d9a43fc5 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:50.257527 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb25ce-4189-4b57-93ef-beb6d9a43fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:50.257951 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb25ce-4189-4b57-93ef-beb6d9a43fc5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:50.259362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b49c17-070d-43e9-903a-1e6738949b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:50.260141 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b49c17-070d-43e9-903a-1e6738949b92 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:50.260503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b49c17-070d-43e9-903a-1e6738949b92 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:50.260824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b49c17-070d-43e9-903a-1e6738949b92 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:50.261814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b49c17-070d-43e9-903a-1e6738949b92 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:50.263985 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b49c17-070d-43e9-903a-1e6738949b92 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:50.268827 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb25ce-4189-4b57-93ef-beb6d9a43fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:50.270822 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb25ce-4189-4b57-93ef-beb6d9a43fc5 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:50.276786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-52b49c17-070d-43e9-903a-1e6738949b92 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:39:50.276786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:50.276786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:39:50.276786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:39:50.276786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:39:50.276786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:39:50.276786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:39:50.276786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:39:50.276786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:39:50.276786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:50.276786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:39:50.276786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:50.276786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:50.276786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:50.276786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:50.276786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:50.276786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:50.278094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:50.278094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:50.278094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:50.278094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:50.278094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:50.278094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:50.278094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:39:50.278094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:39:50.278094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:39:50.278094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:39:50.278094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:50.278094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:50.278094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:50.278094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:50.278094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:50.278094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:50.279151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:50.279151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:50.279151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:50.279151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:50.279151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:50.279151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:50.279151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:50.279151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:50.279151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:50.279151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:50.279151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:39:50.279151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:39:50.279151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:39:50.279151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:50.285526 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 356/707] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Sep 12 23:39:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:50.286633 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b49c17-070d-43e9-903a-1e6738949b92 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:50.289302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-47cb25ce-4189-4b57-93ef-beb6d9a43fc5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:39:50.289302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:50.289302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:50.289302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:50.289302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:50.289302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:50.289302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:50.289302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:50.289302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:50.289302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:50.289302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:50.289302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:50.289302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:50.289302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:50.289302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:50.289302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:50.290519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:50.291732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:50.291732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:50.291732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:50.291732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:50.291732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:50.291732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:50.291732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:50.291732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:50.291732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:39:50.291732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:50.294399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 352/708] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 23:39:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:50.295682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb25ce-4189-4b57-93ef-beb6d9a43fc5 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:50.309914 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:50.412544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b49c17-070d-43e9-903a-1e6738949b92 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:50.438962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:50.451877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb25ce-4189-4b57-93ef-beb6d9a43fc5 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:50.455511 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ef08f-2171-449d-9b5a-48d486592ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:50.456227 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ef08f-2171-449d-9b5a-48d486592ed3 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:50.456582 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ef08f-2171-449d-9b5a-48d486592ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:50.456932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ef08f-2171-449d-9b5a-48d486592ed3 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:50.457712 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ef08f-2171-449d-9b5a-48d486592ed3 None admin] RBAC: Adding query filter params (name=network) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:50.458105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ef08f-2171-449d-9b5a-48d486592ed3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:50.459767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ef08f-2171-449d-9b5a-48d486592ed3 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:50.472498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 357/709] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 23:39:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:50.472498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ef08f-2171-449d-9b5a-48d486592ed3 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:50.529636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc3a11-0f22-45c7-8c1f-c5006c001791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:50.531246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc3a11-0f22-45c7-8c1f-c5006c001791 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:50.531995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc3a11-0f22-45c7-8c1f-c5006c001791 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:50.532843 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc3a11-0f22-45c7-8c1f-c5006c001791 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:50.534474 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc3a11-0f22-45c7-8c1f-c5006c001791 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:50.535228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc3a11-0f22-45c7-8c1f-c5006c001791 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:50.537771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc3a11-0f22-45c7-8c1f-c5006c001791 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:50.549042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 353/710] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 12 23:39:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:50.551087 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc3a11-0f22-45c7-8c1f-c5006c001791 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:50.595187 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ef08f-2171-449d-9b5a-48d486592ed3 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:50.669432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be1835-1e52-48c4-87eb-09ea4ca6bf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:50.670963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1835-1e52-48c4-87eb-09ea4ca6bf3d None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:50.672740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1835-1e52-48c4-87eb-09ea4ca6bf3d None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:50.673014 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:50.675934 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1835-1e52-48c4-87eb-09ea4ca6bf3d None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:50.677886 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be1835-1e52-48c4-87eb-09ea4ca6bf3d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:50.678944 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be1835-1e52-48c4-87eb-09ea4ca6bf3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:50.682019 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be1835-1e52-48c4-87eb-09ea4ca6bf3d None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:50.723236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc3a11-0f22-45c7-8c1f-c5006c001791 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:50.728045 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 358/711] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 23:39:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:50.729948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be1835-1e52-48c4-87eb-09ea4ca6bf3d None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:50.778060 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9c82f-c7de-4066-924b-a6135f377d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:50.779352 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9c82f-c7de-4066-924b-a6135f377d7d None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:50.779960 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9c82f-c7de-4066-924b-a6135f377d7d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:50.780556 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9c82f-c7de-4066-924b-a6135f377d7d None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:50.782161 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9c82f-c7de-4066-924b-a6135f377d7d None admin] RBAC: Adding query filter params (type=network) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:50.782769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9c82f-c7de-4066-924b-a6135f377d7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:50.786030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9c82f-c7de-4066-924b-a6135f377d7d None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:50.800054 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:50.801884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 354/712] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 23:39:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:50.807506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9c82f-c7de-4066-924b-a6135f377d7d None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:50.885762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be1835-1e52-48c4-87eb-09ea4ca6bf3d None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:50.938715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fbcaa-871f-4bed-84f0-fa102374b54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:50.939638 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fbcaa-871f-4bed-84f0-fa102374b54b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:50.940068 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fbcaa-871f-4bed-84f0-fa102374b54b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:50.940487 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fbcaa-871f-4bed-84f0-fa102374b54b None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:50.941375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fbcaa-871f-4bed-84f0-fa102374b54b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:50.942662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fbcaa-871f-4bed-84f0-fa102374b54b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:50.944660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fbcaa-871f-4bed-84f0-fa102374b54b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:50.952082 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 359/713] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 12 23:39:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:50.957764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228e341-c5ad-48e8-99c3-6e32d7849c4d None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:50.957764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228e341-c5ad-48e8-99c3-6e32d7849c4d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:50.957764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228e341-c5ad-48e8-99c3-6e32d7849c4d None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:50.970579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 360/714] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:50 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:50.975656 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eae076-1d47-4da5-8e29-ebca200c6841 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:50.976148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eae076-1d47-4da5-8e29-ebca200c6841 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:50.976690 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eae076-1d47-4da5-8e29-ebca200c6841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:51.042933 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-84eae076-1d47-4da5-8e29-ebca200c6841 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:51.045196 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-84eae076-1d47-4da5-8e29-ebca200c6841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:51.117547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9c82f-c7de-4066-924b-a6135f377d7d None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:51.216316 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe145f66-607c-4c35-ab8a-d2fe113ef0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:51.218016 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe145f66-607c-4c35-ab8a-d2fe113ef0a5 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:51.218440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe145f66-607c-4c35-ab8a-d2fe113ef0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:51.218994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe145f66-607c-4c35-ab8a-d2fe113ef0a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:51.227703 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:51.252721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 361/715] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:51.269964 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3854f9-4606-4521-a36a-6b280c7441c7 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:51.270454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3854f9-4606-4521-a36a-6b280c7441c7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:51.270932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3854f9-4606-4521-a36a-6b280c7441c7 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:51.279606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 362/716] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:51.285520 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2f0a7-3c40-4a06-a2c9-c3d84a1327c8 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:51.285819 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2f0a7-3c40-4a06-a2c9-c3d84a1327c8 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:51.286073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2f0a7-3c40-4a06-a2c9-c3d84a1327c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:51.305811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-d0b2f0a7-3c40-4a06-a2c9-c3d84a1327c8 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:51.307143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d0b2f0a7-3c40-4a06-a2c9-c3d84a1327c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:51.337684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:51.363711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe145f66-607c-4c35-ab8a-d2fe113ef0a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:51.368620 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe145f66-607c-4c35-ab8a-d2fe113ef0a5 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:51.447424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 363/717] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 12 23:39:51.573404 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 355/718] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 771 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:39:51.582859 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2f0a7-3c40-4a06-a2c9-c3d84a1327c8 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:51.741920 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2f0a7-3c40-4a06-a2c9-c3d84a1327c8 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:51.800223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba19d0a-b36a-4871-93f5-0deff4d7f224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:51.801366 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba19d0a-b36a-4871-93f5-0deff4d7f224 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:51.801852 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba19d0a-b36a-4871-93f5-0deff4d7f224 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:51.802331 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba19d0a-b36a-4871-93f5-0deff4d7f224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:51.818683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe145f66-607c-4c35-ab8a-d2fe113ef0a5 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:51.823777 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba19d0a-b36a-4871-93f5-0deff4d7f224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:51.825700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba19d0a-b36a-4871-93f5-0deff4d7f224 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:51.855235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-fba19d0a-b36a-4871-93f5-0deff4d7f224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:51.855235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:51.855235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:51.855235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:51.855235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:51.855235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:51.855235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:51.855235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:51.855235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:51.855235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:51.855235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:51.855235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:51.855235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:51.855235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:51.855235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:51.855235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:51.856241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:51.856241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:51.856241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:51.856241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:51.856241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:51.856241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:51.856241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:51.856241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:51.856241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:51.856241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:51.856241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:51.856241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:51.856241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:51.856241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:51.856241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:51.856241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:51.856241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:51.857106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:51.857106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:51.857106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:51.859448 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 364/719] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:51.867682 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba19d0a-b36a-4871-93f5-0deff4d7f224 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:51.909945 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:51.915516 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:52.003035 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe145f66-607c-4c35-ab8a-d2fe113ef0a5 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:52.041716 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ccd97-ef98-4116-a380-0a08140525ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:52.042367 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ccd97-ef98-4116-a380-0a08140525ef None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:52.042642 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ccd97-ef98-4116-a380-0a08140525ef None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:52.042913 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ccd97-ef98-4116-a380-0a08140525ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:52.055319 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ccd97-ef98-4116-a380-0a08140525ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:52.060373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-bb8ccd97-ef98-4116-a380-0a08140525ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:52.060373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:52.060373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:52.060373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:52.060373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:52.060373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:52.060373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:52.060373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:52.060373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:52.060373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:52.060373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:52.060373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:52.060373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:52.060373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:52.060373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:52.060373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:52.063419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:52.063419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:52.063419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:52.063419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:52.063419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:52.063419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:52.063419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:52.063419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:52.063419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:52.063419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:52.063419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:52.063419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:52.063419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:52.063419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:52.063419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:52.063419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:52.064906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:52.064906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:52.064906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:52.064906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:52.064906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:52.064906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:52.064906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:52.064906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:52.064906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:52.064906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:52.064906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:39:52.064906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:52.064906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 356/720] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:39:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:52.064906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ccd97-ef98-4116-a380-0a08140525ef None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:52.076001 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba19d0a-b36a-4871-93f5-0deff4d7f224 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:52.141179 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77cfa6-0a07-4ed5-81bd-cbc8ea461bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:52.142304 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77cfa6-0a07-4ed5-81bd-cbc8ea461bf2 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:52.142803 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77cfa6-0a07-4ed5-81bd-cbc8ea461bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:52.143294 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77cfa6-0a07-4ed5-81bd-cbc8ea461bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:52.144791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77cfa6-0a07-4ed5-81bd-cbc8ea461bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:52.145326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77cfa6-0a07-4ed5-81bd-cbc8ea461bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:52.148052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77cfa6-0a07-4ed5-81bd-cbc8ea461bf2 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:52.173836 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 365/721] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:52.175525 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77cfa6-0a07-4ed5-81bd-cbc8ea461bf2 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:52.181126 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:52.188370 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ccd97-ef98-4116-a380-0a08140525ef None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:52.227151 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75acf58-b12f-4742-a346-230fd3f31901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:52.227825 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75acf58-b12f-4742-a346-230fd3f31901 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:52.228077 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75acf58-b12f-4742-a346-230fd3f31901 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:52.228345 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75acf58-b12f-4742-a346-230fd3f31901 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:52.240595 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75acf58-b12f-4742-a346-230fd3f31901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:52.245564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-f75acf58-b12f-4742-a346-230fd3f31901 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:39:52.245564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:52.245564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:52.245564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:52.245564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:52.245564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:52.245564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:52.245564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:52.245564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:52.245564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:52.245564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:52.245564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:52.245564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:52.245564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:52.245564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:52.245564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:52.247601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:52.247601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:52.247601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:52.247601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:52.247601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:52.247601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:52.247601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:52.247601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:52.247601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:52.247601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:52.247601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:52.247601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:52.247601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:52.247601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:52.247601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:52.247601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:52.249369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:52.249369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:52.249369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:52.249369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:52.249369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:52.249369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:52.249369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:52.249369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:52.249369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:52.249369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:52.249369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:39:52.249369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:52.251807 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 357/722] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:39:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:52.252795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75acf58-b12f-4742-a346-230fd3f31901 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:52.345866 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:52.364164 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75acf58-b12f-4742-a346-230fd3f31901 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:52.390784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77cfa6-0a07-4ed5-81bd-cbc8ea461bf2 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:52.409156 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020adce2-230a-477a-a0d7-c3bc169e8b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:52.409858 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020adce2-230a-477a-a0d7-c3bc169e8b8e None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:52.410134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020adce2-230a-477a-a0d7-c3bc169e8b8e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:52.410413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020adce2-230a-477a-a0d7-c3bc169e8b8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:52.419149 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020adce2-230a-477a-a0d7-c3bc169e8b8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:52.420245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020adce2-230a-477a-a0d7-c3bc169e8b8e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:52.439270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-020adce2-230a-477a-a0d7-c3bc169e8b8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:52.439270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:52.439270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:52.439270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:52.439270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:52.439270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:52.439270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:52.439270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:52.439270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:52.439270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:52.439270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:52.439270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:52.439270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:52.439270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:52.439270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:52.440900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:52.440900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:52.440900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:52.440900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:52.440900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:52.440900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:52.440900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:52.440900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:52.440900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:52.440900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:52.440900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:52.440900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:52.440900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:52.440900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:52.440900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:52.440900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:52.440900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:52.442522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:52.442522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:52.442522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:52.442522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:52.442522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:52.442522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:52.442522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:52.442522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:52.442522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 358/723] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:52.442522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020adce2-230a-477a-a0d7-c3bc169e8b8e None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:52.463020 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:52.495755 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3abd8-f3a6-4b2c-a3e0-428fe6d86fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:52.498370 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3abd8-f3a6-4b2c-a3e0-428fe6d86fda None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:52.499106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3abd8-f3a6-4b2c-a3e0-428fe6d86fda None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:52.500239 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3abd8-f3a6-4b2c-a3e0-428fe6d86fda None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:52.503076 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3abd8-f3a6-4b2c-a3e0-428fe6d86fda None admin] RBAC: Adding query filter params (name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:52.504280 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3abd8-f3a6-4b2c-a3e0-428fe6d86fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:52.508097 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3abd8-f3a6-4b2c-a3e0-428fe6d86fda None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:52.529679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 366/724] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:39:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:52.532513 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3abd8-f3a6-4b2c-a3e0-428fe6d86fda None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:52.594267 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020adce2-230a-477a-a0d7-c3bc169e8b8e None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:52.666575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f2408-3c47-4f8f-bcc9-04778bb3f596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:52.667542 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f2408-3c47-4f8f-bcc9-04778bb3f596 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:52.668032 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f2408-3c47-4f8f-bcc9-04778bb3f596 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:52.668512 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f2408-3c47-4f8f-bcc9-04778bb3f596 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:52.670221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f2408-3c47-4f8f-bcc9-04778bb3f596 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:52.670763 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f2408-3c47-4f8f-bcc9-04778bb3f596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:52.673670 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f2408-3c47-4f8f-bcc9-04778bb3f596 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:52.684335 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3abd8-f3a6-4b2c-a3e0-428fe6d86fda None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:52.691565 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 359/725] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:39:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:52.693016 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f2408-3c47-4f8f-bcc9-04778bb3f596 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:52.764690 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c60dc-7288-4cca-84e9-ae91c7ebebf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:52.766749 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c60dc-7288-4cca-84e9-ae91c7ebebf3 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:52.767440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c60dc-7288-4cca-84e9-ae91c7ebebf3 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:52.768113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c60dc-7288-4cca-84e9-ae91c7ebebf3 None admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:52.769553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c60dc-7288-4cca-84e9-ae91c7ebebf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:52.770270 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c60dc-7288-4cca-84e9-ae91c7ebebf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:52.774213 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c60dc-7288-4cca-84e9-ae91c7ebebf3 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:52.857947 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:52.904336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f2408-3c47-4f8f-bcc9-04778bb3f596 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:52.976912 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7d628-2a62-4f7f-9e14-5e6339b91d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:52.978329 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7d628-2a62-4f7f-9e14-5e6339b91d1a None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:52.979000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7d628-2a62-4f7f-9e14-5e6339b91d1a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:52.979658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7d628-2a62-4f7f-9e14-5e6339b91d1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:52.987409 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:52.998751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 367/726] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:53.000621 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c60dc-7288-4cca-84e9-ae91c7ebebf3 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:53.018090 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7d628-2a62-4f7f-9e14-5e6339b91d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:53.021150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7d628-2a62-4f7f-9e14-5e6339b91d1a None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:53.057820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-aab7d628-2a62-4f7f-9e14-5e6339b91d1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:53.057820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:53.057820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:53.057820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:53.057820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:53.057820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:53.057820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:53.057820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:53.057820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:53.057820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:53.057820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:53.057820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:53.057820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:53.057820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:53.057820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:53.057820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:53.059894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:53.059894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:53.059894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:53.059894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:53.059894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:53.059894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:53.059894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:53.059894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:53.059894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:53.059894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:53.059894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:53.059894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:53.059894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:53.059894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:53.059894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:53.059894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:53.059894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:53.062678 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:53.062678 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:53.062678 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:53.066099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 360/727] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:53.068954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7d628-2a62-4f7f-9e14-5e6339b91d1a None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:53.220462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c60dc-7288-4cca-84e9-ae91c7ebebf3 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:53.288670 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a669fa0-3882-4530-b6b8-f3cd816671c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:53.289886 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a669fa0-3882-4530-b6b8-f3cd816671c9 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:53.290356 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7d628-2a62-4f7f-9e14-5e6339b91d1a None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:53.291031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a669fa0-3882-4530-b6b8-f3cd816671c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:53.291031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a669fa0-3882-4530-b6b8-f3cd816671c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:53.311768 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a669fa0-3882-4530-b6b8-f3cd816671c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:53.314602 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a669fa0-3882-4530-b6b8-f3cd816671c9 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:53.347378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-3a669fa0-3882-4530-b6b8-f3cd816671c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:53.347378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:53.347378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:53.347378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:53.347378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:53.347378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:53.347378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:53.347378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:53.347378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:53.347378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:53.347378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:53.347378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:53.347378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:53.347378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:53.347378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:53.347378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:53.349457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:53.349457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:53.349457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:53.349457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:53.349457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:53.349457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:53.349457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:53.349457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:53.349457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:53.349457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:53.349457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:53.349457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:53.349457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:53.349457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:53.349457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:53.349457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:53.349457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:53.351535 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:53.351535 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:53.351535 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:53.352413 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 368/728] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:53.354240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a669fa0-3882-4530-b6b8-f3cd816671c9 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:53.356546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:53.370646 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6ea1c-a5f4-4dba-900e-c755f6fc2bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:53.372053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6ea1c-a5f4-4dba-900e-c755f6fc2bfb None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:53.372751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6ea1c-a5f4-4dba-900e-c755f6fc2bfb None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:53.373464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6ea1c-a5f4-4dba-900e-c755f6fc2bfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:53.375247 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6ea1c-a5f4-4dba-900e-c755f6fc2bfb None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=4a87e18c89ff419f8e428e376d33462c) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:53.376062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6ea1c-a5f4-4dba-900e-c755f6fc2bfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:53.380129 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6ea1c-a5f4-4dba-900e-c755f6fc2bfb None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:53.402477 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 361/729] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:39:53 2022] GET /identity/v3/role_assignments?user.id=4a87e18c89ff419f8e428e376d33462c&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=440092230f024959a90e846ab29c6367 => generated 259 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:53.404497 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6ea1c-a5f4-4dba-900e-c755f6fc2bfb None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:53.470900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:53.577099 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a669fa0-3882-4530-b6b8-f3cd816671c9 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:53.599911 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6ea1c-a5f4-4dba-900e-c755f6fc2bfb None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:53.646998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1a12a-cf7c-4953-b3b3-ee3e2a790acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:53.647645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a12a-cf7c-4953-b3b3-ee3e2a790acb None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:53.647807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abeacc-8eb5-4f05-b45f-2d75957b6e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:53.647966 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a12a-cf7c-4953-b3b3-ee3e2a790acb None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:53.648250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a12a-cf7c-4953-b3b3-ee3e2a790acb None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:53.648836 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abeacc-8eb5-4f05-b45f-2d75957b6e00 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:53.649008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1a12a-cf7c-4953-b3b3-ee3e2a790acb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:53.649144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1a12a-cf7c-4953-b3b3-ee3e2a790acb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:53.649276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abeacc-8eb5-4f05-b45f-2d75957b6e00 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:53.651239 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abeacc-8eb5-4f05-b45f-2d75957b6e00 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:53.651424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1a12a-cf7c-4953-b3b3-ee3e2a790acb None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:53.651593 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abeacc-8eb5-4f05-b45f-2d75957b6e00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:53.651593 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abeacc-8eb5-4f05-b45f-2d75957b6e00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:53.654154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00abeacc-8eb5-4f05-b45f-2d75957b6e00 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:53.666274 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 362/730] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:53.668647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17076789-d1ab-4608-9672-0cf2610e0093 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:53.668990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17076789-d1ab-4608-9672-0cf2610e0093 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:53.669254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17076789-d1ab-4608-9672-0cf2610e0093 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:53.675926 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 363/731] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:53.677515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17076789-d1ab-4608-9672-0cf2610e0093 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:53.679657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 369/732] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:53.680985 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c82534-8cf9-43eb-b5ee-1a607cb51ec9 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:53.681258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c82534-8cf9-43eb-b5ee-1a607cb51ec9 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:53.681590 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c82534-8cf9-43eb-b5ee-1a607cb51ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:53.716753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-d5c82534-8cf9-43eb-b5ee-1a607cb51ec9 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:53.718964 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d5c82534-8cf9-43eb-b5ee-1a607cb51ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:53.770386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:53.845571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 370/733] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:53.846340 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17076789-d1ab-4608-9672-0cf2610e0093 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:53.847135 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c82534-8cf9-43eb-b5ee-1a607cb51ec9 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:53.893186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cf7ce-88c2-4078-90f3-8de48655c738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:53.893911 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cf7ce-88c2-4078-90f3-8de48655c738 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:53.894200 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cf7ce-88c2-4078-90f3-8de48655c738 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:53.894467 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cf7ce-88c2-4078-90f3-8de48655c738 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:53.903789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cf7ce-88c2-4078-90f3-8de48655c738 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:53.905369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cf7ce-88c2-4078-90f3-8de48655c738 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:53.919402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-5b0cf7ce-88c2-4078-90f3-8de48655c738 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:39:53.919402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:53.919402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:53.919402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:53.919402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:53.919402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:53.919402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:53.919402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:53.919402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:53.919402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:53.919402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:53.919402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:53.919402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:53.919402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:53.919402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:53.919402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:53.922067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:53.923289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:53.923289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:53.923289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:53.923289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:53.923289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:53.923289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:53.923289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:53.923289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:53.923289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:39:53.923289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:53.923289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 364/734] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:39:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:53.929267 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cf7ce-88c2-4078-90f3-8de48655c738 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:54.005120 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:54.083142 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c82534-8cf9-43eb-b5ee-1a607cb51ec9 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:54.123413 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75fcc0-004d-43f5-9af5-a0b101a1f888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:54.124055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75fcc0-004d-43f5-9af5-a0b101a1f888 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:54.124333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75fcc0-004d-43f5-9af5-a0b101a1f888 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:54.124653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75fcc0-004d-43f5-9af5-a0b101a1f888 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:54.133205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75fcc0-004d-43f5-9af5-a0b101a1f888 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:54.134744 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75fcc0-004d-43f5-9af5-a0b101a1f888 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:54.147828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-dd75fcc0-004d-43f5-9af5-a0b101a1f888 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:39:54.147828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:54.147828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:54.147828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:54.147828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:54.147828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:54.147828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:54.147828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:54.147828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:54.147828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:54.147828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:54.147828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:54.147828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:54.147828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:54.147828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:54.147828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:54.151473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:54.158212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:54.158212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:54.158212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:54.158212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:54.158212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:54.158212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:54.158212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:54.158212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:54.158212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:39:54.158212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:54.158212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 371/735] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 23:39:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:54.158212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fcffd-fd0c-4fac-b427-0d0f017d0f83 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:54.158212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fcffd-fd0c-4fac-b427-0d0f017d0f83 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:54.160824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fcffd-fd0c-4fac-b427-0d0f017d0f83 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:54.160824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 372/736] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:54.160824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7be5d-6de1-4ef8-b297-5423a8df5e63 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:54.161455 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cf7ce-88c2-4078-90f3-8de48655c738 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:54.161716 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7be5d-6de1-4ef8-b297-5423a8df5e63 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:54.161716 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7be5d-6de1-4ef8-b297-5423a8df5e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:54.181737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-ccd7be5d-6de1-4ef8-b297-5423a8df5e63 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:54.183237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ccd7be5d-6de1-4ef8-b297-5423a8df5e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:54.191144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:54.227914 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef945f-b17f-4a28-a295-4d90447863b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:54.228881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef945f-b17f-4a28-a295-4d90447863b9 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:54.229369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef945f-b17f-4a28-a295-4d90447863b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:54.229850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef945f-b17f-4a28-a295-4d90447863b9 None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:54.230769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef945f-b17f-4a28-a295-4d90447863b9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:54.231281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef945f-b17f-4a28-a295-4d90447863b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:54.233059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef945f-b17f-4a28-a295-4d90447863b9 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:54.277606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 373/737] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 12 23:39:54.281187 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7be5d-6de1-4ef8-b297-5423a8df5e63 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:54.283598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 365/738] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 12 23:39:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:54.290185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef945f-b17f-4a28-a295-4d90447863b9 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:54.367851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:54.508488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7be5d-6de1-4ef8-b297-5423a8df5e63 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:54.518760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef945f-b17f-4a28-a295-4d90447863b9 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:54.570104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fd52c-b8e8-4ad1-9bf5-c84b9d865055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:54.571087 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fd52c-b8e8-4ad1-9bf5-c84b9d865055 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:54.571973 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fd52c-b8e8-4ad1-9bf5-c84b9d865055 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:54.572430 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fd52c-b8e8-4ad1-9bf5-c84b9d865055 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:54.573918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fd52c-b8e8-4ad1-9bf5-c84b9d865055 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:54.574417 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fd52c-b8e8-4ad1-9bf5-c84b9d865055 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:54.577053 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fd52c-b8e8-4ad1-9bf5-c84b9d865055 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:54.579885 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fc90d-7a6a-4416-b3e6-edb14661db65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:54.580963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fc90d-7a6a-4416-b3e6-edb14661db65 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:54.581631 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fc90d-7a6a-4416-b3e6-edb14661db65 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:54.582119 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fc90d-7a6a-4416-b3e6-edb14661db65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:54.607708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 374/739] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 12 23:39:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:54.609283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fd52c-b8e8-4ad1-9bf5-c84b9d865055 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:54.651749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:54.691953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fc90d-7a6a-4416-b3e6-edb14661db65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:54.693827 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fc90d-7a6a-4416-b3e6-edb14661db65 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:54.738036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:54.758780 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fd52c-b8e8-4ad1-9bf5-c84b9d865055 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:54.818154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967d260-63f6-4f72-a3c0-0237ad957da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:54.818796 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967d260-63f6-4f72-a3c0-0237ad957da5 None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:54.819069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967d260-63f6-4f72-a3c0-0237ad957da5 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:54.819339 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967d260-63f6-4f72-a3c0-0237ad957da5 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:54.820011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967d260-63f6-4f72-a3c0-0237ad957da5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:54.821627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1967d260-63f6-4f72-a3c0-0237ad957da5 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:54.843682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 366/740] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 12 23:39:54.845221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fc90d-7a6a-4416-b3e6-edb14661db65 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:54.848813 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 375/741] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 23:39:54 2022] POST /identity/v3/services => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:39:54.849846 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967d260-63f6-4f72-a3c0-0237ad957da5 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:55.010215 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:55.021188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967d260-63f6-4f72-a3c0-0237ad957da5 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:55.058952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fc90d-7a6a-4416-b3e6-edb14661db65 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:55.092850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb472686-7c34-4087-84c4-31bfb666d929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:55.093602 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb472686-7c34-4087-84c4-31bfb666d929 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:55.093945 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb472686-7c34-4087-84c4-31bfb666d929 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:55.094220 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb472686-7c34-4087-84c4-31bfb666d929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:55.114618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:55.133922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b7fff-052d-474d-824c-c0c722a54ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:55.135441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b7fff-052d-474d-824c-c0c722a54ac1 None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:55.136251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b7fff-052d-474d-824c-c0c722a54ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:55.136998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b7fff-052d-474d-824c-c0c722a54ac1 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:55.138555 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b7fff-052d-474d-824c-c0c722a54ac1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:55.143313 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b7fff-052d-474d-824c-c0c722a54ac1 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:55.178576 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 367/742] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 23:39:54 2022] POST /identity/v3/services => generated 240 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:39:55.179922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b7fff-052d-474d-824c-c0c722a54ac1 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:55.193495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb472686-7c34-4087-84c4-31bfb666d929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:55.195092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb472686-7c34-4087-84c4-31bfb666d929 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:55.424326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 376/743] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:39:54 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 12 23:39:55.433071 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb472686-7c34-4087-84c4-31bfb666d929 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:55.515976 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:55.556397 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b7fff-052d-474d-824c-c0c722a54ac1 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:55.591236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:55.607630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91af5c-353e-4626-b554-00a2251aabfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:55.610164 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91af5c-353e-4626-b554-00a2251aabfd None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:55.610932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91af5c-353e-4626-b554-00a2251aabfd None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:55.611855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91af5c-353e-4626-b554-00a2251aabfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:55.618612 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb472686-7c34-4087-84c4-31bfb666d929 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:55.642123 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91af5c-353e-4626-b554-00a2251aabfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:55.643618 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91af5c-353e-4626-b554-00a2251aabfd None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:55.685117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b24b7-3a81-4f85-bc7c-096909386212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:55.685716 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b24b7-3a81-4f85-bc7c-096909386212 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:55.686004 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b24b7-3a81-4f85-bc7c-096909386212 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:55.686602 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b24b7-3a81-4f85-bc7c-096909386212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:55.695306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-0b91af5c-353e-4626-b554-00a2251aabfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:55.695306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:55.695306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:55.695306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:55.695306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:55.695306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:55.695306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:55.695306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:55.695306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:55.695306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:55.695306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:55.695306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:55.695306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:55.695306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:55.695306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:55.695306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:55.697195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:55.697195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:55.697195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:55.697195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:55.697195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:55.697195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:55.697195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:55.697195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:55.697195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:55.697195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:55.697195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:55.697195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:55.697195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:55.697195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:55.697195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:55.697195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:55.697195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:55.698902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:55.698902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:55.698902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:55.698902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 368/744] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 518 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:55.709373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91af5c-353e-4626-b554-00a2251aabfd None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:55.724475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b24b7-3a81-4f85-bc7c-096909386212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:55.726159 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b24b7-3a81-4f85-bc7c-096909386212 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:55.751915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-5b2b24b7-3a81-4f85-bc7c-096909386212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:55.751915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:55.751915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:55.751915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:55.751915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:55.751915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:55.751915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:55.751915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:55.751915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:55.751915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:55.751915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:55.751915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:55.751915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:55.751915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:55.751915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:55.751915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:55.753636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:55.753636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:55.753636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:55.753636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:55.753636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:55.753636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:55.753636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:55.753636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:55.753636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:55.753636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:55.753636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:55.753636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:55.753636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:55.753636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:55.753636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:55.753636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:55.753636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:55.755191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:55.755191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:55.755191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:55.755191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 377/745] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:55.761720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b24b7-3a81-4f85-bc7c-096909386212 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:55.952680 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91af5c-353e-4626-b554-00a2251aabfd None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:55.974682 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:55.984930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b24b7-3a81-4f85-bc7c-096909386212 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:56.034584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b07f45-2cde-4cbd-87e9-245a9c3c193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:56.035210 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b07f45-2cde-4cbd-87e9-245a9c3c193d None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:56.035481 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b07f45-2cde-4cbd-87e9-245a9c3c193d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:56.035748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b07f45-2cde-4cbd-87e9-245a9c3c193d None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:56.036408 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b07f45-2cde-4cbd-87e9-245a9c3c193d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:56.036810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b07f45-2cde-4cbd-87e9-245a9c3c193d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:56.038244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b07f45-2cde-4cbd-87e9-245a9c3c193d None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:56.064527 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 369/746] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:56.065209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eda84c-a740-42bf-b7a9-0af31d7dca00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:56.070134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eda84c-a740-42bf-b7a9-0af31d7dca00 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:56.070436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eda84c-a740-42bf-b7a9-0af31d7dca00 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:56.070684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eda84c-a740-42bf-b7a9-0af31d7dca00 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:56.071368 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eda84c-a740-42bf-b7a9-0af31d7dca00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:56.071673 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eda84c-a740-42bf-b7a9-0af31d7dca00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:56.073075 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eda84c-a740-42bf-b7a9-0af31d7dca00 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:56.084585 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b07f45-2cde-4cbd-87e9-245a9c3c193d None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:56.101536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 378/747] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:56.108790 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eda84c-a740-42bf-b7a9-0af31d7dca00 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:56.150619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:56.223068 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b07f45-2cde-4cbd-87e9-245a9c3c193d None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:56.292624 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133a552-d04a-48c4-8697-d1cded050b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:56.295488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133a552-d04a-48c4-8697-d1cded050b31 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:56.296016 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133a552-d04a-48c4-8697-d1cded050b31 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:56.296501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133a552-d04a-48c4-8697-d1cded050b31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:56.318852 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133a552-d04a-48c4-8697-d1cded050b31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:56.321397 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133a552-d04a-48c4-8697-d1cded050b31 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:56.345069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eda84c-a740-42bf-b7a9-0af31d7dca00 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:56.367269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-f133a552-d04a-48c4-8697-d1cded050b31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:56.367269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:56.367269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:56.367269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:56.367269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:56.367269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:56.367269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:56.367269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:56.367269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:56.367269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:56.367269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:56.367269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:56.367269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:56.367269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:56.367269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:56.368252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:56.368252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:56.368252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:56.368252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:56.368252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:56.368252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:56.368252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:56.368252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:56.368252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:56.368252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:56.368252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:56.368252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:56.368252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:56.368252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:56.368252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:56.368252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:56.368252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:56.369136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:56.369136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:56.369136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:56.369136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:56.369136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:56.369136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:56.369136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:56.369136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:56.370058 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 370/748] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:39:56.376214 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133a552-d04a-48c4-8697-d1cded050b31 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:56.406267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e215a38-e0fc-4472-acb0-bfab6389c7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:56.407585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e215a38-e0fc-4472-acb0-bfab6389c7b8 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:56.407585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e215a38-e0fc-4472-acb0-bfab6389c7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:56.407585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e215a38-e0fc-4472-acb0-bfab6389c7b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:56.416775 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e215a38-e0fc-4472-acb0-bfab6389c7b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:56.418471 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e215a38-e0fc-4472-acb0-bfab6389c7b8 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:56.432547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-8e215a38-e0fc-4472-acb0-bfab6389c7b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:56.432547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:56.432547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:56.432547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:56.432547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:56.432547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:56.432547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:56.432547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:56.432547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:56.432547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:56.432547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:56.432547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:56.432547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:39:56.432547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:39:56.432547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:39:56.433533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:39:56.433533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:56.433533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:56.433533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:56.433533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:56.433533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:56.433533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:56.433533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:56.433533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:56.433533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:56.433533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:56.433533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:56.433533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:56.433533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:56.433533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:56.433533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:56.433533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:56.434394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:39:56.434394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:39:56.434394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:39:56.434394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:39:56.434394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:39:56.434394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:39:56.434394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:39:56.434394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:56.434394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 379/749] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:56.445747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e215a38-e0fc-4472-acb0-bfab6389c7b8 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:56.486766 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:56.593924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e215a38-e0fc-4472-acb0-bfab6389c7b8 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:56.638437 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e64914-e32a-4b3b-b0f6-444d84bb01eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:56.639500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e64914-e32a-4b3b-b0f6-444d84bb01eb None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:56.641142 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e64914-e32a-4b3b-b0f6-444d84bb01eb None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:56.641737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e64914-e32a-4b3b-b0f6-444d84bb01eb None admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:56.642727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e64914-e32a-4b3b-b0f6-444d84bb01eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:56.643461 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e64914-e32a-4b3b-b0f6-444d84bb01eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:56.646889 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e64914-e32a-4b3b-b0f6-444d84bb01eb None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:56.657774 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:56.663519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133a552-d04a-48c4-8697-d1cded050b31 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:56.680057 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 380/750] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:56.688726 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e64914-e32a-4b3b-b0f6-444d84bb01eb None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:56.747055 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936f5c8-3a4d-401f-a39f-76cf4eaf4889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:56.747576 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936f5c8-3a4d-401f-a39f-76cf4eaf4889 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:56.747879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936f5c8-3a4d-401f-a39f-76cf4eaf4889 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:56.748134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936f5c8-3a4d-401f-a39f-76cf4eaf4889 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:56.748826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936f5c8-3a4d-401f-a39f-76cf4eaf4889 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:56.749135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936f5c8-3a4d-401f-a39f-76cf4eaf4889 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:56.750737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936f5c8-3a4d-401f-a39f-76cf4eaf4889 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:56.773150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 371/751] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:56.776626 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:56.778969 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936f5c8-3a4d-401f-a39f-76cf4eaf4889 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:56.817307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e64914-e32a-4b3b-b0f6-444d84bb01eb None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:56.886316 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fceb441-1aab-46d9-aa46-2160bc277d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:56.886952 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceb441-1aab-46d9-aa46-2160bc277d3d None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:56.887226 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceb441-1aab-46d9-aa46-2160bc277d3d None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:56.887484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceb441-1aab-46d9-aa46-2160bc277d3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:56.888237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fceb441-1aab-46d9-aa46-2160bc277d3d None admin] RBAC: Adding query filter params (role.id=8cf7b72483b94512b497317ab1d11192, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=e1f49820de264982aeec97fa0be3c290) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:56.888539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fceb441-1aab-46d9-aa46-2160bc277d3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:56.894346 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fceb441-1aab-46d9-aa46-2160bc277d3d None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:56.905813 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 381/752] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:39:56 2022] GET /identity/v3/role_assignments?user.id=e1f49820de264982aeec97fa0be3c290&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=8cf7b72483b94512b497317ab1d11192 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:56.916992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936f5c8-3a4d-401f-a39f-76cf4eaf4889 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:56.956770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89d34e-9cbf-4d4c-b5e1-2f871629e588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:56.957476 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89d34e-9cbf-4d4c-b5e1-2f871629e588 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:56.957780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89d34e-9cbf-4d4c-b5e1-2f871629e588 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:56.958019 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89d34e-9cbf-4d4c-b5e1-2f871629e588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:56.958799 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89d34e-9cbf-4d4c-b5e1-2f871629e588 None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=43c45ae3144b4fe8ab4e921fda30164a) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:56.959111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89d34e-9cbf-4d4c-b5e1-2f871629e588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:56.960663 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89d34e-9cbf-4d4c-b5e1-2f871629e588 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:56.967980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 372/753] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:39:56 2022] GET /identity/v3/role_assignments?user.id=43c45ae3144b4fe8ab4e921fda30164a&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=440092230f024959a90e846ab29c6367 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:57.094343 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ab113-a1ca-4602-87d3-f1b154bc8183 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:57.095141 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ab113-a1ca-4602-87d3-f1b154bc8183 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:57.095141 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ab113-a1ca-4602-87d3-f1b154bc8183 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:57.096660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 382/754] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:57.102988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072257a8-2fc5-4ad1-a99d-2af8ac4ca6a1 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:57.103288 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072257a8-2fc5-4ad1-a99d-2af8ac4ca6a1 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:57.103566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072257a8-2fc5-4ad1-a99d-2af8ac4ca6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:57.130586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-072257a8-2fc5-4ad1-a99d-2af8ac4ca6a1 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:57.131865 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-072257a8-2fc5-4ad1-a99d-2af8ac4ca6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:57.158157 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:57.222791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 373/755] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:39:57.646971 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ab113-a1ca-4602-87d3-f1b154bc8183 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:57.793702 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ab113-a1ca-4602-87d3-f1b154bc8183 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:57.842859 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a81aca-21ee-49e2-af0e-c22858725e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:57.843616 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a81aca-21ee-49e2-af0e-c22858725e9f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:57.843909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a81aca-21ee-49e2-af0e-c22858725e9f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:57.844189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a81aca-21ee-49e2-af0e-c22858725e9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:57.858789 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:57.862752 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a81aca-21ee-49e2-af0e-c22858725e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:39:57.869599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-f2a81aca-21ee-49e2-af0e-c22858725e9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:39:57.869599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:57.869599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:57.869599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:57.869599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:57.869599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:57.869599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:57.869599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:57.869599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:57.869599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:57.869599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:57.869599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:57.869599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:39:57.869599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:39:57.869599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:39:57.869599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:39:57.870618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:39:57.870618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:39:57.870618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:39:57.870618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:39:57.870618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:57.870618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:57.870618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:57.870618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:57.870618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:57.870618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:57.870618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:57.870618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:57.870618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:57.870618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:57.870618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:57.870618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:57.871447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:57.871447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:57.871447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:57.871447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:57.871447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:39:57.871447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:39:57.871447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:39:57.871447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:39:57.871447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:39:57.871447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:39:57.871447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:39:57.871447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:57.871447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 383/756] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:39:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:57.881168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072257a8-2fc5-4ad1-a99d-2af8ac4ca6a1 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:58.141040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072257a8-2fc5-4ad1-a99d-2af8ac4ca6a1 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:58.226404 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fb085-9ff9-429e-b823-09be58475185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:58.227471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fb085-9ff9-429e-b823-09be58475185 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:58.227963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fb085-9ff9-429e-b823-09be58475185 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:58.228442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fb085-9ff9-429e-b823-09be58475185 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:58.229771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fb085-9ff9-429e-b823-09be58475185 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:58.230327 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fb085-9ff9-429e-b823-09be58475185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:58.232998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fb085-9ff9-429e-b823-09be58475185 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:58.251597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 374/757] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:39:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:39:58.260042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a81aca-21ee-49e2-af0e-c22858725e9f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:58.506554 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a81aca-21ee-49e2-af0e-c22858725e9f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:58.575897 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad9957-f5e3-4f07-8816-979e5ea6b544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:58.577502 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad9957-f5e3-4f07-8816-979e5ea6b544 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:58.578307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad9957-f5e3-4f07-8816-979e5ea6b544 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:58.579077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad9957-f5e3-4f07-8816-979e5ea6b544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:58.599092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad9957-f5e3-4f07-8816-979e5ea6b544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:58.602343 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad9957-f5e3-4f07-8816-979e5ea6b544 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:58.634601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-ffad9957-f5e3-4f07-8816-979e5ea6b544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:58.634601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:58.634601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:58.634601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:58.634601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:58.634601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:58.634601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:58.634601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:58.634601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:58.634601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:58.634601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:58.634601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:58.634601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:39:58.634601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:39:58.634601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:39:58.634601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:39:58.636491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:58.636491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:58.636491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:58.636491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:58.636491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:58.636491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:58.636491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:58.636491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:58.636491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:58.636491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:58.636491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:58.636491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:58.636491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:58.636491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:58.636491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:58.636491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:58.636491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:39:58.638250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:39:58.638250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:39:58.638250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:58.642026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 384/758] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:58.651457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fb085-9ff9-429e-b823-09be58475185 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:58.707012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:58.918415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fb085-9ff9-429e-b823-09be58475185 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:58.965447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092a85a-a9c6-4caf-b260-4362a135e90d None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:58.966103 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092a85a-a9c6-4caf-b260-4362a135e90d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:58.966644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092a85a-a9c6-4caf-b260-4362a135e90d None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:58.968750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 385/759] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:39:58.975275 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4affac3-d40f-4bfe-86c4-f944ed9c9efb None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:58.975901 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4affac3-d40f-4bfe-86c4-f944ed9c9efb None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:58.976371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4affac3-d40f-4bfe-86c4-f944ed9c9efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:58.980829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ae2b5-8f1b-4fb8-8c03-f650c0b2a7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:58.981525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ae2b5-8f1b-4fb8-8c03-f650c0b2a7c7 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:58.981812 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ae2b5-8f1b-4fb8-8c03-f650c0b2a7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:58.982086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ae2b5-8f1b-4fb8-8c03-f650c0b2a7c7 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:58.982771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ae2b5-8f1b-4fb8-8c03-f650c0b2a7c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:58.983079 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ae2b5-8f1b-4fb8-8c03-f650c0b2a7c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:58.984627 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ae2b5-8f1b-4fb8-8c03-f650c0b2a7c7 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:59.009049 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 375/760] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:59.011139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-a4affac3-d40f-4bfe-86c4-f944ed9c9efb None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:59.013055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a4affac3-d40f-4bfe-86c4-f944ed9c9efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:59.017564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ae2b5-8f1b-4fb8-8c03-f650c0b2a7c7 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:59.098837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:59.133979 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 386/761] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:39:59.135961 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcda099-75a4-4145-998d-d89ffc67e0b4 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:59.136504 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcda099-75a4-4145-998d-d89ffc67e0b4 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:59.137080 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcda099-75a4-4145-998d-d89ffc67e0b4 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:59.139183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 387/762] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:39:59.148906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf8fc4-d000-4508-aea6-7995026e36c1 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:59.149603 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf8fc4-d000-4508-aea6-7995026e36c1 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:59.150126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf8fc4-d000-4508-aea6-7995026e36c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:59.180691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:59.189100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-18cf8fc4-d000-4508-aea6-7995026e36c1 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:39:59.191477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-18cf8fc4-d000-4508-aea6-7995026e36c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:39:59.246963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ae2b5-8f1b-4fb8-8c03-f650c0b2a7c7 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:59.326350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5f74b-2258-4f95-92bc-05bc201b2643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:59.327007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f74b-2258-4f95-92bc-05bc201b2643 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:59.327281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f74b-2258-4f95-92bc-05bc201b2643 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:59.327542 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5f74b-2258-4f95-92bc-05bc201b2643 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:59.339112 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 388/763] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:39:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:39:59.346433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5f74b-2258-4f95-92bc-05bc201b2643 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:59.347996 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5f74b-2258-4f95-92bc-05bc201b2643 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:59.364517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-6cb5f74b-2258-4f95-92bc-05bc201b2643 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:39:59.364517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:59.364517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:59.364517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:59.364517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:59.364517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:59.364517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:59.364517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:59.364517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:59.364517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:59.364517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:59.364517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:59.364517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:39:59.364517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:39:59.364517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:39:59.364517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:59.365594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:59.366579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:59.366579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:59.366579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:39:59.366579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:39:59.366579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:39:59.366579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:39:59.366579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:39:59.366579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:39:59.366579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:39:59.366579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:59.366579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 376/764] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 23:39:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:59.377213 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf8fc4-d000-4508-aea6-7995026e36c1 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:59.639085 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5f74b-2258-4f95-92bc-05bc201b2643 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:59.644853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf8fc4-d000-4508-aea6-7995026e36c1 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:59.670024 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:59.714247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b0f7a-3676-47ea-81fe-4c6f82abcde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:59.715300 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b0f7a-3676-47ea-81fe-4c6f82abcde3 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:59.715862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b0f7a-3676-47ea-81fe-4c6f82abcde3 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:59.716302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b0f7a-3676-47ea-81fe-4c6f82abcde3 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:59.717739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b0f7a-3676-47ea-81fe-4c6f82abcde3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:39:59.718264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b0f7a-3676-47ea-81fe-4c6f82abcde3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:59.725372 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b0f7a-3676-47ea-81fe-4c6f82abcde3 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:59.761812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 389/765] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 23:39:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:39:59.762927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b0f7a-3676-47ea-81fe-4c6f82abcde3 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:59.849722 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5f74b-2258-4f95-92bc-05bc201b2643 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:59.888918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b0f7a-3676-47ea-81fe-4c6f82abcde3 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:39:59.918226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4116c-05da-4e72-aabe-b1aefb2b6c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:59.919124 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4116c-05da-4e72-aabe-b1aefb2b6c65 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:59.919991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4116c-05da-4e72-aabe-b1aefb2b6c65 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:59.920408 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4116c-05da-4e72-aabe-b1aefb2b6c65 None admin] PATH_INFO: `/v3/services/network` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:59.921152 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4116c-05da-4e72-aabe-b1aefb2b6c65 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:59.922897 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4116c-05da-4e72-aabe-b1aefb2b6c65 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:59.926875 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:39:59.934311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-41c4116c-05da-4e72-aabe-b1aefb2b6c65 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:39:59.934311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:59.934311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:39:59.934311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:39:59.934311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:39:59.934311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:39:59.934311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:39:59.934311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:39:59.934311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:39:59.934311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:59.934311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:39:59.934311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:59.934311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:59.934311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:59.934311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:59.934311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:59.934311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:59.935494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:59.935494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:59.935494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:59.935494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:59.935494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:59.935494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:59.935494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:39:59.935494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:39:59.935494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:39:59.935494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:39:59.935494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:59.935494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:59.935494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:59.935494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:59.935494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:59.935494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:59.936756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:59.936756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:59.936756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:59.936756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:59.936756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:59.936756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:59.936756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:59.936756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:59.936756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:59.936756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:59.936756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:39:59.936756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:39:59.936756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:39:59.936756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:39:59.939195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 377/766] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:39:59 2022] GET /identity/v3/services/network => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:39:59.940402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4116c-05da-4e72-aabe-b1aefb2b6c65 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:39:59.961579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaff0e7-1e3b-455c-bc4e-83523bf7ee77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:39:59.962845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaff0e7-1e3b-455c-bc4e-83523bf7ee77 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:39:59.963317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaff0e7-1e3b-455c-bc4e-83523bf7ee77 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:39:59.963779 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaff0e7-1e3b-455c-bc4e-83523bf7ee77 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:39:59.964959 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaff0e7-1e3b-455c-bc4e-83523bf7ee77 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:39:59.967606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaff0e7-1e3b-455c-bc4e-83523bf7ee77 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:39:59.989262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-9aaff0e7-1e3b-455c-bc4e-83523bf7ee77 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:39:59.989262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:59.989262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:39:59.989262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:39:59.989262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:39:59.989262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:39:59.989262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:39:59.989262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:39:59.989262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:39:59.989262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:59.989262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:39:59.989262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:59.989262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:39:59.989262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:39:59.989262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:39:59.989262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:39:59.989262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:39:59.990432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:39:59.990432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:39:59.990432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:39:59.990432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:39:59.990432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:39:59.990432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:39:59.990432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:39:59.990432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:39:59.990432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:39:59.990432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:39:59.990432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:39:59.990432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:39:59.990432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:39:59.990432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:39:59.990432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:39:59.990432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:39:59.991248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:39:59.991248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:39:59.991248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:39:59.991248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:39:59.991248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:39:59.991248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:39:59.991248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:39:59.991248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:39:59.991248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:39:59.991248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:39:59.991248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:39:59.991248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:39:59.991248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:39:59.991248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:39:59.997826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 390/767] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Sep 12 23:39:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:39:59.999352 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaff0e7-1e3b-455c-bc4e-83523bf7ee77 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:00.072816 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4116c-05da-4e72-aabe-b1aefb2b6c65 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:00.088761 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:00.112810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7c2cc-97b4-45b9-8d34-738681d5cdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:00.113903 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7c2cc-97b4-45b9-8d34-738681d5cdd2 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:00.114415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7c2cc-97b4-45b9-8d34-738681d5cdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:00.114876 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7c2cc-97b4-45b9-8d34-738681d5cdd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:00.129444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7c2cc-97b4-45b9-8d34-738681d5cdd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:00.131306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7c2cc-97b4-45b9-8d34-738681d5cdd2 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:00.148834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-16f7c2cc-97b4-45b9-8d34-738681d5cdd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:00.148834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:00.148834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:00.148834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:00.148834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:00.148834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:00.148834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:00.148834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:00.148834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:00.148834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:00.148834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:00.148834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:00.148834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:00.148834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:00.148834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:00.148834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:00.149896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:00.149896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:00.149896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:00.149896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:00.149896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:00.149896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:00.149896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:00.149896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:00.149896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:00.149896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:00.149896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:00.149896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:00.149896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:00.149896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:00.149896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:00.149896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:00.149896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:00.150762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:00.150762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:00.150762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:00.153081 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 378/768] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:00.154262 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7c2cc-97b4-45b9-8d34-738681d5cdd2 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:00.208797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaff0e7-1e3b-455c-bc4e-83523bf7ee77 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:00.219064 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:00.251273 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba7ef3-e807-4722-b88d-d37ec08917d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:00.251912 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba7ef3-e807-4722-b88d-d37ec08917d8 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:00.252185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba7ef3-e807-4722-b88d-d37ec08917d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:00.252453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba7ef3-e807-4722-b88d-d37ec08917d8 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:00.253108 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba7ef3-e807-4722-b88d-d37ec08917d8 None admin] RBAC: Adding query filter params (name=network) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:00.253450 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba7ef3-e807-4722-b88d-d37ec08917d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:00.254911 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba7ef3-e807-4722-b88d-d37ec08917d8 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:00.260425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 391/769] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 23:39:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:00.267540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca682d0-2a22-4876-b37a-0ae19e52e685 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:00.267540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca682d0-2a22-4876-b37a-0ae19e52e685 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:00.267540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca682d0-2a22-4876-b37a-0ae19e52e685 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:00.267540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 392/770] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:00.267540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca682d0-2a22-4876-b37a-0ae19e52e685 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:00.299026 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7c2cc-97b4-45b9-8d34-738681d5cdd2 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:00.357137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dbd9b-fcef-40e7-b190-fe88ccc77a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:00.358575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dbd9b-fcef-40e7-b190-fe88ccc77a5e None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:00.359016 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dbd9b-fcef-40e7-b190-fe88ccc77a5e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:00.359492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9dbd9b-fcef-40e7-b190-fe88ccc77a5e None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:00.360530 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9dbd9b-fcef-40e7-b190-fe88ccc77a5e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:00.361010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9dbd9b-fcef-40e7-b190-fe88ccc77a5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:00.363191 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9dbd9b-fcef-40e7-b190-fe88ccc77a5e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:00.375315 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 379/771] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 12 23:40:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:00.375315 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dbd9b-fcef-40e7-b190-fe88ccc77a5e None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:00.448819 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:00.457270 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca682d0-2a22-4876-b37a-0ae19e52e685 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:00.505661 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a0df9-f2d9-4b0f-a742-999f76a86a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:00.506289 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a0df9-f2d9-4b0f-a742-999f76a86a60 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:00.506563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a0df9-f2d9-4b0f-a742-999f76a86a60 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:00.506825 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a0df9-f2d9-4b0f-a742-999f76a86a60 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:00.507486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a0df9-f2d9-4b0f-a742-999f76a86a60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:00.507779 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a0df9-f2d9-4b0f-a742-999f76a86a60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:00.509164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a0df9-f2d9-4b0f-a742-999f76a86a60 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:00.522970 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 393/772] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:00.523250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9dbd9b-fcef-40e7-b190-fe88ccc77a5e None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:00.524299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3b080-4bdd-4377-bc24-5c7d1dddb0b0 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:00.524529 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3b080-4bdd-4377-bc24-5c7d1dddb0b0 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:00.524793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3b080-4bdd-4377-bc24-5c7d1dddb0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:00.547264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-1ee3b080-4bdd-4377-bc24-5c7d1dddb0b0 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:00.549089 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1ee3b080-4bdd-4377-bc24-5c7d1dddb0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:00.552330 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:00.578999 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a216f-d813-41d6-88a3-a318a777c8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:00.579774 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a216f-d813-41d6-88a3-a318a777c8cb None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:00.580243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a216f-d813-41d6-88a3-a318a777c8cb None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:00.580616 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a216f-d813-41d6-88a3-a318a777c8cb None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:00.581530 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a216f-d813-41d6-88a3-a318a777c8cb None admin] RBAC: Adding query filter params (type=network) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:00.582012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a216f-d813-41d6-88a3-a318a777c8cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:00.583805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a216f-d813-41d6-88a3-a318a777c8cb None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:00.589982 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 380/773] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 23:40:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:00.591265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a216f-d813-41d6-88a3-a318a777c8cb None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:00.657476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 394/774] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:00.657476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71990e31-c416-4826-b91d-947f2ccf0377 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:00.657476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71990e31-c416-4826-b91d-947f2ccf0377 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:00.657476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71990e31-c416-4826-b91d-947f2ccf0377 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:00.659041 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 395/775] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:00.659653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71990e31-c416-4826-b91d-947f2ccf0377 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:00.747738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a216f-d813-41d6-88a3-a318a777c8cb None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:00.789012 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:00.811715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71990e31-c416-4826-b91d-947f2ccf0377 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:00.817879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea981e7-ffc0-43f5-a345-243f419ad842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:00.818515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea981e7-ffc0-43f5-a345-243f419ad842 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:00.818785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea981e7-ffc0-43f5-a345-243f419ad842 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:00.819062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea981e7-ffc0-43f5-a345-243f419ad842 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:00.819701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea981e7-ffc0-43f5-a345-243f419ad842 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:00.819997 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea981e7-ffc0-43f5-a345-243f419ad842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:00.821466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea981e7-ffc0-43f5-a345-243f419ad842 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:00.829074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 381/776] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 12 23:40:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:00.829855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea981e7-ffc0-43f5-a345-243f419ad842 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:00.862835 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8202e19-860b-4030-b147-1c630a397d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:00.863756 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202e19-860b-4030-b147-1c630a397d9c None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:00.864172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202e19-860b-4030-b147-1c630a397d9c None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:00.864577 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202e19-860b-4030-b147-1c630a397d9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:00.875081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8202e19-860b-4030-b147-1c630a397d9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:00.877106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8202e19-860b-4030-b147-1c630a397d9c None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:00.882929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:00.895950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-c8202e19-860b-4030-b147-1c630a397d9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:00.895950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:00.895950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:00.895950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:00.895950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:00.895950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:00.895950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:00.895950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:00.895950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:00.895950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:00.895950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:00.895950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:00.895950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:40:00.895950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:40:00.895950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:40:00.897737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:40:00.897737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:00.897737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:00.897737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:00.897737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:00.897737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:00.897737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:00.897737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:00.897737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:00.897737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:00.897737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:00.897737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:00.897737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:00.897737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:00.897737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:00.897737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:00.897737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:00.900505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:40:00.900505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:40:00.900505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:40:00.900505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:40:00.900505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:40:00.900505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:40:00.900505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:00.900505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:00.900505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 396/777] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:00.900505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30cbee-435c-46d5-a55b-c5bda1cf7a4c None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:00.900505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30cbee-435c-46d5-a55b-c5bda1cf7a4c None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:00.902709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30cbee-435c-46d5-a55b-c5bda1cf7a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:00.938155 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-bf30cbee-435c-46d5-a55b-c5bda1cf7a4c None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:00.942236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-bf30cbee-435c-46d5-a55b-c5bda1cf7a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:00.967109 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea981e7-ffc0-43f5-a345-243f419ad842 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:01.037372 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 397/778] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:01.037372 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30cbee-435c-46d5-a55b-c5bda1cf7a4c None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:01.040831 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae136ff-4550-4cd4-9f45-b92e2449fbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:01.041829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae136ff-4550-4cd4-9f45-b92e2449fbf9 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:01.042334 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae136ff-4550-4cd4-9f45-b92e2449fbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:01.042812 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae136ff-4550-4cd4-9f45-b92e2449fbf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:01.044370 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae136ff-4550-4cd4-9f45-b92e2449fbf9 None admin] RBAC: Adding query filter params (interface=public, service_id=fabd5d8bbb504b5c8f0e2cbe8cfbefa2, region_id=RegionOne) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:01.044900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae136ff-4550-4cd4-9f45-b92e2449fbf9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:01.047614 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae136ff-4550-4cd4-9f45-b92e2449fbf9 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:01.062013 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 382/779] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 12 23:40:00 2022] GET /identity/v3/endpoints?service_id=fabd5d8bbb504b5c8f0e2cbe8cfbefa2&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:01.063486 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae136ff-4550-4cd4-9f45-b92e2449fbf9 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:01.145965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:01.177250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30cbee-435c-46d5-a55b-c5bda1cf7a4c None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:01.216402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d13879-fe79-43ee-9097-791eea3ec7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:01.217125 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d13879-fe79-43ee-9097-791eea3ec7b3 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:01.217492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d13879-fe79-43ee-9097-791eea3ec7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:01.217823 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d13879-fe79-43ee-9097-791eea3ec7b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:01.218648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d13879-fe79-43ee-9097-791eea3ec7b3 None admin] RBAC: Adding query filter params (interface=public, service_id=3204f5f44ebb40488d1acd5eae84fb0a, region_id=RegionOne) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:01.219009 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d13879-fe79-43ee-9097-791eea3ec7b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:01.220394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d13879-fe79-43ee-9097-791eea3ec7b3 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:01.242292 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 398/780] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 12 23:40:01 2022] GET /identity/v3/endpoints?service_id=3204f5f44ebb40488d1acd5eae84fb0a&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:01.242292 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d13879-fe79-43ee-9097-791eea3ec7b3 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:01.252056 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae136ff-4550-4cd4-9f45-b92e2449fbf9 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:01.268629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:01.315658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cba036-a710-4fcf-8d72-9cee63a0e744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:01.316694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba036-a710-4fcf-8d72-9cee63a0e744 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:01.317244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba036-a710-4fcf-8d72-9cee63a0e744 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:01.317885 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba036-a710-4fcf-8d72-9cee63a0e744 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:01.319082 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cba036-a710-4fcf-8d72-9cee63a0e744 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:01.319612 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cba036-a710-4fcf-8d72-9cee63a0e744 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:01.322335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cba036-a710-4fcf-8d72-9cee63a0e744 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:01.348894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 383/781] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:40:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:01.348894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cba036-a710-4fcf-8d72-9cee63a0e744 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:01.428566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d13879-fe79-43ee-9097-791eea3ec7b3 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:01.481932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa64a2f-1b4f-4597-8861-cd21930a50eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:01.483031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa64a2f-1b4f-4597-8861-cd21930a50eb None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:01.483526 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa64a2f-1b4f-4597-8861-cd21930a50eb None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:01.483999 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa64a2f-1b4f-4597-8861-cd21930a50eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:01.486649 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cba036-a710-4fcf-8d72-9cee63a0e744 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:01.503178 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa64a2f-1b4f-4597-8861-cd21930a50eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:40:01.509607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-caa64a2f-1b4f-4597-8861-cd21930a50eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:40:01.509607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:01.509607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:01.509607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:01.509607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:01.509607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:01.509607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:01.509607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:01.509607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:01.509607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:01.509607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:01.509607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:01.509607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:40:01.509607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:40:01.509607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:40:01.509607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:40:01.511773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:40:01.511773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:40:01.511773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:40:01.511773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:40:01.511773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:01.511773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:01.511773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:01.511773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:01.511773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:01.511773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:01.511773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:01.511773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:01.511773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:01.511773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:01.511773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:01.511773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:01.514186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:01.514186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:01.514186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:01.514186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:01.514186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:40:01.514186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:40:01.514186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:40:01.514186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:40:01.514186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:40:01.514186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:40:01.514186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:40:01.514186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:01.514186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 399/782] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:40:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:01.514186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa64a2f-1b4f-4597-8861-cd21930a50eb None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:01.517107 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:01.532460 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65e289-80c1-43e7-975e-d08984fa2a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:01.533084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65e289-80c1-43e7-975e-d08984fa2a2b None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:01.533389 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65e289-80c1-43e7-975e-d08984fa2a2b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:01.533670 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65e289-80c1-43e7-975e-d08984fa2a2b None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:01.534285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65e289-80c1-43e7-975e-d08984fa2a2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:01.535680 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65e289-80c1-43e7-975e-d08984fa2a2b None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:01.541197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 384/783] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 23:40:01 2022] GET /identity/v3/services => generated 772 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:01.542121 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65e289-80c1-43e7-975e-d08984fa2a2b None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:01.595813 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:01.678164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa64a2f-1b4f-4597-8861-cd21930a50eb None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:01.725367 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cac342-7e36-40e4-ba06-ba39c68c0120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:01.726034 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cac342-7e36-40e4-ba06-ba39c68c0120 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:01.726454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cac342-7e36-40e4-ba06-ba39c68c0120 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:01.726737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cac342-7e36-40e4-ba06-ba39c68c0120 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:01.727380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cac342-7e36-40e4-ba06-ba39c68c0120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:01.728824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cac342-7e36-40e4-ba06-ba39c68c0120 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:01.733388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65e289-80c1-43e7-975e-d08984fa2a2b None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:01.745803 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 400/784] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 23:40:01 2022] GET /identity/v3/services => generated 772 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:01.746583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cac342-7e36-40e4-ba06-ba39c68c0120 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:01.806183 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82011da-2457-4bde-a92f-1ea57d9cc8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:01.807450 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82011da-2457-4bde-a92f-1ea57d9cc8d6 None admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:01.807831 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82011da-2457-4bde-a92f-1ea57d9cc8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:01.808172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82011da-2457-4bde-a92f-1ea57d9cc8d6 None admin] PATH_INFO: `/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/4a87e18c89ff419f8e428e376d33462c/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:01.810848 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82011da-2457-4bde-a92f-1ea57d9cc8d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=21118e9e4fa94603b2c0880dd0d5f5ba, user_id=4a87e18c89ff419f8e428e376d33462c, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:01.813684 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82011da-2457-4bde-a92f-1ea57d9cc8d6 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:01.835134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 385/785] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:40:01 2022] PUT /identity/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/4a87e18c89ff419f8e428e376d33462c/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:40:01.845514 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82011da-2457-4bde-a92f-1ea57d9cc8d6 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:01.974077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:02.059069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cac342-7e36-40e4-ba06-ba39c68c0120 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:02.069085 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:02.086293 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82011da-2457-4bde-a92f-1ea57d9cc8d6 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:02.130384 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265f150-378d-4ecb-885f-2914172ed8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:02.131114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265f150-378d-4ecb-885f-2914172ed8c8 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:02.131462 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265f150-378d-4ecb-885f-2914172ed8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:02.131809 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265f150-378d-4ecb-885f-2914172ed8c8 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:02.132572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265f150-378d-4ecb-885f-2914172ed8c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:02.132950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265f150-378d-4ecb-885f-2914172ed8c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:02.134506 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3851e-6418-4c13-998c-f3e3eefea104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:02.134717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265f150-378d-4ecb-885f-2914172ed8c8 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:02.136076 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3851e-6418-4c13-998c-f3e3eefea104 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:02.136758 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3851e-6418-4c13-998c-f3e3eefea104 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:02.137508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3851e-6418-4c13-998c-f3e3eefea104 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:02.145007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 386/786] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:40:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:02.151082 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265f150-378d-4ecb-885f-2914172ed8c8 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:02.162991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3851e-6418-4c13-998c-f3e3eefea104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:40:02.175988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-65c3851e-6418-4c13-998c-f3e3eefea104 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:40:02.175988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:02.175988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:02.175988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:02.175988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:02.175988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:02.175988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:02.175988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:02.175988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:02.175988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:02.175988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:02.175988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:02.175988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:40:02.175988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:40:02.175988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:40:02.175988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:40:02.178042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:40:02.178042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:40:02.178042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:40:02.178042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:40:02.178042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:02.178042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:02.178042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:02.178042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:02.178042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:02.178042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:02.178042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:02.178042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:02.178042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:02.178042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:02.178042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:02.178042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:02.179708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:02.179708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:02.179708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:02.179708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:02.179708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:40:02.179708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:40:02.179708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:40:02.179708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:40:02.179708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:40:02.179708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:40:02.179708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:40:02.179708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:02.179708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 401/787] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:40:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:02.190769 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3851e-6418-4c13-998c-f3e3eefea104 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:02.344443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265f150-378d-4ecb-885f-2914172ed8c8 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:02.389077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3851e-6418-4c13-998c-f3e3eefea104 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:02.418199 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da849655-1975-4790-8c62-b5ebdb016ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:02.418891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da849655-1975-4790-8c62-b5ebdb016ff1 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:02.419163 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da849655-1975-4790-8c62-b5ebdb016ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:02.419435 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da849655-1975-4790-8c62-b5ebdb016ff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:02.445064 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da849655-1975-4790-8c62-b5ebdb016ff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:02.446594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da849655-1975-4790-8c62-b5ebdb016ff1 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:02.468843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:02.478276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71330367-b6eb-4b90-bac9-5c3c1078a44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:02.479356 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71330367-b6eb-4b90-bac9-5c3c1078a44b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:02.479857 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71330367-b6eb-4b90-bac9-5c3c1078a44b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:02.480400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71330367-b6eb-4b90-bac9-5c3c1078a44b None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:02.481767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71330367-b6eb-4b90-bac9-5c3c1078a44b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:02.482500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71330367-b6eb-4b90-bac9-5c3c1078a44b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:02.485243 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71330367-b6eb-4b90-bac9-5c3c1078a44b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:02.502224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 402/788] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:40:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:02.518265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-da849655-1975-4790-8c62-b5ebdb016ff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:02.518265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:02.518265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:02.518265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:02.518265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:02.518265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:02.518265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:02.518265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:02.518265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:02.518265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:02.518265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:02.518265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:02.518265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:02.518265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:02.518265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:02.518265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:02.519318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:02.519318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:02.519318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:02.519318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:02.519318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:02.519318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:02.519318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:02.519318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:02.519318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:02.519318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:02.519318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:02.519318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:02.519318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:02.519318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:02.519318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:02.519318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:02.519318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:02.520216 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:02.520216 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:02.520216 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:02.520818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 387/789] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:02.522896 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71330367-b6eb-4b90-bac9-5c3c1078a44b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:02.527023 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da849655-1975-4790-8c62-b5ebdb016ff1 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:02.538005 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:02.723736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da849655-1975-4790-8c62-b5ebdb016ff1 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:02.737989 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71330367-b6eb-4b90-bac9-5c3c1078a44b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:02.794179 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b6236-9230-42d3-b58f-455432b2c44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:02.794824 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b6236-9230-42d3-b58f-455432b2c44a None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:02.795113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b6236-9230-42d3-b58f-455432b2c44a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:02.795383 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b6236-9230-42d3-b58f-455432b2c44a None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:02.796070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b6236-9230-42d3-b58f-455432b2c44a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:02.796379 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b6236-9230-42d3-b58f-455432b2c44a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:02.797968 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b6236-9230-42d3-b58f-455432b2c44a None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:02.817147 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03fe90-a649-4e93-9337-6a2a62050ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:02.817864 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03fe90-a649-4e93-9337-6a2a62050ae3 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:02.818144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03fe90-a649-4e93-9337-6a2a62050ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:02.818418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03fe90-a649-4e93-9337-6a2a62050ae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:02.832404 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 388/790] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:02.838561 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b6236-9230-42d3-b58f-455432b2c44a None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:02.842741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03fe90-a649-4e93-9337-6a2a62050ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:02.844423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03fe90-a649-4e93-9337-6a2a62050ae3 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:02.876965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-4a03fe90-a649-4e93-9337-6a2a62050ae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:02.876965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:02.876965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:02.876965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:02.876965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:02.876965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:02.876965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:02.876965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:02.876965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:02.876965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:02.876965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:02.876965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:02.876965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:02.876965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:02.876965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:02.876965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:02.878044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:02.878044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:02.878044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:02.878044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:02.878044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:02.878044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:02.878044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:02.878044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:02.878044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:02.878044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:02.878044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:02.878044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:02.878044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:02.878044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:02.878044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:02.878044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:02.878044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:02.878943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:02.878943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:02.878943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:02.879784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 403/791] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:02.896947 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03fe90-a649-4e93-9337-6a2a62050ae3 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:03.006815 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:03.010658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:03.095702 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03fe90-a649-4e93-9337-6a2a62050ae3 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:03.136642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046d66a-9c39-4f1e-88ac-cdfa2f8aa793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:03.137279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046d66a-9c39-4f1e-88ac-cdfa2f8aa793 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:03.137591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046d66a-9c39-4f1e-88ac-cdfa2f8aa793 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:03.137867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046d66a-9c39-4f1e-88ac-cdfa2f8aa793 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:03.138629 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046d66a-9c39-4f1e-88ac-cdfa2f8aa793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:03.139496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046d66a-9c39-4f1e-88ac-cdfa2f8aa793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:03.141177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046d66a-9c39-4f1e-88ac-cdfa2f8aa793 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:03.148853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b6236-9230-42d3-b58f-455432b2c44a None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:03.155465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 404/792] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:03.163798 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046d66a-9c39-4f1e-88ac-cdfa2f8aa793 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:03.228612 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec957f1c-ed94-48af-a9f6-13c9234a0091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:03.229632 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec957f1c-ed94-48af-a9f6-13c9234a0091 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:03.229914 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec957f1c-ed94-48af-a9f6-13c9234a0091 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:03.230187 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec957f1c-ed94-48af-a9f6-13c9234a0091 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:03.239241 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec957f1c-ed94-48af-a9f6-13c9234a0091 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:03.240724 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec957f1c-ed94-48af-a9f6-13c9234a0091 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:03.254832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-ec957f1c-ed94-48af-a9f6-13c9234a0091 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:40:03.254832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:03.254832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:03.254832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:03.254832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:03.254832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:03.254832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:03.254832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:03.254832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:03.254832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:03.254832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:03.254832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:03.254832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:40:03.254832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:40:03.254832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:40:03.254832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:03.256918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:03.258165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:03.258165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:03.258165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:40:03.258165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:40:03.258165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:40:03.258165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:40:03.258165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:40:03.258165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:40:03.258165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:40:03.258165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:03.258165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 389/793] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 23:40:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:03.269240 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec957f1c-ed94-48af-a9f6-13c9234a0091 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:03.395488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec957f1c-ed94-48af-a9f6-13c9234a0091 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:03.427893 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:03.439300 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:03.440788 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04f9aa-6dd9-4f80-b0ac-c49bf7af7871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:03.442051 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04f9aa-6dd9-4f80-b0ac-c49bf7af7871 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:03.442616 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04f9aa-6dd9-4f80-b0ac-c49bf7af7871 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:03.443033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04f9aa-6dd9-4f80-b0ac-c49bf7af7871 None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:03.443943 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04f9aa-6dd9-4f80-b0ac-c49bf7af7871 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:03.444883 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046d66a-9c39-4f1e-88ac-cdfa2f8aa793 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:03.449582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04f9aa-6dd9-4f80-b0ac-c49bf7af7871 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:03.449582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04f9aa-6dd9-4f80-b0ac-c49bf7af7871 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:03.491055 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 390/794] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 12 23:40:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:03.492072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04f9aa-6dd9-4f80-b0ac-c49bf7af7871 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:03.520425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05df3a-6bc7-4096-81f5-86b4e845b999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:03.521093 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05df3a-6bc7-4096-81f5-86b4e845b999 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:03.521289 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05df3a-6bc7-4096-81f5-86b4e845b999 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:03.521589 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05df3a-6bc7-4096-81f5-86b4e845b999 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:03.536648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05df3a-6bc7-4096-81f5-86b4e845b999 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:03.539215 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05df3a-6bc7-4096-81f5-86b4e845b999 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:03.558212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-7f05df3a-6bc7-4096-81f5-86b4e845b999 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:40:03.558212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:03.558212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:03.558212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:03.558212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:03.558212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:03.558212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:03.558212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:03.558212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:03.558212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:03.558212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:03.558212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:03.558212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:40:03.558212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:40:03.558212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:40:03.558212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:03.559219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:03.560169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:03.560169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:03.560169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:40:03.560169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:40:03.560169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:40:03.560169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:40:03.560169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:40:03.560169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:40:03.560169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:40:03.560169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:03.560704 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 405/795] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:40:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:03.568761 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05df3a-6bc7-4096-81f5-86b4e845b999 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:03.650342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04f9aa-6dd9-4f80-b0ac-c49bf7af7871 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:03.690246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80b06-c5ce-4022-bb5b-1a61c09941a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:03.691395 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80b06-c5ce-4022-bb5b-1a61c09941a5 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:03.691877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80b06-c5ce-4022-bb5b-1a61c09941a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:03.692441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80b06-c5ce-4022-bb5b-1a61c09941a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:03.704914 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b80b06-c5ce-4022-bb5b-1a61c09941a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:03.706900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b80b06-c5ce-4022-bb5b-1a61c09941a5 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:03.724302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-95b80b06-c5ce-4022-bb5b-1a61c09941a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:03.724302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:03.724302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:03.724302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:03.724302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:03.724302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:03.724302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:03.724302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:03.724302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:03.724302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:03.724302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:03.724302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:03.724302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:03.724302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:03.724302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:03.724302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:03.725311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:03.725311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:03.725311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:03.725311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:03.725311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:03.725311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:03.725311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:03.725311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:03.725311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:03.725311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:03.725311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:03.725311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:03.725311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:03.725311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:03.725311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:03.725311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:03.725311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:03.726257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:03.726257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:03.726257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:03.728512 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 391/796] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:03.734718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80b06-c5ce-4022-bb5b-1a61c09941a5 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:03.790019 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:03.851704 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80b06-c5ce-4022-bb5b-1a61c09941a5 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:03.884645 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05df3a-6bc7-4096-81f5-86b4e845b999 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:03.892018 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef52983-7920-4323-9f9a-e1f4c9835eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:03.893162 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef52983-7920-4323-9f9a-e1f4c9835eb3 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:03.893668 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef52983-7920-4323-9f9a-e1f4c9835eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:03.894160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef52983-7920-4323-9f9a-e1f4c9835eb3 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:03.896645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef52983-7920-4323-9f9a-e1f4c9835eb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:03.897410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef52983-7920-4323-9f9a-e1f4c9835eb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:03.899116 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef52983-7920-4323-9f9a-e1f4c9835eb3 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:03.919720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 392/797] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:03.931318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef52983-7920-4323-9f9a-e1f4c9835eb3 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:04.003857 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aafebe-25c4-4ce7-bf7e-18aafc4d93ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:04.004494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafebe-25c4-4ce7-bf7e-18aafc4d93ef None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:04.004769 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafebe-25c4-4ce7-bf7e-18aafc4d93ef None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:04.005040 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafebe-25c4-4ce7-bf7e-18aafc4d93ef None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:04.006627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aafebe-25c4-4ce7-bf7e-18aafc4d93ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:04.006936 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aafebe-25c4-4ce7-bf7e-18aafc4d93ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:04.008386 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aafebe-25c4-4ce7-bf7e-18aafc4d93ef None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:04.047013 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 406/798] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 12 23:40:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:04.052503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aafebe-25c4-4ce7-bf7e-18aafc4d93ef None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:04.085075 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:04.183426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:04.196079 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef52983-7920-4323-9f9a-e1f4c9835eb3 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:04.262488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dba7f4-2ef3-4cf6-a826-c36198100ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:04.264032 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dba7f4-2ef3-4cf6-a826-c36198100ef0 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:04.264756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dba7f4-2ef3-4cf6-a826-c36198100ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:04.265572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dba7f4-2ef3-4cf6-a826-c36198100ef0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:04.279845 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dba7f4-2ef3-4cf6-a826-c36198100ef0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:04.280714 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aafebe-25c4-4ce7-bf7e-18aafc4d93ef None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:04.283651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dba7f4-2ef3-4cf6-a826-c36198100ef0 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:04.308078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-53dba7f4-2ef3-4cf6-a826-c36198100ef0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:04.308078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:04.308078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:04.308078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:04.308078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:04.308078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:04.308078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:04.308078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:04.308078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:04.308078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:04.308078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:04.308078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:04.308078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:40:04.308078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:40:04.308078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:40:04.309891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:40:04.309891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:04.309891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:04.309891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:04.309891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:04.309891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:04.309891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:04.309891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:04.309891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:04.309891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:04.309891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:04.309891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:04.309891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:04.309891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:04.309891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:04.309891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:04.309891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:04.312306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:40:04.312306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:40:04.312306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:40:04.312306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:40:04.312306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:40:04.312306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:40:04.312306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:04.312306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:04.316265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 393/799] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:40:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:04.326631 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dba7f4-2ef3-4cf6-a826-c36198100ef0 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:04.429203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ce115-0c3d-45e7-8377-9b77e5d20ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:04.430158 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ce115-0c3d-45e7-8377-9b77e5d20ed5 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:04.430558 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ce115-0c3d-45e7-8377-9b77e5d20ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:04.430953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ce115-0c3d-45e7-8377-9b77e5d20ed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:04.465218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ce115-0c3d-45e7-8377-9b77e5d20ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:04.466266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ce115-0c3d-45e7-8377-9b77e5d20ed5 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:04.494917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-451ce115-0c3d-45e7-8377-9b77e5d20ed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:04.494917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:04.494917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:04.494917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:04.494917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:04.494917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:04.494917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:04.494917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:04.494917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:04.494917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:04.494917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:04.494917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:04.494917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:04.494917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:04.494917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:04.494917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:04.496927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:04.496927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:04.496927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:04.496927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:04.496927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:04.496927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:04.496927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:04.496927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:04.496927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:04.496927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:04.496927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:04.496927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:04.496927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:04.496927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:04.496927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:04.496927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:04.496927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:04.498787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:04.498787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:04.498787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:04.498787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 407/800] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:04.506470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ce115-0c3d-45e7-8377-9b77e5d20ed5 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:04.536876 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dba7f4-2ef3-4cf6-a826-c36198100ef0 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:04.599522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d912b-ed9a-47af-97af-9e1a8b419790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:04.600822 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d912b-ed9a-47af-97af-9e1a8b419790 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:04.601574 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d912b-ed9a-47af-97af-9e1a8b419790 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:04.602181 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d912b-ed9a-47af-97af-9e1a8b419790 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:04.603445 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d912b-ed9a-47af-97af-9e1a8b419790 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:04.604161 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d912b-ed9a-47af-97af-9e1a8b419790 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:04.607024 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d912b-ed9a-47af-97af-9e1a8b419790 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:04.630331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 394/801] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:04.640075 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d912b-ed9a-47af-97af-9e1a8b419790 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:04.673222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:04.695751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:04.736499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ce115-0c3d-45e7-8377-9b77e5d20ed5 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:04.802806 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae36b3-f5d9-4189-917a-a6d0268f10c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:04.803824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae36b3-f5d9-4189-917a-a6d0268f10c0 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:04.804417 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae36b3-f5d9-4189-917a-a6d0268f10c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:04.805870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae36b3-f5d9-4189-917a-a6d0268f10c0 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:04.806762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae36b3-f5d9-4189-917a-a6d0268f10c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:04.807429 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae36b3-f5d9-4189-917a-a6d0268f10c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:04.810482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae36b3-f5d9-4189-917a-a6d0268f10c0 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:04.831634 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 408/802] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:04.839783 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae36b3-f5d9-4189-917a-a6d0268f10c0 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:04.847657 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d912b-ed9a-47af-97af-9e1a8b419790 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:04.898905 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa64adc-eeae-4c0b-95de-1dd9e081e527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:04.899939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa64adc-eeae-4c0b-95de-1dd9e081e527 None admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:04.900440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa64adc-eeae-4c0b-95de-1dd9e081e527 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:04.900956 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa64adc-eeae-4c0b-95de-1dd9e081e527 None admin] PATH_INFO: `/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/e1f49820de264982aeec97fa0be3c290/roles/8cf7b72483b94512b497317ab1d11192` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:04.919077 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa64adc-eeae-4c0b-95de-1dd9e081e527 None admin] RBAC: Authorizing `identity:create_grant(project_id=21118e9e4fa94603b2c0880dd0d5f5ba, user_id=e1f49820de264982aeec97fa0be3c290, role_id=8cf7b72483b94512b497317ab1d11192)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:04.921121 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa64adc-eeae-4c0b-95de-1dd9e081e527 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:04.949707 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 395/803] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:40:04 2022] PUT /identity/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/e1f49820de264982aeec97fa0be3c290/roles/8cf7b72483b94512b497317ab1d11192 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:40:05.032070 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae36b3-f5d9-4189-917a-a6d0268f10c0 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:05.077498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:05.084829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10127bab-8fbf-416a-948e-a4df8e4fbe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:05.085549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10127bab-8fbf-416a-948e-a4df8e4fbe19 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:05.085833 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10127bab-8fbf-416a-948e-a4df8e4fbe19 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:05.086107 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10127bab-8fbf-416a-948e-a4df8e4fbe19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:05.094906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10127bab-8fbf-416a-948e-a4df8e4fbe19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:05.096503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10127bab-8fbf-416a-948e-a4df8e4fbe19 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:05.110369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-10127bab-8fbf-416a-948e-a4df8e4fbe19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:05.110369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:05.110369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:05.110369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:05.110369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:05.110369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:05.110369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:05.110369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:05.110369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:05.110369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:05.110369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:05.110369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:05.110369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:40:05.110369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:40:05.110369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:40:05.111333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:40:05.111333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:05.111333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:05.111333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:05.111333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:05.111333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:05.111333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:05.111333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:05.111333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:05.111333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:05.111333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:05.111333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:05.111333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:05.111333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:05.111333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:05.111333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:05.111333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:05.112211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:40:05.112211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:40:05.112211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:40:05.112211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:40:05.112211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:40:05.112211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:40:05.112211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:05.112211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:05.112211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 409/804] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:05.123284 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa64adc-eeae-4c0b-95de-1dd9e081e527 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:05.142100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6811600-228e-49dd-ad40-106668e5e283 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:05.142594 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6811600-228e-49dd-ad40-106668e5e283 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:05.143076 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6811600-228e-49dd-ad40-106668e5e283 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:05.149246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 410/805] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:05.157947 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c593f-e670-4e17-81d0-53ae28fcf405 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:05.158370 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c593f-e670-4e17-81d0-53ae28fcf405 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:05.158771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c593f-e670-4e17-81d0-53ae28fcf405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:05.208792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-be0c593f-e670-4e17-81d0-53ae28fcf405 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:05.212888 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-be0c593f-e670-4e17-81d0-53ae28fcf405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:05.244224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:05.287072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa64adc-eeae-4c0b-95de-1dd9e081e527 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:05.332389 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcec72f-bbab-400a-a388-b08b1c1bed1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:05.333025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcec72f-bbab-400a-a388-b08b1c1bed1e None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:05.333644 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcec72f-bbab-400a-a388-b08b1c1bed1e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:05.333914 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcec72f-bbab-400a-a388-b08b1c1bed1e None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:05.334645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcec72f-bbab-400a-a388-b08b1c1bed1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:05.334953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcec72f-bbab-400a-a388-b08b1c1bed1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:05.336441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcec72f-bbab-400a-a388-b08b1c1bed1e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:05.355760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 396/806] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:40:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:05.357218 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa4531-7676-477b-8bbf-463e11bb04d0 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:05.357528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa4531-7676-477b-8bbf-463e11bb04d0 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:05.358141 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa4531-7676-477b-8bbf-463e11bb04d0 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:05.359590 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 397/807] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:05.365565 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc83659-a0a9-4a24-9ba7-bdde95bf16a3 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:05.366031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc83659-a0a9-4a24-9ba7-bdde95bf16a3 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:05.366300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc83659-a0a9-4a24-9ba7-bdde95bf16a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:05.377959 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 411/808] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:05.379297 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c593f-e670-4e17-81d0-53ae28fcf405 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:05.388363 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-7bc83659-a0a9-4a24-9ba7-bdde95bf16a3 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:05.389659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7bc83659-a0a9-4a24-9ba7-bdde95bf16a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:05.538994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 398/809] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:05.538994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8258129-b803-48ec-93b3-53c8d42687d4 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:05.538994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8258129-b803-48ec-93b3-53c8d42687d4 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:05.538994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8258129-b803-48ec-93b3-53c8d42687d4 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:05.539806 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 399/810] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:05.549214 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf3382-ed28-4c84-8708-4d67e25590a3 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:05.549726 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf3382-ed28-4c84-8708-4d67e25590a3 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:05.550193 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf3382-ed28-4c84-8708-4d67e25590a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:05.589370 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-d6bf3382-ed28-4c84-8708-4d67e25590a3 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:05.589370 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-d6bf3382-ed28-4c84-8708-4d67e25590a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:05.619841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c593f-e670-4e17-81d0-53ae28fcf405 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:05.685792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:05.720358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:05.733265 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca891423-926b-4c4f-8a4e-6f8c07accc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:05.734944 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca891423-926b-4c4f-8a4e-6f8c07accc52 None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:05.736243 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca891423-926b-4c4f-8a4e-6f8c07accc52 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:05.736693 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca891423-926b-4c4f-8a4e-6f8c07accc52 None admin] PATH_INFO: `/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/43c45ae3144b4fe8ab4e921fda30164a/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:05.739667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca891423-926b-4c4f-8a4e-6f8c07accc52 None admin] RBAC: Authorizing `identity:create_grant(project_id=21118e9e4fa94603b2c0880dd0d5f5ba, user_id=43c45ae3144b4fe8ab4e921fda30164a, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:05.741470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca891423-926b-4c4f-8a4e-6f8c07accc52 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:05.757413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 400/811] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:05.757413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf3382-ed28-4c84-8708-4d67e25590a3 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:05.776460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 412/812] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:40:05 2022] PUT /identity/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/43c45ae3144b4fe8ab4e921fda30164a/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:40:05.899741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf3382-ed28-4c84-8708-4d67e25590a3 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:05.901779 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca891423-926b-4c4f-8a4e-6f8c07accc52 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:05.967359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d775d54-2d25-4be0-9d17-53a359e9c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:05.967928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d775d54-2d25-4be0-9d17-53a359e9c2c2 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:05.968206 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d775d54-2d25-4be0-9d17-53a359e9c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:05.968797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d775d54-2d25-4be0-9d17-53a359e9c2c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:05.988153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d775d54-2d25-4be0-9d17-53a359e9c2c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:40:05.994727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-1d775d54-2d25-4be0-9d17-53a359e9c2c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:40:05.994727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:05.994727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:05.994727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:05.994727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:05.994727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:05.994727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:05.994727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:05.994727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:05.994727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:05.994727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:05.994727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:05.994727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:40:05.994727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:40:05.994727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:40:05.994727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:40:05.995710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:40:05.995710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:40:05.995710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:40:05.995710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:40:05.995710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:05.995710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:05.995710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:05.995710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:05.995710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:05.995710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:05.995710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:05.995710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:05.995710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:05.995710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:05.995710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:05.995710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:05.996560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:05.996560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:05.996560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:05.996560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:05.996560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:40:05.996560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:40:05.996560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:40:05.996560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:40:05.996560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:40:05.996560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:40:05.996560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:40:05.996560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:05.996560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 401/813] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:40:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:06.003985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d775d54-2d25-4be0-9d17-53a359e9c2c2 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:06.086878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca891423-926b-4c4f-8a4e-6f8c07accc52 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:06.114818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:06.134855 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f8a8d-fcdd-43e0-8b3c-8e70a8ae57e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:06.135672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f8a8d-fcdd-43e0-8b3c-8e70a8ae57e1 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:06.135951 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f8a8d-fcdd-43e0-8b3c-8e70a8ae57e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:06.136220 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f8a8d-fcdd-43e0-8b3c-8e70a8ae57e1 None admin] PATH_INFO: `/v3/services/network` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:06.136824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f8a8d-fcdd-43e0-8b3c-8e70a8ae57e1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:06.139495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f8a8d-fcdd-43e0-8b3c-8e70a8ae57e1 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:06.150531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-f20f8a8d-fcdd-43e0-8b3c-8e70a8ae57e1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:40:06.150531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:06.150531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:06.150531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:06.150531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:06.150531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:06.150531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:06.150531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:06.150531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:40:06.150531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:06.150531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:06.150531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:06.150531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:06.150531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:06.150531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:06.150531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:06.150531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:06.151570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:06.151570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:06.151570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:06.151570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:06.151570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:06.151570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:06.151570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:06.151570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:06.151570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:06.151570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:06.151570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:06.151570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:06.151570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:06.151570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:06.151570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:06.151570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:06.152401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:06.152401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:06.152401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:06.152401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:06.152401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:06.152401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:06.152401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:06.152401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:06.152401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:06.152401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:06.152401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:06.152401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:06.152401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 12 23:40:06.152401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:06.153114 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 413/814] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:40:05 2022] GET /identity/v3/services/network => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:06.153787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f8a8d-fcdd-43e0-8b3c-8e70a8ae57e1 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:06.209919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d775d54-2d25-4be0-9d17-53a359e9c2c2 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:06.230938 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:06.291447 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ffb4b-f54e-424f-b191-b10963e32a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:06.292619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ffb4b-f54e-424f-b191-b10963e32a76 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:06.292911 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ffb4b-f54e-424f-b191-b10963e32a76 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:06.293183 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ffb4b-f54e-424f-b191-b10963e32a76 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:06.294183 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ffb4b-f54e-424f-b191-b10963e32a76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:06.294487 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ffb4b-f54e-424f-b191-b10963e32a76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:06.296157 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ffb4b-f54e-424f-b191-b10963e32a76 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:06.309448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 402/815] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:40:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:06.310567 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ffb4b-f54e-424f-b191-b10963e32a76 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:06.324942 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f8a8d-fcdd-43e0-8b3c-8e70a8ae57e1 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:06.375112 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf236b-2e0f-4278-8e3c-8dcb2604ff7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:06.376066 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf236b-2e0f-4278-8e3c-8dcb2604ff7d None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:06.376787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf236b-2e0f-4278-8e3c-8dcb2604ff7d None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:06.377067 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf236b-2e0f-4278-8e3c-8dcb2604ff7d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:06.378005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf236b-2e0f-4278-8e3c-8dcb2604ff7d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:06.379417 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf236b-2e0f-4278-8e3c-8dcb2604ff7d None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:06.392272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-11cf236b-2e0f-4278-8e3c-8dcb2604ff7d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:40:06.392272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:06.392272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:06.392272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:06.392272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:06.392272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:06.392272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:06.392272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:06.392272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:40:06.392272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:06.392272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:06.392272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:06.392272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:06.392272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:06.392272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:06.392272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:06.392272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:06.393632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:06.393632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:06.393632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:06.393632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:06.393632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:06.393632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:06.393632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:06.393632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:06.393632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:06.393632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:06.393632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:06.393632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:06.393632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:06.393632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:06.393632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:06.393632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:06.394528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:06.394528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:06.394528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:06.394528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:06.394528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:06.394528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:06.394528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:06.394528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:06.394528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:06.394528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:06.394528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:06.394528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:06.394528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 12 23:40:06.394528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:06.404407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 414/816] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Sep 12 23:40:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:06.405672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf236b-2e0f-4278-8e3c-8dcb2604ff7d None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:06.443762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ffb4b-f54e-424f-b191-b10963e32a76 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:06.456973 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:06.496350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb9e64-1357-457d-9d24-27593115e66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:06.496350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb9e64-1357-457d-9d24-27593115e66f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:06.496350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb9e64-1357-457d-9d24-27593115e66f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:06.496350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb9e64-1357-457d-9d24-27593115e66f None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:06.496748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb9e64-1357-457d-9d24-27593115e66f None admin] RBAC: Adding query filter params (name=network) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:06.496748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb9e64-1357-457d-9d24-27593115e66f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:06.496748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb9e64-1357-457d-9d24-27593115e66f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:06.505666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 403/817] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 23:40:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:06.506804 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb9e64-1357-457d-9d24-27593115e66f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:06.541758 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf236b-2e0f-4278-8e3c-8dcb2604ff7d None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:06.553314 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:06.583778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c0edb-9404-4735-9a07-ccec586e4136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:06.584628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c0edb-9404-4735-9a07-ccec586e4136 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:06.584911 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c0edb-9404-4735-9a07-ccec586e4136 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:06.585181 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c0edb-9404-4735-9a07-ccec586e4136 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:06.598185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c0edb-9404-4735-9a07-ccec586e4136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:06.599842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c0edb-9404-4735-9a07-ccec586e4136 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:06.616885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-078c0edb-9404-4735-9a07-ccec586e4136 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:06.616885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:06.616885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:06.616885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:06.616885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:06.616885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:06.616885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:06.616885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:06.616885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:06.616885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:06.616885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:06.616885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:06.616885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:06.616885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:06.616885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:06.616885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:06.618264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:06.618264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:06.618264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:06.618264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:06.618264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:06.618264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:06.618264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:06.618264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:06.618264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:06.618264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:06.618264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:06.618264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:06.618264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:06.618264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:06.618264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:06.618264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:06.618264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:06.619258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:06.619258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:06.619258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:06.619258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 415/818] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:06.619491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c0edb-9404-4735-9a07-ccec586e4136 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:06.635711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb9e64-1357-457d-9d24-27593115e66f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:06.679608 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ddd7c-628b-41fd-b4e0-8b4cef8992c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:06.680579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ddd7c-628b-41fd-b4e0-8b4cef8992c3 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:06.681007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ddd7c-628b-41fd-b4e0-8b4cef8992c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:06.681564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ddd7c-628b-41fd-b4e0-8b4cef8992c3 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:06.682498 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ddd7c-628b-41fd-b4e0-8b4cef8992c3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:06.682954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ddd7c-628b-41fd-b4e0-8b4cef8992c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:06.684547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ddd7c-628b-41fd-b4e0-8b4cef8992c3 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:06.691019 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 404/819] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 12 23:40:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:06.692360 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ddd7c-628b-41fd-b4e0-8b4cef8992c3 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:06.735533 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:06.748284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c0edb-9404-4735-9a07-ccec586e4136 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:06.793241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2d2e4-09c7-47b2-9688-7248a3b48de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:06.795083 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2d2e4-09c7-47b2-9688-7248a3b48de9 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:06.795529 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2d2e4-09c7-47b2-9688-7248a3b48de9 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:06.795952 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2d2e4-09c7-47b2-9688-7248a3b48de9 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:06.796806 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2d2e4-09c7-47b2-9688-7248a3b48de9 None admin] RBAC: Adding query filter params (type=network) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:06.797291 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2d2e4-09c7-47b2-9688-7248a3b48de9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:06.798872 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2d2e4-09c7-47b2-9688-7248a3b48de9 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:06.806609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 416/820] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 23:40:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:06.807740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2d2e4-09c7-47b2-9688-7248a3b48de9 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:06.835640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ddd7c-628b-41fd-b4e0-8b4cef8992c3 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:06.846578 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:06.879616 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34b623-6a90-4cab-b27f-1020adadcdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:06.880260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34b623-6a90-4cab-b27f-1020adadcdbe None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:06.880544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34b623-6a90-4cab-b27f-1020adadcdbe None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:06.880814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34b623-6a90-4cab-b27f-1020adadcdbe None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:06.881537 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34b623-6a90-4cab-b27f-1020adadcdbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:06.881847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34b623-6a90-4cab-b27f-1020adadcdbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:06.883293 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34b623-6a90-4cab-b27f-1020adadcdbe None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:06.903075 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 405/821] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:06.903821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34b623-6a90-4cab-b27f-1020adadcdbe None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:06.947117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2d2e4-09c7-47b2-9688-7248a3b48de9 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:06.989876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdac38b-2cbc-4526-95c0-a49a451776ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:06.990876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdac38b-2cbc-4526-95c0-a49a451776ae None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:06.991371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdac38b-2cbc-4526-95c0-a49a451776ae None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:06.991831 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdac38b-2cbc-4526-95c0-a49a451776ae None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:06.992698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdac38b-2cbc-4526-95c0-a49a451776ae None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:06.993257 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdac38b-2cbc-4526-95c0-a49a451776ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:06.994904 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdac38b-2cbc-4526-95c0-a49a451776ae None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:07.003013 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 417/822] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 12 23:40:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:07.004298 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdac38b-2cbc-4526-95c0-a49a451776ae None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:07.073643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:07.085932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34b623-6a90-4cab-b27f-1020adadcdbe None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:07.124463 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:07.137401 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc5056-c2ac-44e9-9924-a131e1a18212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:07.138064 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc5056-c2ac-44e9-9924-a131e1a18212 None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:07.138419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc5056-c2ac-44e9-9924-a131e1a18212 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:07.138711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc5056-c2ac-44e9-9924-a131e1a18212 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:07.139694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc5056-c2ac-44e9-9924-a131e1a18212 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:07.142107 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc5056-c2ac-44e9-9924-a131e1a18212 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:07.153989 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdac38b-2cbc-4526-95c0-a49a451776ae None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:07.185382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 406/823] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:40:06 2022] POST /identity/v3/endpoints => generated 337 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:40:07.185382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc5056-c2ac-44e9-9924-a131e1a18212 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:07.248535 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4d33f-fc1b-4e66-afc4-f439abb293bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:07.249200 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4d33f-fc1b-4e66-afc4-f439abb293bc None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:07.249531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4d33f-fc1b-4e66-afc4-f439abb293bc None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:07.250501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4d33f-fc1b-4e66-afc4-f439abb293bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:07.265884 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4d33f-fc1b-4e66-afc4-f439abb293bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:07.272211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4d33f-fc1b-4e66-afc4-f439abb293bc None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:07.294472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-0aa4d33f-fc1b-4e66-afc4-f439abb293bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:40:07.294472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:07.294472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:07.294472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:07.294472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:07.294472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:07.294472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:07.294472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:07.294472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:07.294472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:07.294472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:07.294472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:07.294472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:40:07.294472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:40:07.294472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:40:07.294472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:07.296225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:07.298982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:07.298982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:07.298982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:40:07.298982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:40:07.298982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:40:07.298982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:40:07.298982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:40:07.298982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:40:07.298982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:40:07.298982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:07.298982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 418/824] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 23:40:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:07.306256 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4d33f-fc1b-4e66-afc4-f439abb293bc None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:07.432780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc5056-c2ac-44e9-9924-a131e1a18212 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:07.524360 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac66b1-148e-42f3-8095-7ce4851b1bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:07.525268 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac66b1-148e-42f3-8095-7ce4851b1bf9 None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:07.525738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac66b1-148e-42f3-8095-7ce4851b1bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:07.526169 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac66b1-148e-42f3-8095-7ce4851b1bf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:07.527343 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac66b1-148e-42f3-8095-7ce4851b1bf9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:07.529757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac66b1-148e-42f3-8095-7ce4851b1bf9 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:07.594562 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4d33f-fc1b-4e66-afc4-f439abb293bc None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:07.613034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 407/825] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:40:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:40:07.634208 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d767b4c-6f45-412e-8031-af7c7dbd81c6 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:07.634644 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d767b4c-6f45-412e-8031-af7c7dbd81c6 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:07.635067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d767b4c-6f45-412e-8031-af7c7dbd81c6 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:07.638153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 408/826] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:07.647100 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5f995-a97a-4505-8de1-d0eaa5bb7fe1 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:07.647533 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5f995-a97a-4505-8de1-d0eaa5bb7fe1 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:07.647934 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5f995-a97a-4505-8de1-d0eaa5bb7fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:07.660565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a34b2e-150d-438a-9508-686f567bc248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:07.661421 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a34b2e-150d-438a-9508-686f567bc248 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:07.661825 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a34b2e-150d-438a-9508-686f567bc248 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:07.662192 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a34b2e-150d-438a-9508-686f567bc248 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:07.663083 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a34b2e-150d-438a-9508-686f567bc248 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:07.663699 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a34b2e-150d-438a-9508-686f567bc248 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:07.665399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a34b2e-150d-438a-9508-686f567bc248 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:07.678208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:07.696801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-50c5f995-a97a-4505-8de1-d0eaa5bb7fe1 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:07.698884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-50c5f995-a97a-4505-8de1-d0eaa5bb7fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:07.702308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 419/827] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 23:40:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:07.704015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:07.713977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a34b2e-150d-438a-9508-686f567bc248 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:07.795236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 409/828] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:07.892602 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a34b2e-150d-438a-9508-686f567bc248 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:07.941157 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02d00f-da3a-4f55-ac45-0c8fb12d46c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:07.941987 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d00f-da3a-4f55-ac45-0c8fb12d46c5 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:07.942361 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d00f-da3a-4f55-ac45-0c8fb12d46c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:07.942728 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d00f-da3a-4f55-ac45-0c8fb12d46c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:08.021157 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:08.025734 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02d00f-da3a-4f55-ac45-0c8fb12d46c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:08.027502 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02d00f-da3a-4f55-ac45-0c8fb12d46c5 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:08.149226 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 420/829] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:40:07 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:40:08.158537 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5f995-a97a-4505-8de1-d0eaa5bb7fe1 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:08.279380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02d00f-da3a-4f55-ac45-0c8fb12d46c5 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:08.320336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5f995-a97a-4505-8de1-d0eaa5bb7fe1 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:08.404508 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc83b12-053b-49dc-8b9a-be163ec68922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:08.406592 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc83b12-053b-49dc-8b9a-be163ec68922 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:08.407410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc83b12-053b-49dc-8b9a-be163ec68922 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:08.407896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc83b12-053b-49dc-8b9a-be163ec68922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:08.424120 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:08.427581 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:08.436930 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc83b12-053b-49dc-8b9a-be163ec68922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:08.437979 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02d00f-da3a-4f55-ac45-0c8fb12d46c5 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:08.440546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc83b12-053b-49dc-8b9a-be163ec68922 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:08.478749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-2cc83b12-053b-49dc-8b9a-be163ec68922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:08.478749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:08.478749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:08.478749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:08.478749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:08.478749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:08.478749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:08.478749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:08.478749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:08.478749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:08.478749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:08.478749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:08.478749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:08.478749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:08.478749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:08.478749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:08.479758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:08.479758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:08.479758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:08.479758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:08.479758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:08.479758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:08.479758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:08.479758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:08.479758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:08.479758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:08.479758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:08.479758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:08.479758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:08.479758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:08.479758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:08.479758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:08.479758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:08.480683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:08.480683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:08.480683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:08.481828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f2c71-e475-42e9-9aa4-9c52f51570bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:08.482923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f2c71-e475-42e9-9aa4-9c52f51570bd None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:08.483400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f2c71-e475-42e9-9aa4-9c52f51570bd None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:08.483865 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f2c71-e475-42e9-9aa4-9c52f51570bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:08.486856 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 410/830] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:08.491425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc83b12-053b-49dc-8b9a-be163ec68922 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:08.497562 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f2c71-e475-42e9-9aa4-9c52f51570bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:40:08.502878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-9c6f2c71-e475-42e9-9aa4-9c52f51570bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:40:08.502878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:08.502878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:08.502878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:08.502878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:08.502878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:08.502878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:08.502878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:08.502878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:08.502878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:08.502878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:08.502878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:08.502878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:40:08.502878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:40:08.502878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:40:08.502878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:40:08.503841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:40:08.503841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:40:08.503841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:40:08.503841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:40:08.503841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:08.503841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:08.503841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:08.503841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:08.503841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:08.503841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:08.503841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:08.503841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:08.503841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:08.503841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:08.503841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:08.503841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:08.504739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:08.504739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:08.504739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:08.504739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:08.504739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:40:08.504739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:40:08.504739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:40:08.504739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:40:08.504739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:40:08.504739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:40:08.504739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:40:08.504739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:08.507759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 421/831] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:40:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:08.518555 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f2c71-e475-42e9-9aa4-9c52f51570bd None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:08.650719 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc83b12-053b-49dc-8b9a-be163ec68922 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:08.699598 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f2c71-e475-42e9-9aa4-9c52f51570bd None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:08.730532 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6237ab4-f513-4dcd-b3fe-031818bf4c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:08.731239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6237ab4-f513-4dcd-b3fe-031818bf4c21 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:08.731615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6237ab4-f513-4dcd-b3fe-031818bf4c21 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:08.731889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6237ab4-f513-4dcd-b3fe-031818bf4c21 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:08.732548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6237ab4-f513-4dcd-b3fe-031818bf4c21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:08.732847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6237ab4-f513-4dcd-b3fe-031818bf4c21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:08.735326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6237ab4-f513-4dcd-b3fe-031818bf4c21 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:08.752569 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 411/832] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:08.754451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf8887-8262-4451-a72f-f4a77aa54f41 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:08.754851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf8887-8262-4451-a72f-f4a77aa54f41 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:08.755219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf8887-8262-4451-a72f-f4a77aa54f41 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:08.757006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 412/833] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:08.762938 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22608-7352-46e8-a25d-8d7773e24517 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:08.763293 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22608-7352-46e8-a25d-8d7773e24517 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:08.763634 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22608-7352-46e8-a25d-8d7773e24517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:08.765323 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8997971-7723-4919-8b66-1527e813ff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:08.766086 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997971-7723-4919-8b66-1527e813ff4e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:08.766429 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997971-7723-4919-8b66-1527e813ff4e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:08.766769 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997971-7723-4919-8b66-1527e813ff4e None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:08.767517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8997971-7723-4919-8b66-1527e813ff4e None admin] RBAC: Adding query filter params (name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:08.767879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8997971-7723-4919-8b66-1527e813ff4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:08.769326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8997971-7723-4919-8b66-1527e813ff4e None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:08.780589 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 422/834] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:40:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:08.781556 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8997971-7723-4919-8b66-1527e813ff4e None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:08.786481 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-62a22608-7352-46e8-a25d-8d7773e24517 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:08.788518 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-62a22608-7352-46e8-a25d-8d7773e24517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:08.808044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:08.872854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:08.897218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8997971-7723-4919-8b66-1527e813ff4e None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:08.910964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 413/835] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:08.912660 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a22608-7352-46e8-a25d-8d7773e24517 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:08.948956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a88ae3-b7c2-4c24-bb18-00d5a3374adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:08.950022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a88ae3-b7c2-4c24-bb18-00d5a3374adc None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:08.950448 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a88ae3-b7c2-4c24-bb18-00d5a3374adc None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:08.950877 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a88ae3-b7c2-4c24-bb18-00d5a3374adc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:08.960295 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a88ae3-b7c2-4c24-bb18-00d5a3374adc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:08.962871 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a88ae3-b7c2-4c24-bb18-00d5a3374adc None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:08.978371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-58a88ae3-b7c2-4c24-bb18-00d5a3374adc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:08.978371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:08.978371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:08.978371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:08.978371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:08.978371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:08.978371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:08.978371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:08.978371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:08.978371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:08.978371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:08.978371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:08.978371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:40:08.978371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:40:08.978371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:40:08.979441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:40:08.979441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:08.979441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:08.979441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:08.979441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:08.979441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:08.979441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:08.979441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:08.979441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:08.979441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:08.979441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:08.979441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:08.979441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:08.979441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:08.979441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:08.979441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:08.979441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:08.980486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:40:08.980486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:40:08.980486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:40:08.980486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:40:08.980486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:40:08.980486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:40:08.980486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:08.980486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:08.983904 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 423/836] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:40:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:08.996092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a88ae3-b7c2-4c24-bb18-00d5a3374adc None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:09.099059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a22608-7352-46e8-a25d-8d7773e24517 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:09.137257 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:09.153365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918fc2a-b8f1-4625-a08b-4b39ccb64988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:09.154540 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918fc2a-b8f1-4625-a08b-4b39ccb64988 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:09.155011 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918fc2a-b8f1-4625-a08b-4b39ccb64988 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:09.155482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918fc2a-b8f1-4625-a08b-4b39ccb64988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:09.164878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a88ae3-b7c2-4c24-bb18-00d5a3374adc None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:09.174455 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918fc2a-b8f1-4625-a08b-4b39ccb64988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:09.176953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918fc2a-b8f1-4625-a08b-4b39ccb64988 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:09.204621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-7918fc2a-b8f1-4625-a08b-4b39ccb64988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:09.204621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:09.204621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:09.204621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:09.204621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:09.204621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:09.204621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:09.204621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:09.204621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:09.204621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:09.204621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:09.204621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:09.204621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:09.204621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:09.204621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:09.204621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:09.205917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:09.205917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:09.205917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:09.205917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:09.205917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:09.205917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:09.205917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:09.205917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:09.205917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:09.205917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:09.205917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:09.205917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:09.205917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:09.205917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:09.205917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:09.205917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:09.205917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:09.206811 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:09.206811 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:09.206811 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:09.212019 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 414/837] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:09.212019 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918fc2a-b8f1-4625-a08b-4b39ccb64988 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:09.212152 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762540fb-575a-4937-b466-94b4af38b88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:09.212152 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762540fb-575a-4937-b466-94b4af38b88d None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:09.212152 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762540fb-575a-4937-b466-94b4af38b88d None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:09.212152 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762540fb-575a-4937-b466-94b4af38b88d None admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:09.212437 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762540fb-575a-4937-b466-94b4af38b88d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:09.212437 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762540fb-575a-4937-b466-94b4af38b88d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:09.212437 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762540fb-575a-4937-b466-94b4af38b88d None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:09.234416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 424/838] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:40:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:09.234416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762540fb-575a-4937-b466-94b4af38b88d None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:09.261741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:09.346308 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918fc2a-b8f1-4625-a08b-4b39ccb64988 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:09.388153 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762540fb-575a-4937-b466-94b4af38b88d None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:09.388483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5daf0-8802-4be4-944e-8a66c0d43dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:09.388920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5daf0-8802-4be4-944e-8a66c0d43dac None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:09.389198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5daf0-8802-4be4-944e-8a66c0d43dac None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:09.389503 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5daf0-8802-4be4-944e-8a66c0d43dac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:09.403533 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5daf0-8802-4be4-944e-8a66c0d43dac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:40:09.413836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-95d5daf0-8802-4be4-944e-8a66c0d43dac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:40:09.413836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:09.413836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:09.413836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:09.413836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:09.413836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:09.413836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:09.413836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:09.413836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:09.413836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:09.413836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:09.413836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:09.413836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:40:09.413836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:40:09.413836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:40:09.413836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:40:09.415853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:40:09.415853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:40:09.415853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:40:09.415853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:40:09.415853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:09.415853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:09.415853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:09.415853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:09.415853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:09.415853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:09.415853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:09.415853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:09.415853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:09.415853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:09.415853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:09.415853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:09.417645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:09.417645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:09.417645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:09.417645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:09.417645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:40:09.417645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:40:09.417645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:40:09.417645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:40:09.417645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:40:09.417645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:40:09.417645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:40:09.417645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:09.417645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 415/839] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:40:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:09.417645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5daf0-8802-4be4-944e-8a66c0d43dac None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:09.439284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacbaa2-85e9-44ec-9178-6275e77a3ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:09.439917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacbaa2-85e9-44ec-9178-6275e77a3ac7 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:09.440327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacbaa2-85e9-44ec-9178-6275e77a3ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:09.440565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacbaa2-85e9-44ec-9178-6275e77a3ac7 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:09.441854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacbaa2-85e9-44ec-9178-6275e77a3ac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:09.441854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacbaa2-85e9-44ec-9178-6275e77a3ac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:09.443003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacbaa2-85e9-44ec-9178-6275e77a3ac7 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:09.454564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:09.459687 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 425/840] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:09.465201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacbaa2-85e9-44ec-9178-6275e77a3ac7 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:09.526146 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:09.537246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5daf0-8802-4be4-944e-8a66c0d43dac None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:09.580268 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c9c40-fe2d-4946-bfbc-d733bee10c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:09.581282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9c40-fe2d-4946-bfbc-d733bee10c05 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:09.581820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9c40-fe2d-4946-bfbc-d733bee10c05 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:09.582316 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9c40-fe2d-4946-bfbc-d733bee10c05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:09.583750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c9c40-fe2d-4946-bfbc-d733bee10c05 None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=4a87e18c89ff419f8e428e376d33462c) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:09.584310 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c9c40-fe2d-4946-bfbc-d733bee10c05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:09.587261 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c9c40-fe2d-4946-bfbc-d733bee10c05 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:09.598288 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacbaa2-85e9-44ec-9178-6275e77a3ac7 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:09.609489 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 416/841] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:40:09 2022] GET /identity/v3/role_assignments?user.id=4a87e18c89ff419f8e428e376d33462c&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=440092230f024959a90e846ab29c6367 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:09.609489 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c9c40-fe2d-4946-bfbc-d733bee10c05 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:09.650715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab1b2f-7121-4570-8c62-fed0f44dbf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:09.652140 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab1b2f-7121-4570-8c62-fed0f44dbf11 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:09.652546 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab1b2f-7121-4570-8c62-fed0f44dbf11 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:09.652928 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab1b2f-7121-4570-8c62-fed0f44dbf11 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:09.654165 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab1b2f-7121-4570-8c62-fed0f44dbf11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:09.654586 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab1b2f-7121-4570-8c62-fed0f44dbf11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:09.656387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab1b2f-7121-4570-8c62-fed0f44dbf11 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:09.671227 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 426/842] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:40:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:09.678211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab1b2f-7121-4570-8c62-fed0f44dbf11 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:09.786924 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c9c40-fe2d-4946-bfbc-d733bee10c05 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:09.788072 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:09.835080 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab1b2f-7121-4570-8c62-fed0f44dbf11 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:09.859508 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0d972-9e7e-4972-bd22-fe0b0b8d1322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:09.860613 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0d972-9e7e-4972-bd22-fe0b0b8d1322 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:09.861113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0d972-9e7e-4972-bd22-fe0b0b8d1322 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:09.861665 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0d972-9e7e-4972-bd22-fe0b0b8d1322 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:09.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376bdd4-d8d1-4fe3-bcb5-d5f6c8a23250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:09.878538 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0d972-9e7e-4972-bd22-fe0b0b8d1322 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:09.878868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376bdd4-d8d1-4fe3-bcb5-d5f6c8a23250 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:09.879361 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376bdd4-d8d1-4fe3-bcb5-d5f6c8a23250 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:09.879830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376bdd4-d8d1-4fe3-bcb5-d5f6c8a23250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:09.880067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0d972-9e7e-4972-bd22-fe0b0b8d1322 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:09.893173 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376bdd4-d8d1-4fe3-bcb5-d5f6c8a23250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:09.895047 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376bdd4-d8d1-4fe3-bcb5-d5f6c8a23250 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:09.903898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-1cb0d972-9e7e-4972-bd22-fe0b0b8d1322 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:40:09.903898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:09.903898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:09.903898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:09.903898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:09.903898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:09.903898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:09.903898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:09.903898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:09.903898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:09.903898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:09.903898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:09.903898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:40:09.903898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:40:09.903898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:40:09.903898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:09.904919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:09.905979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:09.905979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:09.905979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:40:09.905979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:40:09.905979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:40:09.905979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:40:09.905979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:40:09.905979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:40:09.905979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:40:09.905979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:09.906510 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 417/843] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 23:40:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:09.912793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0d972-9e7e-4972-bd22-fe0b0b8d1322 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:09.922737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-3376bdd4-d8d1-4fe3-bcb5-d5f6c8a23250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:09.922737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:09.922737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:09.922737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:09.922737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:09.922737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:09.922737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:09.922737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:09.922737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:09.922737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:09.922737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:09.922737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:09.922737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:09.922737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:09.922737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:09.922737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:09.924065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:09.924065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:09.924065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:09.924065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:09.924065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:09.924065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:09.924065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:09.924065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:09.924065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:09.924065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:09.924065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:09.924065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:09.924065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:09.924065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:09.924065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:09.924065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:09.924065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:09.925584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:09.925584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:09.925584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:09.925584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 427/844] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:09.930278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376bdd4-d8d1-4fe3-bcb5-d5f6c8a23250 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:09.946846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:10.046596 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376bdd4-d8d1-4fe3-bcb5-d5f6c8a23250 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:10.064630 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:10.104298 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0d972-9e7e-4972-bd22-fe0b0b8d1322 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:10.106182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa934eb-47cc-45dd-812b-7a084ef391f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:10.107272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa934eb-47cc-45dd-812b-7a084ef391f2 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:10.107776 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa934eb-47cc-45dd-812b-7a084ef391f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:10.108275 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa934eb-47cc-45dd-812b-7a084ef391f2 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:10.109548 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa934eb-47cc-45dd-812b-7a084ef391f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:10.110113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa934eb-47cc-45dd-812b-7a084ef391f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:10.112755 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa934eb-47cc-45dd-812b-7a084ef391f2 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:10.140968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 428/845] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:10.140968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42058c8-f121-41d9-a136-187d1bb5401e None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:10.140968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42058c8-f121-41d9-a136-187d1bb5401e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:10.140968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42058c8-f121-41d9-a136-187d1bb5401e None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:10.142402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 429/846] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:10.143798 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42058c8-f121-41d9-a136-187d1bb5401e None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:10.148683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14f01d-3665-445d-8f1d-90ef8a916601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:10.149614 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14f01d-3665-445d-8f1d-90ef8a916601 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:10.151127 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14f01d-3665-445d-8f1d-90ef8a916601 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:10.151570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14f01d-3665-445d-8f1d-90ef8a916601 None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:10.152503 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14f01d-3665-445d-8f1d-90ef8a916601 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:10.152995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14f01d-3665-445d-8f1d-90ef8a916601 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:10.154677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14f01d-3665-445d-8f1d-90ef8a916601 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:10.188880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 418/847] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 12 23:40:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:10.188880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf70ca5-6c9d-4f25-a7d2-894be2dd6d8e None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:10.188880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf70ca5-6c9d-4f25-a7d2-894be2dd6d8e None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:10.188880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf70ca5-6c9d-4f25-a7d2-894be2dd6d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:10.219699 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-dcf70ca5-6c9d-4f25-a7d2-894be2dd6d8e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:10.221849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-dcf70ca5-6c9d-4f25-a7d2-894be2dd6d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:10.282074 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42058c8-f121-41d9-a136-187d1bb5401e None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:10.324868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2057d-ea5e-483f-8963-c8d6fca6c024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:10.325602 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2057d-ea5e-483f-8963-c8d6fca6c024 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:10.325948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2057d-ea5e-483f-8963-c8d6fca6c024 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:10.326279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2057d-ea5e-483f-8963-c8d6fca6c024 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:10.326915 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 419/848] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:10.327776 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf70ca5-6c9d-4f25-a7d2-894be2dd6d8e None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:10.335131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:10.359463 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2057d-ea5e-483f-8963-c8d6fca6c024 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:10.361430 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2057d-ea5e-483f-8963-c8d6fca6c024 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:10.379048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-c8b2057d-ea5e-483f-8963-c8d6fca6c024 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:40:10.379048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:10.379048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:10.379048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:10.379048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:10.379048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:10.379048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:10.379048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:10.379048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:10.379048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:10.379048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:10.379048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:10.379048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:40:10.379048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:40:10.379048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:40:10.379048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:10.381144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:10.383017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:10.383017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:10.383017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:40:10.383017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:40:10.383017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:40:10.383017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:40:10.383017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:40:10.383017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:40:10.383017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 12 23:40:10.383017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:10.388134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 430/849] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:40:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:10.388134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2057d-ea5e-483f-8963-c8d6fca6c024 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:10.448282 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:10.515870 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf70ca5-6c9d-4f25-a7d2-894be2dd6d8e None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:10.547717 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2057d-ea5e-483f-8963-c8d6fca6c024 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:10.560773 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222621a4-f0f2-463c-8ced-4b4dcdd30e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:10.562580 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222621a4-f0f2-463c-8ced-4b4dcdd30e9f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:10.563031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222621a4-f0f2-463c-8ced-4b4dcdd30e9f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:10.563468 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222621a4-f0f2-463c-8ced-4b4dcdd30e9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:10.621403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad618984-d7d5-4314-91cd-cf681935620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:10.622407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad618984-d7d5-4314-91cd-cf681935620e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:10.622887 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad618984-d7d5-4314-91cd-cf681935620e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:10.623442 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad618984-d7d5-4314-91cd-cf681935620e None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:10.624951 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad618984-d7d5-4314-91cd-cf681935620e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:10.625868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad618984-d7d5-4314-91cd-cf681935620e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:10.628404 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad618984-d7d5-4314-91cd-cf681935620e None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:10.644061 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222621a4-f0f2-463c-8ced-4b4dcdd30e9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:10.645974 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222621a4-f0f2-463c-8ced-4b4dcdd30e9f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:10.652081 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:10.673573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 431/850] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 12 23:40:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:10.675730 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad618984-d7d5-4314-91cd-cf681935620e None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:10.795000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 420/851] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:40:10 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:40:10.796831 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222621a4-f0f2-463c-8ced-4b4dcdd30e9f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:10.800955 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:10.812640 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad618984-d7d5-4314-91cd-cf681935620e None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:10.858256 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a30bb5-4d59-448f-9a96-333d2048fa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:10.859869 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a30bb5-4d59-448f-9a96-333d2048fa60 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:10.860359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a30bb5-4d59-448f-9a96-333d2048fa60 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:10.860818 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a30bb5-4d59-448f-9a96-333d2048fa60 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:10.861922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a30bb5-4d59-448f-9a96-333d2048fa60 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:10.864604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a30bb5-4d59-448f-9a96-333d2048fa60 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:10.881663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-e7a30bb5-4d59-448f-9a96-333d2048fa60 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:40:10.881663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:10.881663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:10.881663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:10.881663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:10.881663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:10.881663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:10.881663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:10.881663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:40:10.881663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:10.881663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:10.881663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:10.881663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:10.881663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:10.881663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:10.881663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:10.881663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:10.882696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:10.882696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:10.882696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:10.882696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:10.882696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:10.882696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:10.882696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:10.882696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:10.882696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:10.882696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:10.882696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:10.882696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:10.882696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:10.882696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:10.882696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:10.882696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:10.883542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:10.883542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:10.883542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:10.883542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:10.883542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:10.883542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:10.883542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:10.883542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:10.883542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:10.883542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:10.883542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:10.883542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:10.883542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:40:10.883542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:10.884297 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 432/852] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:40:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:10.885066 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a30bb5-4d59-448f-9a96-333d2048fa60 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:10.933832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222621a4-f0f2-463c-8ced-4b4dcdd30e9f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:10.938169 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:10.974531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7adec-1a62-4820-a1ef-1d477ecf0b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:10.975612 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7adec-1a62-4820-a1ef-1d477ecf0b59 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:10.976089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7adec-1a62-4820-a1ef-1d477ecf0b59 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:10.976567 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7adec-1a62-4820-a1ef-1d477ecf0b59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:11.033430 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a30bb5-4d59-448f-9a96-333d2048fa60 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:11.075081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a7d6c-be01-4cee-b850-e39086aac5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:11.075748 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7d6c-be01-4cee-b850-e39086aac5f4 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:11.076186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7d6c-be01-4cee-b850-e39086aac5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:11.076352 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7d6c-be01-4cee-b850-e39086aac5f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:11.089667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a7d6c-be01-4cee-b850-e39086aac5f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:11.091211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a7d6c-be01-4cee-b850-e39086aac5f4 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:11.108257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7adec-1a62-4820-a1ef-1d477ecf0b59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:11.110021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-923a7d6c-be01-4cee-b850-e39086aac5f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:11.110021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:11.110021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:11.110021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:11.110021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:11.110021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:11.110021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:11.110021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:11.110021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:11.110021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:11.110021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:11.110021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:11.110021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:11.110021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:11.110021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:11.110021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:11.110966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:11.110966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:11.110966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:11.110966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:11.110966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:11.110966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:11.110966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:11.110966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:11.110966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:11.110966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:11.110966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:11.110966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:11.110966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:11.110966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:11.110966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:11.110966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:11.110966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:11.111867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:11.111867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:11.111867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:11.112037 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7adec-1a62-4820-a1ef-1d477ecf0b59 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:11.113760 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 433/853] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:11.115279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a7d6c-be01-4cee-b850-e39086aac5f4 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:11.130320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:11.255204 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a7d6c-be01-4cee-b850-e39086aac5f4 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:11.264726 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 421/854] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:40:10 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:40:11.264726 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7adec-1a62-4820-a1ef-1d477ecf0b59 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:11.268228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:11.319732 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db815c81-9e03-4d29-985d-6a976cccbe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:11.320668 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db815c81-9e03-4d29-985d-6a976cccbe43 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:11.321155 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db815c81-9e03-4d29-985d-6a976cccbe43 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:11.321664 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db815c81-9e03-4d29-985d-6a976cccbe43 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:11.322993 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db815c81-9e03-4d29-985d-6a976cccbe43 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:11.323396 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db815c81-9e03-4d29-985d-6a976cccbe43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:11.326187 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db815c81-9e03-4d29-985d-6a976cccbe43 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:11.336158 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 434/855] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:40:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:11.337395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db815c81-9e03-4d29-985d-6a976cccbe43 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:11.418608 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7adec-1a62-4820-a1ef-1d477ecf0b59 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:11.453843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:11.488562 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e22d6-263c-423e-83b0-3f29ce1d39f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:11.489720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e22d6-263c-423e-83b0-3f29ce1d39f9 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:11.490198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e22d6-263c-423e-83b0-3f29ce1d39f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:11.490636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e22d6-263c-423e-83b0-3f29ce1d39f9 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:11.491803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e22d6-263c-423e-83b0-3f29ce1d39f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:11.492328 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e22d6-263c-423e-83b0-3f29ce1d39f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:11.494874 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e22d6-263c-423e-83b0-3f29ce1d39f9 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:11.496730 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db815c81-9e03-4d29-985d-6a976cccbe43 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:11.517510 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 422/856] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:11.518149 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e22d6-263c-423e-83b0-3f29ce1d39f9 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:11.548215 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753b59d-dea4-4012-9b9c-e7dc98ff1c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:11.549119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753b59d-dea4-4012-9b9c-e7dc98ff1c92 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:11.549832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753b59d-dea4-4012-9b9c-e7dc98ff1c92 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:11.550260 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753b59d-dea4-4012-9b9c-e7dc98ff1c92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:11.565357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753b59d-dea4-4012-9b9c-e7dc98ff1c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:11.567191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753b59d-dea4-4012-9b9c-e7dc98ff1c92 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:11.585395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-d753b59d-dea4-4012-9b9c-e7dc98ff1c92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:11.585395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:11.585395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:11.585395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:11.585395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:11.585395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:11.585395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:11.585395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:11.585395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:11.585395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:11.585395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:11.585395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:11.585395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:11.585395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:11.585395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:11.585395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:11.587162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:11.587162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:11.587162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:11.587162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:11.587162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:11.587162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:11.587162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:11.587162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:11.587162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:11.587162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:11.587162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:11.587162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:11.587162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:11.587162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:11.587162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:11.587162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:11.587162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:11.588820 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:11.588820 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:11.588820 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:11.590085 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 435/857] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:11.591651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753b59d-dea4-4012-9b9c-e7dc98ff1c92 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:11.630876 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:11.709996 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e22d6-263c-423e-83b0-3f29ce1d39f9 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:11.764049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753b59d-dea4-4012-9b9c-e7dc98ff1c92 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:11.770051 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33dfe2-8a35-44dc-a3ef-f3a3e792d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:11.771034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33dfe2-8a35-44dc-a3ef-f3a3e792d1cf None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:11.771512 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33dfe2-8a35-44dc-a3ef-f3a3e792d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:11.771976 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33dfe2-8a35-44dc-a3ef-f3a3e792d1cf None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:11.772819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33dfe2-8a35-44dc-a3ef-f3a3e792d1cf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:11.773364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33dfe2-8a35-44dc-a3ef-f3a3e792d1cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:11.775006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33dfe2-8a35-44dc-a3ef-f3a3e792d1cf None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:11.783981 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 423/858] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:40:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:11.785399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33dfe2-8a35-44dc-a3ef-f3a3e792d1cf None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:11.814002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:11.829692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c9e78-b5d0-477d-9ae7-a945ec9fe785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:11.830761 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c9e78-b5d0-477d-9ae7-a945ec9fe785 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:11.831243 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c9e78-b5d0-477d-9ae7-a945ec9fe785 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:11.831712 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c9e78-b5d0-477d-9ae7-a945ec9fe785 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:11.842972 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c9e78-b5d0-477d-9ae7-a945ec9fe785 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:11.845057 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c9e78-b5d0-477d-9ae7-a945ec9fe785 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:11.858870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-890c9e78-b5d0-477d-9ae7-a945ec9fe785 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:11.858870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:11.858870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:11.858870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:11.858870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:11.858870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:11.858870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:11.858870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:11.858870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:11.858870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:11.858870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:11.858870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:11.858870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:40:11.858870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:40:11.858870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:40:11.859882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:40:11.859882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:11.859882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:11.859882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:11.859882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:11.859882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:11.859882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:11.859882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:11.859882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:11.859882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:11.859882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:11.859882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:11.859882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:11.859882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:11.859882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:11.859882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:11.859882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:11.860850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:40:11.860850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:40:11.860850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:40:11.860850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:40:11.860850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:40:11.860850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:40:11.860850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:11.860850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:11.867824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 436/859] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:11.870477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c9e78-b5d0-477d-9ae7-a945ec9fe785 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:11.962919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33dfe2-8a35-44dc-a3ef-f3a3e792d1cf None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:11.998146 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:12.010442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fd52c-07dd-44dc-aa1f-a7686246dc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:12.011090 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fd52c-07dd-44dc-aa1f-a7686246dc74 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:12.011398 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fd52c-07dd-44dc-aa1f-a7686246dc74 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:12.011666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fd52c-07dd-44dc-aa1f-a7686246dc74 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:12.012351 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fd52c-07dd-44dc-aa1f-a7686246dc74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:12.012651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fd52c-07dd-44dc-aa1f-a7686246dc74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:12.014131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fd52c-07dd-44dc-aa1f-a7686246dc74 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:12.037494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 424/860] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:12.037494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a3595-7d22-49de-b85c-ccb7fbdb780e None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:12.037494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a3595-7d22-49de-b85c-ccb7fbdb780e None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:12.037494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a3595-7d22-49de-b85c-ccb7fbdb780e None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:12.037494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 425/861] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:12.040265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c37e3-26bd-4dab-969b-80ff1309b4ca None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:12.040553 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c37e3-26bd-4dab-969b-80ff1309b4ca None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:12.040788 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c37e3-26bd-4dab-969b-80ff1309b4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:12.068603 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c9e78-b5d0-477d-9ae7-a945ec9fe785 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:12.069933 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-f11c37e3-26bd-4dab-969b-80ff1309b4ca None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:12.071948 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f11c37e3-26bd-4dab-969b-80ff1309b4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:12.123383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538edbd-e1f4-4c53-b2d3-918d2409169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:12.124751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538edbd-e1f4-4c53-b2d3-918d2409169f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:12.124999 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538edbd-e1f4-4c53-b2d3-918d2409169f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:12.125460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538edbd-e1f4-4c53-b2d3-918d2409169f None admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:12.126641 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538edbd-e1f4-4c53-b2d3-918d2409169f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:12.127151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538edbd-e1f4-4c53-b2d3-918d2409169f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:12.129819 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538edbd-e1f4-4c53-b2d3-918d2409169f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:12.158956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 437/862] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:12.158956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538edbd-e1f4-4c53-b2d3-918d2409169f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:12.166127 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 426/863] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:12.169386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c37e3-26bd-4dab-969b-80ff1309b4ca None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:12.259655 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:12.297491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c37e3-26bd-4dab-969b-80ff1309b4ca None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:12.342799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538edbd-e1f4-4c53-b2d3-918d2409169f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:12.344106 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:12.383884 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd2b95-3e15-46d0-9fef-27297a1f8f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:12.384544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd2b95-3e15-46d0-9fef-27297a1f8f6e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:12.384823 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd2b95-3e15-46d0-9fef-27297a1f8f6e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:12.385093 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd2b95-3e15-46d0-9fef-27297a1f8f6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:12.387859 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c07d9-354b-47d8-8b0f-80d16d4e0748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:12.389750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c07d9-354b-47d8-8b0f-80d16d4e0748 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:12.390650 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c07d9-354b-47d8-8b0f-80d16d4e0748 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:12.391385 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c07d9-354b-47d8-8b0f-80d16d4e0748 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:12.393460 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c07d9-354b-47d8-8b0f-80d16d4e0748 None admin] RBAC: Adding query filter params (role.id=8cf7b72483b94512b497317ab1d11192, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=e1f49820de264982aeec97fa0be3c290) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:12.393669 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd2b95-3e15-46d0-9fef-27297a1f8f6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:12.394475 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c07d9-354b-47d8-8b0f-80d16d4e0748 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:12.395215 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd2b95-3e15-46d0-9fef-27297a1f8f6e None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:12.398067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c07d9-354b-47d8-8b0f-80d16d4e0748 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:12.411201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-6abd2b95-3e15-46d0-9fef-27297a1f8f6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:12.411201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:12.411201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:12.411201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:12.411201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:12.411201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:12.411201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:12.411201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:12.411201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:12.411201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:12.411201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:12.411201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:12.411201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:40:12.411201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:40:12.411201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:40:12.412444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:40:12.412444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:12.412444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:12.412444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:12.412444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:12.412444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:12.412444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:12.412444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:12.412444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:12.412444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:12.412444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:12.412444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:12.412444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:12.412444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:12.412444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:12.412444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:12.412444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:12.413363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:40:12.413363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:40:12.413363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:40:12.413363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:40:12.413363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:40:12.413363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:40:12.413363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:12.413363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:12.413793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 427/864] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:40:12 2022] GET /identity/v3/role_assignments?user.id=e1f49820de264982aeec97fa0be3c290&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=8cf7b72483b94512b497317ab1d11192 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:12.420589 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 438/865] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:40:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:12.426790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c07d9-354b-47d8-8b0f-80d16d4e0748 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:12.482033 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd2b95-3e15-46d0-9fef-27297a1f8f6e None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:12.584105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c07d9-354b-47d8-8b0f-80d16d4e0748 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:12.629688 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43479b-17bf-448d-8c64-9958ffbbe9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:12.630844 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43479b-17bf-448d-8c64-9958ffbbe9c5 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:12.631133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43479b-17bf-448d-8c64-9958ffbbe9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:12.631985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43479b-17bf-448d-8c64-9958ffbbe9c5 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:12.632364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43479b-17bf-448d-8c64-9958ffbbe9c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:12.632689 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43479b-17bf-448d-8c64-9958ffbbe9c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:12.635073 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43479b-17bf-448d-8c64-9958ffbbe9c5 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:12.651167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 428/866] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:40:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:12.656281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd2b95-3e15-46d0-9fef-27297a1f8f6e None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:12.659008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43479b-17bf-448d-8c64-9958ffbbe9c5 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:12.662196 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:12.729314 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d87ac0-381d-4fe9-ba00-7ad23119e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:12.730643 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d87ac0-381d-4fe9-ba00-7ad23119e443 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:12.730989 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d87ac0-381d-4fe9-ba00-7ad23119e443 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:12.731491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d87ac0-381d-4fe9-ba00-7ad23119e443 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:12.732756 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d87ac0-381d-4fe9-ba00-7ad23119e443 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:12.733415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:12.737830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d87ac0-381d-4fe9-ba00-7ad23119e443 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:12.753229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-14d87ac0-381d-4fe9-ba00-7ad23119e443 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:40:12.753229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:12.753229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:12.753229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:12.753229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:12.753229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:12.753229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:12.753229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:12.753229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:40:12.753229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:12.753229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:12.753229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:12.753229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:12.753229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:12.753229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:12.753229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:12.754711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:12.754711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:12.754711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:12.754711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:12.754711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:12.754711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:12.754711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:12.754711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:12.754711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:12.754711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:12.754711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:12.754711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:12.754711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:12.754711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:12.754711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:12.754711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:12.754711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:12.756329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:12.756329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:12.756329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:12.756329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:12.756329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:12.756329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:12.756329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:12.756329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:12.756329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:12.756329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:12.756329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:12.756329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:12.756329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:40:12.756329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:12.758785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 439/867] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Sep 12 23:40:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:12.764710 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d87ac0-381d-4fe9-ba00-7ad23119e443 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:12.846424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43479b-17bf-448d-8c64-9958ffbbe9c5 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:12.925630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e41837-fdb8-4862-8ca1-dc66d0fff9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:12.927179 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e41837-fdb8-4862-8ca1-dc66d0fff9e7 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:12.927913 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e41837-fdb8-4862-8ca1-dc66d0fff9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:12.928614 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e41837-fdb8-4862-8ca1-dc66d0fff9e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:12.931003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e41837-fdb8-4862-8ca1-dc66d0fff9e7 None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=43c45ae3144b4fe8ab4e921fda30164a) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:12.931547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e41837-fdb8-4862-8ca1-dc66d0fff9e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:12.934014 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e41837-fdb8-4862-8ca1-dc66d0fff9e7 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:12.949880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 429/868] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:40:12 2022] GET /identity/v3/role_assignments?user.id=43c45ae3144b4fe8ab4e921fda30164a&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=440092230f024959a90e846ab29c6367 => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:12.958329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d87ac0-381d-4fe9-ba00-7ad23119e443 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:13.031528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53b257-fcbb-47fe-a606-7414c276cf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:13.032994 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53b257-fcbb-47fe-a606-7414c276cf9a None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:13.033887 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53b257-fcbb-47fe-a606-7414c276cf9a None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:13.034630 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53b257-fcbb-47fe-a606-7414c276cf9a None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:13.036102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53b257-fcbb-47fe-a606-7414c276cf9a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:13.036909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53b257-fcbb-47fe-a606-7414c276cf9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:13.039857 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53b257-fcbb-47fe-a606-7414c276cf9a None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:13.054176 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 440/869] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 23:40:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:13.062694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e41837-fdb8-4862-8ca1-dc66d0fff9e7 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:13.256744 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e41837-fdb8-4862-8ca1-dc66d0fff9e7 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:13.267178 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:13.323268 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162d9b0-5348-4d4f-9436-043a1b82d3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:13.324263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162d9b0-5348-4d4f-9436-043a1b82d3df None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:13.324742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162d9b0-5348-4d4f-9436-043a1b82d3df None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:13.325222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162d9b0-5348-4d4f-9436-043a1b82d3df None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:13.326428 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162d9b0-5348-4d4f-9436-043a1b82d3df None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:13.326903 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162d9b0-5348-4d4f-9436-043a1b82d3df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:13.329757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162d9b0-5348-4d4f-9436-043a1b82d3df None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:13.339293 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 430/870] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 23:40:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:14.334011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa5ae2-2eab-4602-a640-f7a8412638b8 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:14.336959 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa5ae2-2eab-4602-a640-f7a8412638b8 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:14.336959 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa5ae2-2eab-4602-a640-f7a8412638b8 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:14.336959 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 441/871] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:14.342999 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f97858-f4e9-4f6f-845c-77efe3e08152 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:14.343959 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f97858-f4e9-4f6f-845c-77efe3e08152 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:14.344390 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f97858-f4e9-4f6f-845c-77efe3e08152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:14.365061 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-c3f97858-f4e9-4f6f-845c-77efe3e08152 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:14.366592 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c3f97858-f4e9-4f6f-845c-77efe3e08152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:14.446535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 431/872] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:14.713581 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa5ae2-2eab-4602-a640-f7a8412638b8 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:14.769742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:14.871337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa5ae2-2eab-4602-a640-f7a8412638b8 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:14.916236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d293c0-82e6-450c-b63a-84f0922b8a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:14.917213 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d293c0-82e6-450c-b63a-84f0922b8a93 None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:14.917712 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d293c0-82e6-450c-b63a-84f0922b8a93 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:14.918172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d293c0-82e6-450c-b63a-84f0922b8a93 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:14.919143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d293c0-82e6-450c-b63a-84f0922b8a93 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:14.920739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d293c0-82e6-450c-b63a-84f0922b8a93 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:14.941756 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 442/873] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 23:40:14 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:40:15.010309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656cde2-ba06-4eac-92d2-2bb5600d1987 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:15.010692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656cde2-ba06-4eac-92d2-2bb5600d1987 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:15.010857 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656cde2-ba06-4eac-92d2-2bb5600d1987 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:15.012420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 432/874] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:40:15.022939 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371923a-ad0f-44ff-a6a3-c675b7df230d None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:15.023908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371923a-ad0f-44ff-a6a3-c675b7df230d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:15.024684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371923a-ad0f-44ff-a6a3-c675b7df230d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:15.057107 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-9371923a-ad0f-44ff-a6a3-c675b7df230d None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:15.059674 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9371923a-ad0f-44ff-a6a3-c675b7df230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:15.198070 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 443/875] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:15 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:15.397493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63920338-91d7-4210-8d84-59e6bf8f938c None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:15.403589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63920338-91d7-4210-8d84-59e6bf8f938c None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:15.404278 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63920338-91d7-4210-8d84-59e6bf8f938c None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:15.407648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 433/876] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:40:15.412845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895837c-4714-4c75-a2b4-47fed5bd69be None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:15.413827 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895837c-4714-4c75-a2b4-47fed5bd69be None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:15.414307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895837c-4714-4c75-a2b4-47fed5bd69be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:15.441209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-1895837c-4714-4c75-a2b4-47fed5bd69be None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:15.442928 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1895837c-4714-4c75-a2b4-47fed5bd69be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:15.459203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:15.476809 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63920338-91d7-4210-8d84-59e6bf8f938c None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:15.526406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 444/877] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:15 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:15.595670 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:15.600352 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63920338-91d7-4210-8d84-59e6bf8f938c None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:15.642758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a59e97-53ec-4ab1-b0d2-e43b323164f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:15.643412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a59e97-53ec-4ab1-b0d2-e43b323164f6 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:15.643687 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a59e97-53ec-4ab1-b0d2-e43b323164f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:15.643955 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a59e97-53ec-4ab1-b0d2-e43b323164f6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:15.656623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a59e97-53ec-4ab1-b0d2-e43b323164f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:40:15.661465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-11a59e97-53ec-4ab1-b0d2-e43b323164f6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:40:15.661465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:15.661465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:15.661465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:15.661465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:15.661465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:15.661465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:15.661465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:15.661465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:15.661465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:15.661465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:15.661465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:15.661465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:40:15.661465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:40:15.661465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:40:15.661465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:40:15.662515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:40:15.662515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:40:15.662515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:40:15.662515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:40:15.662515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:15.662515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:15.662515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:15.662515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:15.662515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:15.662515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:15.662515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:15.662515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:15.662515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:15.662515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:15.662515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:15.662515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:15.663770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:15.663770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:15.663770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:15.663770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:15.663770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:40:15.663770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:40:15.663770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:40:15.663770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:40:15.663770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:40:15.663770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:40:15.663770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:40:15.663770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:15.663770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 434/878] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 12 23:40:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:15.673038 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895837c-4714-4c75-a2b4-47fed5bd69be None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:15.813979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a59e97-53ec-4ab1-b0d2-e43b323164f6 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:15.868528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895837c-4714-4c75-a2b4-47fed5bd69be None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:15.926994 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ba256-1b2f-4f34-9c4c-1cf01c54e40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:15.927549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ba256-1b2f-4f34-9c4c-1cf01c54e40f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:15.927827 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ba256-1b2f-4f34-9c4c-1cf01c54e40f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:15.928092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ba256-1b2f-4f34-9c4c-1cf01c54e40f None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:15.928783 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ba256-1b2f-4f34-9c4c-1cf01c54e40f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:15.929074 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ba256-1b2f-4f34-9c4c-1cf01c54e40f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:15.930534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ba256-1b2f-4f34-9c4c-1cf01c54e40f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:15.936499 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a59e97-53ec-4ab1-b0d2-e43b323164f6 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:15.941689 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 445/879] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 12 23:40:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:15.942875 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfdceb-f921-4923-aa1c-793c195d4445 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:15.943128 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfdceb-f921-4923-aa1c-793c195d4445 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:15.943397 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfdceb-f921-4923-aa1c-793c195d4445 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:15.944922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 446/880] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:15.950792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8f392-6eae-4a4c-8a09-bdd492f1961a None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:15.951070 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8f392-6eae-4a4c-8a09-bdd492f1961a None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:15.951344 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8f392-6eae-4a4c-8a09-bdd492f1961a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:15.971720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-cff8f392-6eae-4a4c-8a09-bdd492f1961a None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:15.973059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-cff8f392-6eae-4a4c-8a09-bdd492f1961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:15.978093 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:15.992294 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9d250-d0b9-4582-bc30-9b5427382e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:15.992970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9d250-d0b9-4582-bc30-9b5427382e49 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:15.993241 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9d250-d0b9-4582-bc30-9b5427382e49 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:15.993557 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9d250-d0b9-4582-bc30-9b5427382e49 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:15.994167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9d250-d0b9-4582-bc30-9b5427382e49 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:15.996314 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9d250-d0b9-4582-bc30-9b5427382e49 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:16.009420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-ede9d250-d0b9-4582-bc30-9b5427382e49 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:40:16.009420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:16.009420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:16.009420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:16.009420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:16.009420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:16.009420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:16.009420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:16.009420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:40:16.009420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:16.009420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:16.009420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:16.009420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:16.009420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:16.009420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:16.009420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:16.009420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:16.011509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:16.011509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:16.011509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:16.011509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:16.011509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:16.011509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:16.011509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:16.011509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:16.011509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:16.011509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:16.011509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:16.011509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:16.011509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:16.011509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:16.011509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:16.011509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:16.013252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:16.013252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:16.013252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:16.013252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:16.013252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:16.013252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:16.013252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:16.013252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:16.013252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:16.013252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:16.013252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:16.013252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:16.013252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:40:16.013252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:16.016220 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 435/881] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 23:40:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:16.017246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9d250-d0b9-4582-bc30-9b5427382e49 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:16.049858 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:16.076728 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 447/882] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:15 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:16.078263 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8f392-6eae-4a4c-8a09-bdd492f1961a None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:16.161626 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9d250-d0b9-4582-bc30-9b5427382e49 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:16.212555 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671cf6f-7c7f-4769-ab06-a5a56b93d70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:16.213490 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671cf6f-7c7f-4769-ab06-a5a56b93d70e None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:16.213918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671cf6f-7c7f-4769-ab06-a5a56b93d70e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:16.214331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671cf6f-7c7f-4769-ab06-a5a56b93d70e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:16.228512 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671cf6f-7c7f-4769-ab06-a5a56b93d70e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:16.230313 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671cf6f-7c7f-4769-ab06-a5a56b93d70e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:16.249279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-6671cf6f-7c7f-4769-ab06-a5a56b93d70e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:16.249279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:16.249279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:16.249279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:16.249279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:16.249279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:16.249279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:16.249279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:16.249279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:16.249279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:16.249279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:16.249279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:16.249279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:16.249279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:16.249279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:16.249279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:16.250582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:16.250582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:16.250582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:16.250582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:16.250582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:16.250582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:16.250582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:16.250582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:16.250582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:16.250582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:16.250582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:16.250582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:16.250582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:16.250582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:16.250582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:16.250582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:16.250582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:16.251592 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:16.251592 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:16.251592 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:16.258431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 436/883] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:16.260553 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671cf6f-7c7f-4769-ab06-a5a56b93d70e None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:16.274860 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8f392-6eae-4a4c-8a09-bdd492f1961a None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:16.329858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aa4c7-bfbf-4fee-8e4d-691e79d18acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:16.330953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aa4c7-bfbf-4fee-8e4d-691e79d18acb None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:16.331388 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aa4c7-bfbf-4fee-8e4d-691e79d18acb None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:16.331914 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aa4c7-bfbf-4fee-8e4d-691e79d18acb None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:16.332583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40aa4c7-bfbf-4fee-8e4d-691e79d18acb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:16.332885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40aa4c7-bfbf-4fee-8e4d-691e79d18acb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:16.334348 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40aa4c7-bfbf-4fee-8e4d-691e79d18acb None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:16.345403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 448/884] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 23:40:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:16.349962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aa4c7-bfbf-4fee-8e4d-691e79d18acb None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:16.354710 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:16.397238 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:16.456915 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671cf6f-7c7f-4769-ab06-a5a56b93d70e None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:16.514346 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aa4c7-bfbf-4fee-8e4d-691e79d18acb None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:16.541391 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d6d5a-40e1-452a-bbe8-bc748c91415d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:16.542578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d6d5a-40e1-452a-bbe8-bc748c91415d None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:16.543128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d6d5a-40e1-452a-bbe8-bc748c91415d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:16.544604 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d6d5a-40e1-452a-bbe8-bc748c91415d None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:16.546339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d6d5a-40e1-452a-bbe8-bc748c91415d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:16.547001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d6d5a-40e1-452a-bbe8-bc748c91415d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:16.550064 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d6d5a-40e1-452a-bbe8-bc748c91415d None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:16.572412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 437/885] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:16.572412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d6d5a-40e1-452a-bbe8-bc748c91415d None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:16.575188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e8d7a-8c28-492e-a80e-8bff70973890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:16.576005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e8d7a-8c28-492e-a80e-8bff70973890 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:16.576414 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e8d7a-8c28-492e-a80e-8bff70973890 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:16.576818 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e8d7a-8c28-492e-a80e-8bff70973890 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:16.577771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e8d7a-8c28-492e-a80e-8bff70973890 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:16.578236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e8d7a-8c28-492e-a80e-8bff70973890 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:16.579832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e8d7a-8c28-492e-a80e-8bff70973890 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:16.593540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 449/886] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 23:40:16 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:16.593540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e8d7a-8c28-492e-a80e-8bff70973890 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:16.709654 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d6d5a-40e1-452a-bbe8-bc748c91415d None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:16.735827 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:16.757563 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79c78b-3f30-449a-b544-a9a0a36a3457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:16.758491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c78b-3f30-449a-b544-a9a0a36a3457 None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:16.759028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c78b-3f30-449a-b544-a9a0a36a3457 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:16.759440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c78b-3f30-449a-b544-a9a0a36a3457 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:16.760358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79c78b-3f30-449a-b544-a9a0a36a3457 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:16.762063 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79c78b-3f30-449a-b544-a9a0a36a3457 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:16.768455 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:16.787429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 438/887] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 23:40:16 2022] POST /identity/v3/services => generated 269 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:40:16.811760 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e8d7a-8c28-492e-a80e-8bff70973890 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:16.868368 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675abf2-a750-4396-a8de-a4e096da484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:16.869095 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675abf2-a750-4396-a8de-a4e096da484f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:16.869404 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675abf2-a750-4396-a8de-a4e096da484f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:16.869707 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675abf2-a750-4396-a8de-a4e096da484f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:16.881722 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675abf2-a750-4396-a8de-a4e096da484f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:16.884294 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675abf2-a750-4396-a8de-a4e096da484f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:16.898892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-3675abf2-a750-4396-a8de-a4e096da484f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:40:16.898892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:16.898892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:16.898892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:16.898892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:16.898892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:16.898892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:16.898892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:16.898892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:16.898892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:16.898892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:16.898892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:16.898892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:40:16.898892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:40:16.898892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:40:16.898892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:16.900828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:16.905224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:16.905224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:16.905224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:40:16.905224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:40:16.905224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:40:16.905224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:40:16.905224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:40:16.905224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:40:16.905224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:40:16.905224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:16.905224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 450/888] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 23:40:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:16.907762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79c78b-3f30-449a-b544-a9a0a36a3457 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:17.068872 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79c78b-3f30-449a-b544-a9a0a36a3457 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:17.111574 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958b6dd-0e7e-4c88-9014-1b1a5ef129eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:17.112200 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958b6dd-0e7e-4c88-9014-1b1a5ef129eb None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:17.112533 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958b6dd-0e7e-4c88-9014-1b1a5ef129eb None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:17.112783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958b6dd-0e7e-4c88-9014-1b1a5ef129eb None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:17.113571 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958b6dd-0e7e-4c88-9014-1b1a5ef129eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:17.113876 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958b6dd-0e7e-4c88-9014-1b1a5ef129eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:17.115323 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958b6dd-0e7e-4c88-9014-1b1a5ef129eb None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:17.136555 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 439/889] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 12 23:40:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:17.142231 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675abf2-a750-4396-a8de-a4e096da484f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:17.286626 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675abf2-a750-4396-a8de-a4e096da484f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:17.313154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:17.325862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b526eab-b405-4a62-915f-8a283571cc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:17.326419 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b526eab-b405-4a62-915f-8a283571cc25 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:17.327333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b526eab-b405-4a62-915f-8a283571cc25 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:17.327333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b526eab-b405-4a62-915f-8a283571cc25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:17.406256 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b526eab-b405-4a62-915f-8a283571cc25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:17.407746 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b526eab-b405-4a62-915f-8a283571cc25 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:17.452888 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f935ff0-16a7-450e-9bc3-3cae6b366c6f None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:17.453320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f935ff0-16a7-450e-9bc3-3cae6b366c6f None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:17.453593 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f935ff0-16a7-450e-9bc3-3cae6b366c6f None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:17.455085 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 440/890] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:40:17.460700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8563097-2056-4288-a860-9eec0dadd24f None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:17.461805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8563097-2056-4288-a860-9eec0dadd24f None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:17.461805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8563097-2056-4288-a860-9eec0dadd24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:17.481633 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-c8563097-2056-4288-a860-9eec0dadd24f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:17.482847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c8563097-2056-4288-a860-9eec0dadd24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:17.544462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 451/891] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:40:17 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:40:17.553416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b526eab-b405-4a62-915f-8a283571cc25 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:17.575775 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 441/892] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:17.578112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:17.615967 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:17.758369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b526eab-b405-4a62-915f-8a283571cc25 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:17.822008 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c80bb8-8658-485b-8cba-6580a282346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:17.823242 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c80bb8-8658-485b-8cba-6580a282346f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:17.823723 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c80bb8-8658-485b-8cba-6580a282346f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:17.824239 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c80bb8-8658-485b-8cba-6580a282346f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:17.844047 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c80bb8-8658-485b-8cba-6580a282346f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:17.846647 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c80bb8-8658-485b-8cba-6580a282346f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:17.875048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-39c80bb8-8658-485b-8cba-6580a282346f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:17.875048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:17.875048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:17.875048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:17.875048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:17.875048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:17.875048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:17.875048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:17.875048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:17.875048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:17.875048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:17.875048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:17.875048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:17.875048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:17.875048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:17.875048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:17.876854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:17.876854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:17.876854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:17.876854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:17.876854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:17.876854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:17.876854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:17.876854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:17.876854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:17.876854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:17.876854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:17.876854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:17.876854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:17.876854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:17.876854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:17.876854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:17.876854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:17.878554 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:17.878554 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:17.878554 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:17.881678 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 452/893] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:17.887054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8563097-2056-4288-a860-9eec0dadd24f None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:18.037790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8563097-2056-4288-a860-9eec0dadd24f None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:18.071688 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c80bb8-8658-485b-8cba-6580a282346f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:18.086248 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156fe3b-06fd-4331-a5c7-706365c540a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:18.087697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156fe3b-06fd-4331-a5c7-706365c540a8 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:18.088528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156fe3b-06fd-4331-a5c7-706365c540a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:18.089241 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156fe3b-06fd-4331-a5c7-706365c540a8 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:18.090627 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156fe3b-06fd-4331-a5c7-706365c540a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:18.091398 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156fe3b-06fd-4331-a5c7-706365c540a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:18.094332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156fe3b-06fd-4331-a5c7-706365c540a8 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:18.116827 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 442/894] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:18.123397 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156fe3b-06fd-4331-a5c7-706365c540a8 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:18.205903 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:18.216726 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:18.267963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c80bb8-8658-485b-8cba-6580a282346f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:18.277643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156fe3b-06fd-4331-a5c7-706365c540a8 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:18.319027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb94c1a-32ed-487d-b02d-a3319e136190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:18.319679 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94c1a-32ed-487d-b02d-a3319e136190 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:18.319957 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94c1a-32ed-487d-b02d-a3319e136190 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:18.320226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94c1a-32ed-487d-b02d-a3319e136190 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:18.328794 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb94c1a-32ed-487d-b02d-a3319e136190 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:18.330436 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb94c1a-32ed-487d-b02d-a3319e136190 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:18.344932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-7bb94c1a-32ed-487d-b02d-a3319e136190 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:18.344932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:18.344932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:18.344932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:18.344932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:18.344932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:18.344932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:18.344932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:18.344932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:18.344932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:18.344932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:18.344932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:18.344932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:40:18.344932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:40:18.344932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:40:18.346629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:40:18.346629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:18.346629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:18.346629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:18.346629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:18.346629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:18.346629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:18.346629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:18.346629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:18.346629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:18.346629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:18.346629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:18.346629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:18.346629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:18.346629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:18.346629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:18.346629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:18.348301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:40:18.348301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:40:18.348301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:40:18.348301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:40:18.348301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:40:18.348301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:40:18.348301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:18.348301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:18.348301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 443/895] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:40:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:18.350131 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdf000-939d-4d7e-8149-d8d13f0c957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:18.350502 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdf000-939d-4d7e-8149-d8d13f0c957a None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:18.350781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdf000-939d-4d7e-8149-d8d13f0c957a None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:18.351055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdf000-939d-4d7e-8149-d8d13f0c957a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:18.351677 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdf000-939d-4d7e-8149-d8d13f0c957a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:18.353095 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdf000-939d-4d7e-8149-d8d13f0c957a None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:18.355078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb94c1a-32ed-487d-b02d-a3319e136190 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:18.363455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-acbdf000-939d-4d7e-8149-d8d13f0c957a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:40:18.363455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:18.363455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:18.363455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:18.363455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:18.363455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:18.363455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:18.363455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:18.363455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:40:18.363455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:18.363455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:18.363455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:18.363455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:18.363455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:18.363455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:18.363455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:18.363455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:18.365302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:18.365302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:18.365302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:18.365302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:18.365302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:18.365302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:18.365302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:18.365302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:18.365302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:18.365302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:18.365302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:18.365302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:18.365302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:18.365302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:18.365302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:18.365302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:18.366940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:18.366940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:18.366940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:18.366940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:18.366940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:18.366940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:18.366940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:18.366940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:18.366940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:18.366940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:18.366940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:18.366940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:18.366940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:40:18.366940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:18.366940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 453/896] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:40:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:18.377189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdf000-939d-4d7e-8149-d8d13f0c957a None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:18.517564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb94c1a-32ed-487d-b02d-a3319e136190 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:18.519708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdf000-939d-4d7e-8149-d8d13f0c957a None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:18.520889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:18.565297 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec40ef-2c96-4a65-842d-6681e9b34a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:18.565949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec40ef-2c96-4a65-842d-6681e9b34a61 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:18.566236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec40ef-2c96-4a65-842d-6681e9b34a61 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:18.566510 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec40ef-2c96-4a65-842d-6681e9b34a61 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:18.567165 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec40ef-2c96-4a65-842d-6681e9b34a61 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:18.567486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec40ef-2c96-4a65-842d-6681e9b34a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:18.568930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec40ef-2c96-4a65-842d-6681e9b34a61 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:18.571747 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15a699-1f3b-401e-a73c-ec9d2fccfc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:18.572914 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15a699-1f3b-401e-a73c-ec9d2fccfc72 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:18.573380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15a699-1f3b-401e-a73c-ec9d2fccfc72 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:18.573792 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15a699-1f3b-401e-a73c-ec9d2fccfc72 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:18.574689 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15a699-1f3b-401e-a73c-ec9d2fccfc72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:18.574988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 454/897] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:40:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:18.575368 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15a699-1f3b-401e-a73c-ec9d2fccfc72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:18.576955 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15a699-1f3b-401e-a73c-ec9d2fccfc72 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:18.584211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec40ef-2c96-4a65-842d-6681e9b34a61 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:18.591400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:18.595074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 444/898] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:40:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:18.603780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15a699-1f3b-401e-a73c-ec9d2fccfc72 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:18.737967 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec40ef-2c96-4a65-842d-6681e9b34a61 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:18.756871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15a699-1f3b-401e-a73c-ec9d2fccfc72 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:18.777373 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593f286-74ed-4210-96fa-734fbf0ebf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:18.778419 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593f286-74ed-4210-96fa-734fbf0ebf94 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:18.778900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593f286-74ed-4210-96fa-734fbf0ebf94 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:18.779453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593f286-74ed-4210-96fa-734fbf0ebf94 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:18.780300 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593f286-74ed-4210-96fa-734fbf0ebf94 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:18.780901 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593f286-74ed-4210-96fa-734fbf0ebf94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:18.782646 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593f286-74ed-4210-96fa-734fbf0ebf94 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:18.793694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 455/899] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:40:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:18.798024 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e445f2-9390-4989-a879-537edaf7bad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:18.798659 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593f286-74ed-4210-96fa-734fbf0ebf94 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:18.798969 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e445f2-9390-4989-a879-537edaf7bad0 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:18.799353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e445f2-9390-4989-a879-537edaf7bad0 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:18.799764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e445f2-9390-4989-a879-537edaf7bad0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:18.800603 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e445f2-9390-4989-a879-537edaf7bad0 None admin] RBAC: Adding query filter params (role.id=3c77102a55e849eb882b984ac3e3dfb4, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=e1f49820de264982aeec97fa0be3c290) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:18.801010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e445f2-9390-4989-a879-537edaf7bad0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:18.802749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e445f2-9390-4989-a879-537edaf7bad0 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:18.817767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 445/900] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:40:18 2022] GET /identity/v3/role_assignments?user.id=e1f49820de264982aeec97fa0be3c290&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=3c77102a55e849eb882b984ac3e3dfb4 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:18.878980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:18.919841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593f286-74ed-4210-96fa-734fbf0ebf94 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:18.962275 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91285d2-46d9-473e-8d82-394e950813b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:18.962950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91285d2-46d9-473e-8d82-394e950813b6 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:18.963233 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91285d2-46d9-473e-8d82-394e950813b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:18.963506 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91285d2-46d9-473e-8d82-394e950813b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:18.964237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91285d2-46d9-473e-8d82-394e950813b6 None admin] RBAC: Adding query filter params (interface=public, service_id=0163069923544bddba8028662edbdc9d, region_id=RegionOne) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:18.964547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91285d2-46d9-473e-8d82-394e950813b6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:18.966016 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91285d2-46d9-473e-8d82-394e950813b6 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:18.972474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 456/901] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 12 23:40:18 2022] GET /identity/v3/endpoints?service_id=0163069923544bddba8028662edbdc9d&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:18.978532 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e445f2-9390-4989-a879-537edaf7bad0 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:19.012938 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:19.120049 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e445f2-9390-4989-a879-537edaf7bad0 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:19.180134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d662963-e628-4228-96b2-4f41418bfd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:19.180691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d662963-e628-4228-96b2-4f41418bfd23 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:19.180972 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d662963-e628-4228-96b2-4f41418bfd23 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:19.181243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d662963-e628-4228-96b2-4f41418bfd23 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:19.181922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d662963-e628-4228-96b2-4f41418bfd23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:19.183340 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d662963-e628-4228-96b2-4f41418bfd23 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:19.190876 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 446/902] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 23:40:18 2022] GET /identity/v3/services => generated 1268 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:40:19.535279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94292e-dc38-44c4-8c9d-5a37a9d7b796 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:19.535641 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94292e-dc38-44c4-8c9d-5a37a9d7b796 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:19.535831 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94292e-dc38-44c4-8c9d-5a37a9d7b796 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:19.537634 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 457/903] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:19.543747 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a373-5a60-4a9a-940d-be653c6a4892 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:19.544280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a373-5a60-4a9a-940d-be653c6a4892 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:19.544280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a373-5a60-4a9a-940d-be653c6a4892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:19.565386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-38b4a373-5a60-4a9a-940d-be653c6a4892 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:19.566652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-38b4a373-5a60-4a9a-940d-be653c6a4892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:19.658746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 447/904] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:19.728879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde318b-7b34-4a70-8037-66fe638c605d None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:19.729453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde318b-7b34-4a70-8037-66fe638c605d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:19.729453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde318b-7b34-4a70-8037-66fe638c605d None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:19.731058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 458/905] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:19.737490 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b369c-cdc0-4ffd-ad83-3c55596a21ff None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:19.738185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b369c-cdc0-4ffd-ad83-3c55596a21ff None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:19.738754 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b369c-cdc0-4ffd-ad83-3c55596a21ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:19.759563 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-906b369c-cdc0-4ffd-ad83-3c55596a21ff None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:19.761142 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-906b369c-cdc0-4ffd-ad83-3c55596a21ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:19.782180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:19.852824 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 448/906] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:19.930304 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde318b-7b34-4a70-8037-66fe638c605d None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:20.128524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde318b-7b34-4a70-8037-66fe638c605d None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:20.189750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:20.191045 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c564ced-8948-4c3c-b065-ed4739a1c850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:20.192075 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c564ced-8948-4c3c-b065-ed4739a1c850 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:20.192568 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c564ced-8948-4c3c-b065-ed4739a1c850 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:20.193043 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c564ced-8948-4c3c-b065-ed4739a1c850 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:20.194096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c564ced-8948-4c3c-b065-ed4739a1c850 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:20.196778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c564ced-8948-4c3c-b065-ed4739a1c850 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:20.212585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-8c564ced-8948-4c3c-b065-ed4739a1c850 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:40:20.212585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:20.212585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:20.212585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:20.212585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:20.212585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:20.212585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:20.212585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:20.212585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:40:20.212585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:20.212585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:20.212585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:20.212585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:20.212585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:20.212585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:20.212585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:20.213623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:20.213623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:20.213623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:20.213623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:20.213623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:20.213623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:20.213623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:20.213623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:20.213623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:20.213623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:20.213623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:20.213623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:20.213623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:20.213623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:20.213623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:20.213623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:20.213623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:20.214517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:20.214517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:20.214517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:20.214517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:20.214517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:20.214517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:20.214517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:20.214517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:20.214517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:20.214517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:20.214517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:20.214517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:20.214517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:40:20.214517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:20.216221 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 459/907] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Sep 12 23:40:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:20.223977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b369c-cdc0-4ffd-ad83-3c55596a21ff None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:20.227341 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c564ced-8948-4c3c-b065-ed4739a1c850 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:20.395612 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c564ced-8948-4c3c-b065-ed4739a1c850 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:20.435378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b369c-cdc0-4ffd-ad83-3c55596a21ff None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:20.461949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad10cb-b48e-4fd6-95df-a3cfe1d21463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:20.462991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad10cb-b48e-4fd6-95df-a3cfe1d21463 None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:20.463447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad10cb-b48e-4fd6-95df-a3cfe1d21463 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:20.463872 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad10cb-b48e-4fd6-95df-a3cfe1d21463 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:20.465013 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad10cb-b48e-4fd6-95df-a3cfe1d21463 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:20.467891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad10cb-b48e-4fd6-95df-a3cfe1d21463 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:20.490378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff6b02-f623-4872-9d11-d096776cd01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:20.492072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff6b02-f623-4872-9d11-d096776cd01c None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:20.492857 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff6b02-f623-4872-9d11-d096776cd01c None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:20.493655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff6b02-f623-4872-9d11-d096776cd01c None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:20.495096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff6b02-f623-4872-9d11-d096776cd01c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:20.495929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff6b02-f623-4872-9d11-d096776cd01c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:20.497170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 460/908] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 23:40:20 2022] POST /identity/v3/services => generated 241 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:40:20.498854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff6b02-f623-4872-9d11-d096776cd01c None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:20.512243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 449/909] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 23:40:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:20.523571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad10cb-b48e-4fd6-95df-a3cfe1d21463 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:20.647979 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:20.756308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad10cb-b48e-4fd6-95df-a3cfe1d21463 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:20.823778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61025b91-5da1-4c23-a837-1aa19854601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:20.825283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61025b91-5da1-4c23-a837-1aa19854601b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:20.826096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61025b91-5da1-4c23-a837-1aa19854601b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:20.826847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61025b91-5da1-4c23-a837-1aa19854601b None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:20.834773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61025b91-5da1-4c23-a837-1aa19854601b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:20.841054 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61025b91-5da1-4c23-a837-1aa19854601b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:20.844008 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61025b91-5da1-4c23-a837-1aa19854601b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:20.855477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 461/910] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 23:40:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:20.866516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff6b02-f623-4872-9d11-d096776cd01c None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:20.904711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:21.083449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff6b02-f623-4872-9d11-d096776cd01c None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:21.143860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25ce86-e107-4bd2-9c10-a24e08a54dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:21.145647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25ce86-e107-4bd2-9c10-a24e08a54dbc None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:21.146499 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25ce86-e107-4bd2-9c10-a24e08a54dbc None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:21.147243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25ce86-e107-4bd2-9c10-a24e08a54dbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:21.148861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25ce86-e107-4bd2-9c10-a24e08a54dbc None admin] RBAC: Adding query filter params (interface=public, service_id=170069ad14c648099a811a0519f0addf, region_id=RegionOne) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:21.149696 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25ce86-e107-4bd2-9c10-a24e08a54dbc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:21.152799 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25ce86-e107-4bd2-9c10-a24e08a54dbc None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:21.164110 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 450/911] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 12 23:40:20 2022] GET /identity/v3/endpoints?service_id=170069ad14c648099a811a0519f0addf&interface=public®ion_id=RegionOne => generated 194 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:21.174218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61025b91-5da1-4c23-a837-1aa19854601b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:21.358334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61025b91-5da1-4c23-a837-1aa19854601b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:21.389064 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:21.429021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db66f8c-5eaa-4140-a80c-5bd4b49f1bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:21.440262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db66f8c-5eaa-4140-a80c-5bd4b49f1bda None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:21.441150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db66f8c-5eaa-4140-a80c-5bd4b49f1bda None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:21.441953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db66f8c-5eaa-4140-a80c-5bd4b49f1bda None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:21.443322 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db66f8c-5eaa-4140-a80c-5bd4b49f1bda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:21.446181 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db66f8c-5eaa-4140-a80c-5bd4b49f1bda None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:21.458927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 462/912] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 23:40:21 2022] GET /identity/v3/services => generated 1497 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:40:22.020598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2199b-6a82-4be6-9998-a40135946ea1 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:22.022219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2199b-6a82-4be6-9998-a40135946ea1 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:22.022960 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2199b-6a82-4be6-9998-a40135946ea1 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:22.026320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 451/913] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:22.031924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee616be-d58c-4368-922f-e544c27cc0fa None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:22.032715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee616be-d58c-4368-922f-e544c27cc0fa None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:22.032715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee616be-d58c-4368-922f-e544c27cc0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:22.051893 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-8ee616be-d58c-4368-922f-e544c27cc0fa None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:22.053105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-8ee616be-d58c-4368-922f-e544c27cc0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:22.055860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20865307-e952-4ba5-ab0c-a12660360419 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:22.056510 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20865307-e952-4ba5-ab0c-a12660360419 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:22.056992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20865307-e952-4ba5-ab0c-a12660360419 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:22.059896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 452/914] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:22.070411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74d705-4b3d-49a8-b191-684655a9a4c8 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:22.071068 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74d705-4b3d-49a8-b191-684655a9a4c8 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:22.071536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74d705-4b3d-49a8-b191-684655a9a4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:22.104716 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-dc74d705-4b3d-49a8-b191-684655a9a4c8 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:22.106782 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-dc74d705-4b3d-49a8-b191-684655a9a4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:22.147137 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 463/915] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:22.244963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 453/916] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:22.623552 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee616be-d58c-4368-922f-e544c27cc0fa None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:22.670187 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74d705-4b3d-49a8-b191-684655a9a4c8 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:22.683301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:22.757980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee616be-d58c-4368-922f-e544c27cc0fa None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:22.772383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:22.787415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74d705-4b3d-49a8-b191-684655a9a4c8 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:22.803427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978637f2-d9b9-441b-aed5-a7958a13c670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:22.804104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978637f2-d9b9-441b-aed5-a7958a13c670 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:22.804567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978637f2-d9b9-441b-aed5-a7958a13c670 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:22.804845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978637f2-d9b9-441b-aed5-a7958a13c670 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:22.819425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978637f2-d9b9-441b-aed5-a7958a13c670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:40:22.824977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-978637f2-d9b9-441b-aed5-a7958a13c670 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:40:22.824977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:22.824977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:22.824977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:22.824977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:22.824977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:22.824977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:22.824977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:22.824977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:22.824977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:22.824977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:22.824977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:22.824977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:40:22.824977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:40:22.824977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:40:22.824977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:40:22.826977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:40:22.826977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:40:22.826977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:40:22.826977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:40:22.826977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:22.826977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:22.826977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:22.826977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:22.826977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:22.826977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:22.826977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:22.826977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:22.826977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:22.826977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:22.826977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:22.826977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:22.829571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:22.829571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:22.829571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:22.829571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:22.829571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:40:22.829571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:40:22.829571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:40:22.829571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:40:22.829571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:40:22.829571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:40:22.829571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:40:22.829571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:22.831979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647cce0-1a1e-405d-8e3d-93e6eed73dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:22.831979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647cce0-1a1e-405d-8e3d-93e6eed73dcb None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:22.831979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647cce0-1a1e-405d-8e3d-93e6eed73dcb None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:22.832600 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 464/917] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 12 23:40:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:22.832815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647cce0-1a1e-405d-8e3d-93e6eed73dcb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:22.832815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647cce0-1a1e-405d-8e3d-93e6eed73dcb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:22.833258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978637f2-d9b9-441b-aed5-a7958a13c670 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:22.841031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647cce0-1a1e-405d-8e3d-93e6eed73dcb None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:22.843998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-8647cce0-1a1e-405d-8e3d-93e6eed73dcb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:40:22.843998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:22.843998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:22.843998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:22.843998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:22.843998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:22.843998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:22.843998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:22.843998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:40:22.843998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:22.843998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:22.843998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:22.843998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:22.843998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:22.843998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:22.843998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:22.843998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:22.847424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:22.847424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:22.847424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:22.847424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:22.847424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:22.847424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:22.847424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:22.847424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:22.847424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:22.847424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:22.847424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:22.847424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:22.847424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:22.847424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:22.847424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:22.847424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:22.850539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:22.850539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:22.850539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:22.850539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:22.850539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:22.850539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:22.850539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:22.850539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:22.850539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:22.850539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:22.850539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:22.850539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:22.850539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 12 23:40:22.850539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:22.850539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 454/918] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:40:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:22.859567 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647cce0-1a1e-405d-8e3d-93e6eed73dcb None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:22.954470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:22.958307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978637f2-d9b9-441b-aed5-a7958a13c670 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:22.990133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647cce0-1a1e-405d-8e3d-93e6eed73dcb None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:22.998065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d4c88-db55-4597-9988-001384aeb2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:22.998781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d4c88-db55-4597-9988-001384aeb2d4 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:22.999121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d4c88-db55-4597-9988-001384aeb2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:22.999491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d4c88-db55-4597-9988-001384aeb2d4 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:23.000230 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d4c88-db55-4597-9988-001384aeb2d4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:23.000613 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d4c88-db55-4597-9988-001384aeb2d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:23.002077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d4c88-db55-4597-9988-001384aeb2d4 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:23.013461 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 465/919] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 12 23:40:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:23.013461 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ec6eb-2b96-487b-8a2d-857dd41066f1 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:23.013461 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ec6eb-2b96-487b-8a2d-857dd41066f1 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:23.013461 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ec6eb-2b96-487b-8a2d-857dd41066f1 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:23.017397 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 466/920] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:23.017397 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ec6eb-2b96-487b-8a2d-857dd41066f1 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:23.056293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:23.063757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab29c41-36dc-4b40-8491-1a748f671c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:23.065073 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab29c41-36dc-4b40-8491-1a748f671c7c None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:23.065624 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab29c41-36dc-4b40-8491-1a748f671c7c None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:23.066098 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab29c41-36dc-4b40-8491-1a748f671c7c None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:23.067286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab29c41-36dc-4b40-8491-1a748f671c7c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:23.067818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab29c41-36dc-4b40-8491-1a748f671c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:23.070010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab29c41-36dc-4b40-8491-1a748f671c7c None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:23.077003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 455/921] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:40:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:23.079238 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfb414-866a-4e61-a82b-e3fe6559a688 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:23.079719 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfb414-866a-4e61-a82b-e3fe6559a688 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:23.080188 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfb414-866a-4e61-a82b-e3fe6559a688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:23.102693 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-f4cfb414-866a-4e61-a82b-e3fe6559a688 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:23.104877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f4cfb414-866a-4e61-a82b-e3fe6559a688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:23.174641 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ec6eb-2b96-487b-8a2d-857dd41066f1 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:23.194996 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 456/922] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:23.202467 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfb414-866a-4e61-a82b-e3fe6559a688 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:23.222682 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770658fd-e67c-4db8-809b-d2925fb0c808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:23.223797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770658fd-e67c-4db8-809b-d2925fb0c808 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:23.224305 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770658fd-e67c-4db8-809b-d2925fb0c808 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:23.224855 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770658fd-e67c-4db8-809b-d2925fb0c808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:23.237929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770658fd-e67c-4db8-809b-d2925fb0c808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:23.239636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770658fd-e67c-4db8-809b-d2925fb0c808 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:23.256540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-770658fd-e67c-4db8-809b-d2925fb0c808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:23.256540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:23.256540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:23.256540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:23.256540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:23.256540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:23.256540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:23.256540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:23.256540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:23.256540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:23.256540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:23.256540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:23.256540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:23.256540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:23.256540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:23.256540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:23.257606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:23.257606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:23.257606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:23.257606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:23.257606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:23.257606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:23.257606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:23.257606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:23.257606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:23.257606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:23.257606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:23.257606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:23.257606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:23.257606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:23.257606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:23.257606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:23.257606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:23.258501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:23.258501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:23.258501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:23.261884 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 467/923] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:23.264105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770658fd-e67c-4db8-809b-d2925fb0c808 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:23.304562 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:23.346579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfb414-866a-4e61-a82b-e3fe6559a688 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:23.379782 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:23.391019 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ace79d-db74-4e64-a49a-f567f0f9f64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:23.391650 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ace79d-db74-4e64-a49a-f567f0f9f64f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:23.391929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ace79d-db74-4e64-a49a-f567f0f9f64f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:23.392200 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ace79d-db74-4e64-a49a-f567f0f9f64f None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:23.392847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ace79d-db74-4e64-a49a-f567f0f9f64f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:23.393148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ace79d-db74-4e64-a49a-f567f0f9f64f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:23.394760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ace79d-db74-4e64-a49a-f567f0f9f64f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:23.401097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 457/924] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 12 23:40:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:23.408910 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770658fd-e67c-4db8-809b-d2925fb0c808 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:23.410094 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ace79d-db74-4e64-a49a-f567f0f9f64f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:23.452065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f76a17-eb36-4571-9a8d-1e0729173d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:23.453419 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f76a17-eb36-4571-9a8d-1e0729173d7e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:23.453934 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f76a17-eb36-4571-9a8d-1e0729173d7e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:23.454427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f76a17-eb36-4571-9a8d-1e0729173d7e None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:23.455753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f76a17-eb36-4571-9a8d-1e0729173d7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:23.456431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f76a17-eb36-4571-9a8d-1e0729173d7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:23.458175 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f76a17-eb36-4571-9a8d-1e0729173d7e None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:23.476019 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 468/925] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:23.485508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f76a17-eb36-4571-9a8d-1e0729173d7e None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:23.575568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ace79d-db74-4e64-a49a-f567f0f9f64f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:23.613978 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:23.620999 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad269f-33ba-44ba-a380-768d15225e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:23.622003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad269f-33ba-44ba-a380-768d15225e77 None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:23.622285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad269f-33ba-44ba-a380-768d15225e77 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:23.622547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad269f-33ba-44ba-a380-768d15225e77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:23.623258 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad269f-33ba-44ba-a380-768d15225e77 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:23.625374 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad269f-33ba-44ba-a380-768d15225e77 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:23.642189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f76a17-eb36-4571-9a8d-1e0729173d7e None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:23.661377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 458/926] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:40:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:40:23.661377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad269f-33ba-44ba-a380-768d15225e77 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:23.709071 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca63ac-c79b-4c0a-b661-a2da98e07ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:23.709965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca63ac-c79b-4c0a-b661-a2da98e07ddb None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:23.710309 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca63ac-c79b-4c0a-b661-a2da98e07ddb None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:23.710681 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca63ac-c79b-4c0a-b661-a2da98e07ddb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:23.720011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca63ac-c79b-4c0a-b661-a2da98e07ddb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:23.721960 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca63ac-c79b-4c0a-b661-a2da98e07ddb None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:23.725687 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:23.737814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-93ca63ac-c79b-4c0a-b661-a2da98e07ddb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:40:23.737814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:23.737814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:23.737814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:23.737814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:23.737814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:23.737814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:23.737814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:23.737814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:23.737814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:23.737814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:23.737814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:23.737814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:40:23.737814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:40:23.737814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:40:23.737814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:23.739573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:23.741326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:23.741326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:23.741326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:40:23.741326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:40:23.741326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:40:23.741326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:40:23.741326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:40:23.741326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:40:23.741326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:40:23.741326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:23.744977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 469/927] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 23:40:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:23.746105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca63ac-c79b-4c0a-b661-a2da98e07ddb None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:23.804762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad269f-33ba-44ba-a380-768d15225e77 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:23.851028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8db6d5-68bc-482e-aebb-6d229c359d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:23.852336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8db6d5-68bc-482e-aebb-6d229c359d99 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:23.852881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8db6d5-68bc-482e-aebb-6d229c359d99 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:23.853522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8db6d5-68bc-482e-aebb-6d229c359d99 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:23.854427 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8db6d5-68bc-482e-aebb-6d229c359d99 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:23.856170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8db6d5-68bc-482e-aebb-6d229c359d99 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:23.867736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-6b8db6d5-68bc-482e-aebb-6d229c359d99 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:40:23.867736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:23.867736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:23.867736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:23.867736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:23.867736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:23.867736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:23.867736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:23.867736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:40:23.867736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:23.867736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:23.867736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:23.867736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:23.867736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:23.867736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:23.867736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:23.867736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:23.868797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:23.868797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:23.868797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:23.868797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:23.868797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:23.868797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:23.868797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:23.868797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:23.868797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:23.868797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:23.868797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:23.868797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:23.868797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:23.868797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:23.868797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:23.868797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:23.869686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:23.869686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:23.869686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:23.869686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:23.869686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:23.869686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:23.869686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:23.869686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:23.869686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:23.869686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:23.869686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:23.869686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:23.869686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:40:23.869686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:23.872480 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 459/928] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 23:40:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:23.879425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca63ac-c79b-4c0a-b661-a2da98e07ddb None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:23.881286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8db6d5-68bc-482e-aebb-6d229c359d99 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:23.925992 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c462064-ec59-4276-bd4d-de1dd6a2ceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:23.926828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c462064-ec59-4276-bd4d-de1dd6a2ceb6 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:23.927132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c462064-ec59-4276-bd4d-de1dd6a2ceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:23.927455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c462064-ec59-4276-bd4d-de1dd6a2ceb6 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:23.928453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c462064-ec59-4276-bd4d-de1dd6a2ceb6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:23.928678 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c462064-ec59-4276-bd4d-de1dd6a2ceb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:23.930753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c462064-ec59-4276-bd4d-de1dd6a2ceb6 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:23.957484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 470/929] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 12 23:40:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:23.958697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:23.961715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c462064-ec59-4276-bd4d-de1dd6a2ceb6 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:24.016934 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8db6d5-68bc-482e-aebb-6d229c359d99 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:24.047360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:24.069486 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6712d1-4ad3-4df9-b4e0-89887a5137b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:24.070300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6712d1-4ad3-4df9-b4e0-89887a5137b3 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:24.070486 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6712d1-4ad3-4df9-b4e0-89887a5137b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:24.072352 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6712d1-4ad3-4df9-b4e0-89887a5137b3 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:24.072352 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6712d1-4ad3-4df9-b4e0-89887a5137b3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:24.072352 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6712d1-4ad3-4df9-b4e0-89887a5137b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:24.074008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6712d1-4ad3-4df9-b4e0-89887a5137b3 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:24.080826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 460/930] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 23:40:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:24.087270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6712d1-4ad3-4df9-b4e0-89887a5137b3 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:24.126774 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c462064-ec59-4276-bd4d-de1dd6a2ceb6 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:24.196808 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639e08b-f8bd-433e-83c3-6392c1fed6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:24.198722 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639e08b-f8bd-433e-83c3-6392c1fed6ba None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:24.199538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639e08b-f8bd-433e-83c3-6392c1fed6ba None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:24.200189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639e08b-f8bd-433e-83c3-6392c1fed6ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:24.205104 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6712d1-4ad3-4df9-b4e0-89887a5137b3 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:24.221730 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639e08b-f8bd-433e-83c3-6392c1fed6ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:24.224686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:24.225506 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639e08b-f8bd-433e-83c3-6392c1fed6ba None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:24.246886 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004870f1-0545-455a-8123-f414d588ff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:24.247830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004870f1-0545-455a-8123-f414d588ff40 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:24.248125 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004870f1-0545-455a-8123-f414d588ff40 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:24.248522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004870f1-0545-455a-8123-f414d588ff40 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:24.249295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004870f1-0545-455a-8123-f414d588ff40 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:24.249806 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004870f1-0545-455a-8123-f414d588ff40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:24.251326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004870f1-0545-455a-8123-f414d588ff40 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:24.259127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-8639e08b-f8bd-433e-83c3-6392c1fed6ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:24.259127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:24.259127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:24.259127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:24.259127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:24.259127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:24.259127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:24.259127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:24.259127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:24.259127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:24.259127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:24.259127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:24.259127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:24.259127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:24.259127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:24.259127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:24.261104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:24.261104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:24.261104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:24.261104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:24.261104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:24.261104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:24.261104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:24.261104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:24.261104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:24.261104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:24.261104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:24.261104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:24.261104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:24.261104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:24.261104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:24.261104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:24.261104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:24.262900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:24.262900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:24.262900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:24.263226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 461/931] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 23:40:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:24.264690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004870f1-0545-455a-8123-f414d588ff40 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:24.267203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 471/932] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:24.272977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639e08b-f8bd-433e-83c3-6392c1fed6ba None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:24.396913 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004870f1-0545-455a-8123-f414d588ff40 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:24.455227 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ca4f5-9e54-44dd-b10f-5c4285a1c043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:24.455867 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ca4f5-9e54-44dd-b10f-5c4285a1c043 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:24.456149 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ca4f5-9e54-44dd-b10f-5c4285a1c043 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:24.456477 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ca4f5-9e54-44dd-b10f-5c4285a1c043 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:24.456711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639e08b-f8bd-433e-83c3-6392c1fed6ba None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:24.457219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ca4f5-9e54-44dd-b10f-5c4285a1c043 None admin] RBAC: Adding query filter params (interface=public, service_id=c8a5f2887a604e72818289114239e86e, region_id=RegionOne) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:24.457560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ca4f5-9e54-44dd-b10f-5c4285a1c043 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:24.459076 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ca4f5-9e54-44dd-b10f-5c4285a1c043 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:24.467631 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 462/933] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 12 23:40:24 2022] GET /identity/v3/endpoints?service_id=c8a5f2887a604e72818289114239e86e&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:24.475352 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ca4f5-9e54-44dd-b10f-5c4285a1c043 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:24.475906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:24.503851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a37b85-f7ad-4a43-b0ee-a227933e5ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:24.504946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a37b85-f7ad-4a43-b0ee-a227933e5ccd None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:24.505520 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a37b85-f7ad-4a43-b0ee-a227933e5ccd None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:24.505929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a37b85-f7ad-4a43-b0ee-a227933e5ccd None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:24.506733 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a37b85-f7ad-4a43-b0ee-a227933e5ccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:24.507181 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a37b85-f7ad-4a43-b0ee-a227933e5ccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:24.508903 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a37b85-f7ad-4a43-b0ee-a227933e5ccd None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:24.524852 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 472/934] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:24.531290 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a37b85-f7ad-4a43-b0ee-a227933e5ccd None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:24.534231 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:24.602209 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ca4f5-9e54-44dd-b10f-5c4285a1c043 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:24.639741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16906c9-17e4-456f-afef-a855e656a8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:24.640844 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16906c9-17e4-456f-afef-a855e656a8a9 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:24.641381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16906c9-17e4-456f-afef-a855e656a8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:24.641868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16906c9-17e4-456f-afef-a855e656a8a9 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:24.642878 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16906c9-17e4-456f-afef-a855e656a8a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:24.644562 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16906c9-17e4-456f-afef-a855e656a8a9 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:24.656566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a37b85-f7ad-4a43-b0ee-a227933e5ccd None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:24.657368 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 463/935] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 23:40:24 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:40:24.698751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983a838-e572-40c6-a044-1069d49010d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:24.699432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983a838-e572-40c6-a044-1069d49010d7 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:24.699709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983a838-e572-40c6-a044-1069d49010d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:24.699978 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983a838-e572-40c6-a044-1069d49010d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:24.708609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983a838-e572-40c6-a044-1069d49010d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:24.710174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983a838-e572-40c6-a044-1069d49010d7 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:24.723811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-5983a838-e572-40c6-a044-1069d49010d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:24.723811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:24.723811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:24.723811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:24.723811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:24.723811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:24.723811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:24.723811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:24.723811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:24.723811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:24.723811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:24.723811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:24.723811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:40:24.723811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:40:24.723811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:40:24.724807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:40:24.724807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:24.724807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:24.724807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:24.724807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:24.724807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:24.724807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:24.724807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:24.724807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:24.724807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:24.724807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:24.724807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:24.724807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:24.724807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:24.724807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:24.724807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:24.724807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:24.725741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:40:24.725741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:40:24.725741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:40:24.725741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:40:24.725741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:40:24.725741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:40:24.725741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:24.725741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:24.725741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 473/936] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:40:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:24.733287 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16906c9-17e4-456f-afef-a855e656a8a9 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:24.866646 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16906c9-17e4-456f-afef-a855e656a8a9 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:24.879125 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:24.881838 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b061d38-49ae-4a8b-9e82-aa986dfbc460 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:24.882126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b061d38-49ae-4a8b-9e82-aa986dfbc460 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:24.882424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b061d38-49ae-4a8b-9e82-aa986dfbc460 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:24.884534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 474/937] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:24.894932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d746b-0814-4aa8-91db-463cfd40fdbc None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:24.895222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d746b-0814-4aa8-91db-463cfd40fdbc None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:24.895352 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d746b-0814-4aa8-91db-463cfd40fdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:24.912160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d77bf-f7ae-40b9-8515-a080b3b511a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:24.912982 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d77bf-f7ae-40b9-8515-a080b3b511a2 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:24.913221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d77bf-f7ae-40b9-8515-a080b3b511a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:24.913522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d77bf-f7ae-40b9-8515-a080b3b511a2 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:24.914247 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d77bf-f7ae-40b9-8515-a080b3b511a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:24.914635 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d77bf-f7ae-40b9-8515-a080b3b511a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:24.916441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d77bf-f7ae-40b9-8515-a080b3b511a2 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:24.935057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 464/938] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:40:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:24.936861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-455d746b-0814-4aa8-91db-463cfd40fdbc None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:24.939174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-455d746b-0814-4aa8-91db-463cfd40fdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:24.942068 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d77bf-f7ae-40b9-8515-a080b3b511a2 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:24.991646 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:25.069473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d77bf-f7ae-40b9-8515-a080b3b511a2 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:25.101517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 475/939] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:25.119928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1718832-6771-457d-b523-8b9baee6e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:25.120586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1718832-6771-457d-b523-8b9baee6e25f None admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:25.125365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1718832-6771-457d-b523-8b9baee6e25f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:25.125365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1718832-6771-457d-b523-8b9baee6e25f None admin] PATH_INFO: `/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/e1f49820de264982aeec97fa0be3c290/roles/3c77102a55e849eb882b984ac3e3dfb4` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:25.125365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1718832-6771-457d-b523-8b9baee6e25f None admin] RBAC: Authorizing `identity:create_grant(project_id=21118e9e4fa94603b2c0880dd0d5f5ba, user_id=e1f49820de264982aeec97fa0be3c290, role_id=3c77102a55e849eb882b984ac3e3dfb4)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:25.125365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1718832-6771-457d-b523-8b9baee6e25f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:25.151784 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 465/940] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:40:24 2022] PUT /identity/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/e1f49820de264982aeec97fa0be3c290/roles/3c77102a55e849eb882b984ac3e3dfb4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:40:25.610395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d746b-0814-4aa8-91db-463cfd40fdbc None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:25.792344 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d746b-0814-4aa8-91db-463cfd40fdbc None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:25.852825 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd3776-19a3-4b23-a465-4895c5e92a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:25.853922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd3776-19a3-4b23-a465-4895c5e92a52 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:25.854419 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd3776-19a3-4b23-a465-4895c5e92a52 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:25.854900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd3776-19a3-4b23-a465-4895c5e92a52 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:25.856101 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd3776-19a3-4b23-a465-4895c5e92a52 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:25.858802 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd3776-19a3-4b23-a465-4895c5e92a52 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:25.876549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-03fd3776-19a3-4b23-a465-4895c5e92a52 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:40:25.876549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:25.876549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:25.876549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:25.876549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:25.876549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:25.876549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:25.876549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:25.876549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:40:25.876549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:25.876549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:25.876549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:25.876549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:25.876549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:25.876549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:25.876549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:25.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:25.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:25.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:25.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:25.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:25.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:25.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:25.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:25.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:25.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:25.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:25.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:25.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:25.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:25.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:25.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:25.877609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:25.878509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:25.878509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:25.878509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:25.878509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:25.878509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:25.878509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:25.878509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:25.878509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:25.878509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:25.878509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:25.878509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:25.878509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:25.878509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 12 23:40:25.878509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:25.880444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 476/941] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Sep 12 23:40:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:25.888860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1718832-6771-457d-b523-8b9baee6e25f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:25.949934 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:26.077878 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1718832-6771-457d-b523-8b9baee6e25f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:26.143690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e1e10-4545-4831-bdce-d836a2e6bc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:26.144845 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e1e10-4545-4831-bdce-d836a2e6bc0a None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:26.145293 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e1e10-4545-4831-bdce-d836a2e6bc0a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:26.145807 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e1e10-4545-4831-bdce-d836a2e6bc0a None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:26.146883 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e1e10-4545-4831-bdce-d836a2e6bc0a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:26.147407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e1e10-4545-4831-bdce-d836a2e6bc0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:26.149944 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e1e10-4545-4831-bdce-d836a2e6bc0a None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:26.159556 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 466/942] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 23:40:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:26.168840 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd3776-19a3-4b23-a465-4895c5e92a52 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:26.215660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:26.356556 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd3776-19a3-4b23-a465-4895c5e92a52 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:26.418182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec14558-e81d-48c4-8786-dc68df536227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:26.419235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec14558-e81d-48c4-8786-dc68df536227 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:26.419726 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec14558-e81d-48c4-8786-dc68df536227 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:26.420207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec14558-e81d-48c4-8786-dc68df536227 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:26.421487 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec14558-e81d-48c4-8786-dc68df536227 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:26.422047 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec14558-e81d-48c4-8786-dc68df536227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:26.424733 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec14558-e81d-48c4-8786-dc68df536227 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:26.437242 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 477/943] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 23:40:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:26.445881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e1e10-4545-4831-bdce-d836a2e6bc0a None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:26.629851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:26.645897 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e1e10-4545-4831-bdce-d836a2e6bc0a None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:26.710514 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe876c1-6911-4042-95bf-d6c46a5983ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:26.711536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe876c1-6911-4042-95bf-d6c46a5983ea None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:26.711995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe876c1-6911-4042-95bf-d6c46a5983ea None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:26.712478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe876c1-6911-4042-95bf-d6c46a5983ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:26.713733 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe876c1-6911-4042-95bf-d6c46a5983ea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:26.716425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe876c1-6911-4042-95bf-d6c46a5983ea None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:26.736504 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb47722-4894-4e98-8d71-c7289a92d72d None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:26.737335 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb47722-4894-4e98-8d71-c7289a92d72d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:26.737720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb47722-4894-4e98-8d71-c7289a92d72d None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:26.740140 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 478/944] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:26.749737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f037bb-3cdd-45ee-a778-16fe637c2e35 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:26.750543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f037bb-3cdd-45ee-a778-16fe637c2e35 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:26.751019 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f037bb-3cdd-45ee-a778-16fe637c2e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:26.762220 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 467/945] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:40:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:40:26.783353 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-60f037bb-3cdd-45ee-a778-16fe637c2e35 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:26.785502 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-60f037bb-3cdd-45ee-a778-16fe637c2e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:26.937699 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 479/946] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:26.988312 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cfa5d-26a7-43ea-98f3-9ce59ea0071b None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:26.989245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cfa5d-26a7-43ea-98f3-9ce59ea0071b None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:26.990005 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cfa5d-26a7-43ea-98f3-9ce59ea0071b None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:26.993175 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 468/947] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:27.004415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3434a1-29c9-45c9-96b3-3a44158e3634 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:27.004415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3434a1-29c9-45c9-96b3-3a44158e3634 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:27.004415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3434a1-29c9-45c9-96b3-3a44158e3634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:27.034359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-da3434a1-29c9-45c9-96b3-3a44158e3634 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:27.036403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-da3434a1-29c9-45c9-96b3-3a44158e3634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:27.056371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:27.170767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 480/948] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:27.284950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cfa5d-26a7-43ea-98f3-9ce59ea0071b None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:27.436410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aece998-7f7b-4ae0-b694-21d73f2d12e8 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:27.436776 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aece998-7f7b-4ae0-b694-21d73f2d12e8 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:27.437014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aece998-7f7b-4ae0-b694-21d73f2d12e8 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:27.438735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 481/949] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:40:27.445141 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e9dc4-0fd8-43b2-8b3c-c27a6250b65f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:27.445843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e9dc4-0fd8-43b2-8b3c-c27a6250b65f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:27.446315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e9dc4-0fd8-43b2-8b3c-c27a6250b65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:27.468820 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-494e9dc4-0fd8-43b2-8b3c-c27a6250b65f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:27.468820 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-494e9dc4-0fd8-43b2-8b3c-c27a6250b65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:27.485074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cfa5d-26a7-43ea-98f3-9ce59ea0071b None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:27.540541 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c50c29-7dc9-4ce0-bce2-0cae41a89660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:27.541522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c50c29-7dc9-4ce0-bce2-0cae41a89660 None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:27.541967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c50c29-7dc9-4ce0-bce2-0cae41a89660 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:27.542436 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c50c29-7dc9-4ce0-bce2-0cae41a89660 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:27.543585 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c50c29-7dc9-4ce0-bce2-0cae41a89660 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:27.546482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c50c29-7dc9-4ce0-bce2-0cae41a89660 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:27.551155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: WARNING keystone.server.flask.common [None req-d3c50c29-7dc9-4ce0-bce2-0cae41a89660 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 12 23:40:27.556490 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 482/950] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:27.557607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e9dc4-0fd8-43b2-8b3c-c27a6250b65f None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:27.579832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.sql.core [None req-d3c50c29-7dc9-4ce0-bce2-0cae41a89660 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 12 23:40:27.579832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 12 23:40:27.579832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [parameters: {'id': '906cbe9090c841d1b6deb74f640a5fd5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 12 23:40:27.579832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87848) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 12 23:40:27.621908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-d3c50c29-7dc9-4ce0-bce2-0cae41a89660 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 906cbe9090c841d1b6deb74f640a5fd5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 906cbe9090c841d1b6deb74f640a5fd5. Sep 12 23:40:27.621908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:27.621908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 23:40:27.621908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 23:40:27.621908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 23:40:27.621908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 23:40:27.621908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 23:40:27.621908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 23:40:27.621908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 23:40:27.621908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application conn.query(q) Sep 12 23:40:27.621908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 23:40:27.621908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 23:40:27.621908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application result.read() Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 12 23:40:27.622793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 12 23:40:27.623748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 23:40:27.623748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application next(self.gen) Sep 12 23:40:27.623748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 12 23:40:27.623748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application yield resource Sep 12 23:40:27.623748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 23:40:27.623748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application next(self.gen) Sep 12 23:40:27.623748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 12 23:40:27.623748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self.session.rollback() Sep 12 23:40:27.623748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 12 23:40:27.623748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self.force_reraise() Sep 12 23:40:27.623748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 12 23:40:27.623748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise self.value Sep 12 23:40:27.623748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 12 23:40:27.623748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 12 23:40:27.623748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 12 23:40:27.623748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application session.commit() Sep 12 23:40:27.623748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 12 23:40:27.625117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 12 23:40:27.625117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 12 23:40:27.625117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._prepare_impl() Sep 12 23:40:27.625117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 12 23:40:27.625117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self.session.flush() Sep 12 23:40:27.625117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 12 23:40:27.625117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._flush(objects) Sep 12 23:40:27.625117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 12 23:40:27.625117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 12 23:40:27.625117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 12 23:40:27.625117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application compat.raise_( Sep 12 23:40:27.625117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 23:40:27.625117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception Sep 12 23:40:27.625117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 12 23:40:27.625117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application flush_context.execute() Sep 12 23:40:27.625117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 12 23:40:27.625117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rec.execute(self) Sep 12 23:40:27.626128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 12 23:40:27.626128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 12 23:40:27.626128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 12 23:40:27.626128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 12 23:40:27.626128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 12 23:40:27.626128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 12 23:40:27.626128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 12 23:40:27.626128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 12 23:40:27.626128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 12 23:40:27.626128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 12 23:40:27.626128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 12 23:40:27.626128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 12 23:40:27.626128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 12 23:40:27.626128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 12 23:40:27.626128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 12 23:40:27.626923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 12 23:40:27.626923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 23:40:27.626923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception Sep 12 23:40:27.626923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 23:40:27.626923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 23:40:27.626923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 23:40:27.626923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 23:40:27.626923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 23:40:27.626923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 23:40:27.626923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 23:40:27.626923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application conn.query(q) Sep 12 23:40:27.626923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 23:40:27.626923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 23:40:27.626923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 23:40:27.626923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application result.read() Sep 12 23:40:27.626923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 23:40:27.626923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 23:40:27.627793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 23:40:27.627793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 23:40:27.627793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 23:40:27.627793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 23:40:27.627793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 23:40:27.627793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 23:40:27.627793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 12 23:40:27.627793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 12 23:40:27.627793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [parameters: {'id': '906cbe9090c841d1b6deb74f640a5fd5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 12 23:40:27.627793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 12 23:40:27.627793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:27.627793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:27.627793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:27.627793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:27.627793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 12 23:40:27.628575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 12 23:40:27.628575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 12 23:40:27.628575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 12 23:40:27.628575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 12 23:40:27.628575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:27.628575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:27.628575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:27.628575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:27.628575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:27.628575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:27.628575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:27.628575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:27.628575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:27.628575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:27.628575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:27.628575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:27.628575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:27.630750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:27.630750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 12 23:40:27.630750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 12 23:40:27.630750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:27.630750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:27.630750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 12 23:40:27.630750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 12 23:40:27.630750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 906cbe9090c841d1b6deb74f640a5fd5. Sep 12 23:40:27.630750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:27.630750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 469/951] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Sep 12 23:40:27 2022] POST /identity/v3/projects => generated 262 bytes in 339 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:27.635310 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c50c29-7dc9-4ce0-bce2-0cae41a89660 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:27.646154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:27.672360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:27.710542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e9dc4-0fd8-43b2-8b3c-c27a6250b65f None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:27.761482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69b095-f7de-44ee-9ca0-a1e5b307725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:27.762423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69b095-f7de-44ee-9ca0-a1e5b307725c None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:27.762700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69b095-f7de-44ee-9ca0-a1e5b307725c None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:27.762972 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69b095-f7de-44ee-9ca0-a1e5b307725c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:27.763570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69b095-f7de-44ee-9ca0-a1e5b307725c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:27.765597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69b095-f7de-44ee-9ca0-a1e5b307725c None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:27.777327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-ef69b095-f7de-44ee-9ca0-a1e5b307725c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:40:27.777327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:27.777327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:27.777327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:27.777327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:27.777327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:27.777327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:27.777327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:27.777327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:40:27.777327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:27.777327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:27.777327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:27.777327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:27.777327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:27.777327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:27.777327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:27.777327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:27.778439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:27.778439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:27.778439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:27.778439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:27.778439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:27.778439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:27.778439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:27.778439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:27.778439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:27.778439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:27.778439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:27.778439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:27.778439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:27.778439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:27.778439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:27.778439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:27.779465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:27.779465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:27.779465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:27.779465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:27.779465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:27.779465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:27.779465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:27.779465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:27.779465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:27.779465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:27.779465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:27.779465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:27.779465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:40:27.779465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:27.779465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 483/952] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 23:40:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:27.788583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69b095-f7de-44ee-9ca0-a1e5b307725c None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:27.852470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c50c29-7dc9-4ce0-bce2-0cae41a89660 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:27.905588 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd582d89-954f-4d4a-9ebf-de8b20320378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:27.906324 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd582d89-954f-4d4a-9ebf-de8b20320378 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:27.907016 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd582d89-954f-4d4a-9ebf-de8b20320378 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:27.907288 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd582d89-954f-4d4a-9ebf-de8b20320378 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:27.919078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd582d89-954f-4d4a-9ebf-de8b20320378 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:27.921052 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd582d89-954f-4d4a-9ebf-de8b20320378 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:27.940195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-cd582d89-954f-4d4a-9ebf-de8b20320378 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:27.940195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:27.940195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:27.940195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:27.940195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:27.940195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:27.940195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:27.940195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:27.940195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:27.940195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:27.940195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:27.940195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:27.940195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:40:27.940195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:40:27.940195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:40:27.941272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:40:27.941272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:27.941272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:27.941272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:27.941272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:27.941272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:27.941272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:27.941272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:27.941272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:27.941272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:27.941272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:27.941272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:27.941272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:27.941272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:27.941272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:27.941272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:27.941272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:27.943249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:40:27.943249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:40:27.943249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:40:27.943249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:40:27.943249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:40:27.943249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:40:27.943249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:27.943249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:27.943249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 470/953] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:40:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:27.948887 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd582d89-954f-4d4a-9ebf-de8b20320378 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:27.978464 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69b095-f7de-44ee-9ca0-a1e5b307725c None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:28.028677 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2899c-d08e-4200-af6a-ca0933289307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:28.029998 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2899c-d08e-4200-af6a-ca0933289307 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:28.030960 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2899c-d08e-4200-af6a-ca0933289307 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:28.032050 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2899c-d08e-4200-af6a-ca0933289307 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:28.033631 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2899c-d08e-4200-af6a-ca0933289307 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:28.034263 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2899c-d08e-4200-af6a-ca0933289307 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:28.037370 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2899c-d08e-4200-af6a-ca0933289307 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:28.038499 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:28.052729 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 484/954] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 23:40:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:28.052729 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2899c-d08e-4200-af6a-ca0933289307 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:28.057009 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:28.096084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd582d89-954f-4d4a-9ebf-de8b20320378 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:28.146611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96bcc2-cd55-48fd-8473-b992d861ede0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:28.147589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96bcc2-cd55-48fd-8473-b992d861ede0 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:28.148079 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96bcc2-cd55-48fd-8473-b992d861ede0 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:28.148549 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96bcc2-cd55-48fd-8473-b992d861ede0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:28.165821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96bcc2-cd55-48fd-8473-b992d861ede0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:40:28.170611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-ab96bcc2-cd55-48fd-8473-b992d861ede0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:40:28.170611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:28.170611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:28.170611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:28.170611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:28.170611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:28.170611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:28.170611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:28.170611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:28.170611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:28.170611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:28.170611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:28.170611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:40:28.170611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:40:28.170611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:40:28.170611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:40:28.171918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:40:28.171918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:40:28.171918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:40:28.171918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:40:28.171918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:28.171918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:28.171918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:28.171918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:28.171918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:28.171918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:28.171918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:28.171918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:28.171918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:28.171918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:28.171918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:28.171918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:28.173582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:28.173582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:28.173582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:28.173582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:28.173582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:40:28.173582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:40:28.173582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:40:28.173582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:40:28.173582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:40:28.173582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:40:28.173582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:40:28.173582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:28.173582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 471/955] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 12 23:40:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:28.173582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96bcc2-cd55-48fd-8473-b992d861ede0 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:28.183253 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2899c-d08e-4200-af6a-ca0933289307 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:28.222014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ecb5a-b5cd-40b6-a98b-4b863477e523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:28.222784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ecb5a-b5cd-40b6-a98b-4b863477e523 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:28.223587 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ecb5a-b5cd-40b6-a98b-4b863477e523 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:28.223587 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ecb5a-b5cd-40b6-a98b-4b863477e523 None admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:28.224037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ecb5a-b5cd-40b6-a98b-4b863477e523 None admin] RBAC: Adding query filter params (name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:28.224351 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ecb5a-b5cd-40b6-a98b-4b863477e523 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:28.225929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ecb5a-b5cd-40b6-a98b-4b863477e523 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:28.248337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 485/956] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 23:40:28 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:28.249049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ecb5a-b5cd-40b6-a98b-4b863477e523 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:28.350756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96bcc2-cd55-48fd-8473-b992d861ede0 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:28.366904 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:28.389288 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:28.415645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395661e-a9bc-4704-b2ba-25ce0b684377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:28.416303 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395661e-a9bc-4704-b2ba-25ce0b684377 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:28.416590 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395661e-a9bc-4704-b2ba-25ce0b684377 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:28.416865 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395661e-a9bc-4704-b2ba-25ce0b684377 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:28.417769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395661e-a9bc-4704-b2ba-25ce0b684377 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:28.417931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395661e-a9bc-4704-b2ba-25ce0b684377 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:28.419471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395661e-a9bc-4704-b2ba-25ce0b684377 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:28.428974 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 472/957] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 23:40:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:28.438774 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395661e-a9bc-4704-b2ba-25ce0b684377 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:28.444446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ecb5a-b5cd-40b6-a98b-4b863477e523 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:28.498483 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85c4e8-0ed0-48f1-9dee-363430c6428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:28.499489 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85c4e8-0ed0-48f1-9dee-363430c6428c None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:28.499914 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85c4e8-0ed0-48f1-9dee-363430c6428c None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:28.500327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85c4e8-0ed0-48f1-9dee-363430c6428c None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:28.501290 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85c4e8-0ed0-48f1-9dee-363430c6428c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:28.501793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85c4e8-0ed0-48f1-9dee-363430c6428c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:28.503644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85c4e8-0ed0-48f1-9dee-363430c6428c None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:28.517501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 486/958] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 12 23:40:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:28.521089 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85c4e8-0ed0-48f1-9dee-363430c6428c None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:28.613745 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395661e-a9bc-4704-b2ba-25ce0b684377 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:28.656887 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744dc42-7dfc-4b5c-9967-b885512cde34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:28.658316 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744dc42-7dfc-4b5c-9967-b885512cde34 None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:28.659187 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744dc42-7dfc-4b5c-9967-b885512cde34 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:28.659672 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744dc42-7dfc-4b5c-9967-b885512cde34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:28.660853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744dc42-7dfc-4b5c-9967-b885512cde34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:28.663452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744dc42-7dfc-4b5c-9967-b885512cde34 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:28.675212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85c4e8-0ed0-48f1-9dee-363430c6428c None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:28.694777 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 473/959] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:40:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:40:28.719694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:28.748142 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab33a7-e98b-4fe1-9b95-7e21e1a3a599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:28.748886 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab33a7-e98b-4fe1-9b95-7e21e1a3a599 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:28.749257 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab33a7-e98b-4fe1-9b95-7e21e1a3a599 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:28.749721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab33a7-e98b-4fe1-9b95-7e21e1a3a599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:28.767032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab33a7-e98b-4fe1-9b95-7e21e1a3a599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:28.769115 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab33a7-e98b-4fe1-9b95-7e21e1a3a599 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:28.791828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-1aab33a7-e98b-4fe1-9b95-7e21e1a3a599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:28.791828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:28.791828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:28.791828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:28.791828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:28.791828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:28.791828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:28.791828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:28.791828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:28.791828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:28.791828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:28.791828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:28.791828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:28.791828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:28.791828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:28.791828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:28.792848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:28.792848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:28.792848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:28.792848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:28.792848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:28.792848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:28.792848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:28.792848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:28.792848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:28.792848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:28.792848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:28.792848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:28.792848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:28.792848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:28.792848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:28.792848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:28.792848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:28.793767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:28.793767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:28.793767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:28.795235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 487/960] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:28.803035 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744dc42-7dfc-4b5c-9967-b885512cde34 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:28.885898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:28.964387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744dc42-7dfc-4b5c-9967-b885512cde34 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:29.003692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f7069-db31-42e3-9162-685f273e887f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:29.004333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f7069-db31-42e3-9162-685f273e887f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:29.004606 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f7069-db31-42e3-9162-685f273e887f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:29.004886 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f7069-db31-42e3-9162-685f273e887f None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:29.005579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f7069-db31-42e3-9162-685f273e887f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:29.005891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f7069-db31-42e3-9162-685f273e887f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:29.007319 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f7069-db31-42e3-9162-685f273e887f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:29.021426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 474/961] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:29.030735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab33a7-e98b-4fe1-9b95-7e21e1a3a599 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:29.227229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab33a7-e98b-4fe1-9b95-7e21e1a3a599 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:29.290909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcf5d1-1feb-4e03-bbb0-24120b9a2b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:29.292474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcf5d1-1feb-4e03-bbb0-24120b9a2b52 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:29.293196 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcf5d1-1feb-4e03-bbb0-24120b9a2b52 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:29.293937 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcf5d1-1feb-4e03-bbb0-24120b9a2b52 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:29.309840 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcf5d1-1feb-4e03-bbb0-24120b9a2b52 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:29.313309 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcf5d1-1feb-4e03-bbb0-24120b9a2b52 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:29.334492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-bbbcf5d1-1feb-4e03-bbb0-24120b9a2b52 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:40:29.334492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:29.334492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:29.334492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:29.334492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:29.334492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:29.334492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:29.334492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:29.334492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:29.334492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:29.334492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:29.334492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:29.334492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:40:29.334492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:40:29.334492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:40:29.334492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:29.336177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:29.337969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:29.337969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:29.337969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:40:29.337969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:40:29.337969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:40:29.337969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:40:29.337969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:40:29.337969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:40:29.337969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 12 23:40:29.337969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:29.349500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 488/962] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 23:40:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:29.352125 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f7069-db31-42e3-9162-685f273e887f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:29.534668 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f7069-db31-42e3-9162-685f273e887f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:29.539120 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:29.598695 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206907e-4034-45aa-a565-3956ea040d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:29.599764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206907e-4034-45aa-a565-3956ea040d03 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:29.600264 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206907e-4034-45aa-a565-3956ea040d03 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:29.600736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206907e-4034-45aa-a565-3956ea040d03 None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:29.602236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206907e-4034-45aa-a565-3956ea040d03 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:29.602704 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206907e-4034-45aa-a565-3956ea040d03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:29.605612 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206907e-4034-45aa-a565-3956ea040d03 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:29.649371 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 475/963] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 12 23:40:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:29.651775 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcf5d1-1feb-4e03-bbb0-24120b9a2b52 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:29.710029 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:29.722084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ed0a5-a9e0-44a2-a22c-b11b84184074 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:29.722415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ed0a5-a9e0-44a2-a22c-b11b84184074 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:29.722788 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ed0a5-a9e0-44a2-a22c-b11b84184074 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:29.725742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 476/964] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:29.735627 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6784433-c693-402c-a148-b4bd0107b5aa None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:29.736118 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6784433-c693-402c-a148-b4bd0107b5aa None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:29.736587 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6784433-c693-402c-a148-b4bd0107b5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:29.775623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-c6784433-c693-402c-a148-b4bd0107b5aa None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:29.777731 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c6784433-c693-402c-a148-b4bd0107b5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:29.846129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcf5d1-1feb-4e03-bbb0-24120b9a2b52 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:29.873431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 477/965] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:29.916984 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc41d1a-de1b-4af8-a7dc-0d8eca70c9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:29.918415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc41d1a-de1b-4af8-a7dc-0d8eca70c9d5 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:29.919065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc41d1a-de1b-4af8-a7dc-0d8eca70c9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:29.919720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc41d1a-de1b-4af8-a7dc-0d8eca70c9d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:30.036046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc41d1a-de1b-4af8-a7dc-0d8eca70c9d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:30.037577 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc41d1a-de1b-4af8-a7dc-0d8eca70c9d5 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:30.073086 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:30.168499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 489/966] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:40:29 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:40:30.177754 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6784433-c693-402c-a148-b4bd0107b5aa None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:30.289785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc41d1a-de1b-4af8-a7dc-0d8eca70c9d5 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:30.354752 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:30.375357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6784433-c693-402c-a148-b4bd0107b5aa None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:30.445713 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b50afa-1394-47b9-b479-076485b37781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:30.447415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b50afa-1394-47b9-b479-076485b37781 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:30.448161 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b50afa-1394-47b9-b479-076485b37781 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:30.448944 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b50afa-1394-47b9-b479-076485b37781 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:30.471294 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b50afa-1394-47b9-b479-076485b37781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:30.474749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b50afa-1394-47b9-b479-076485b37781 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:30.496695 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc41d1a-de1b-4af8-a7dc-0d8eca70c9d5 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:30.508640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-d4b50afa-1394-47b9-b479-076485b37781 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:30.508640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:30.508640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:30.508640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:30.508640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:30.508640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:30.508640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:30.508640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:30.508640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:30.508640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:30.508640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:30.508640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:30.508640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:30.508640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:30.508640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:30.508640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:30.510664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:30.510664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:30.510664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:30.510664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:30.510664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:30.510664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:30.510664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:30.510664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:30.510664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:30.510664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:30.510664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:30.510664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:30.510664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:30.510664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:30.510664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:30.510664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:30.510664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:30.512357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:30.512357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:30.512357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:30.521671 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 478/967] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:30.526900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b50afa-1394-47b9-b479-076485b37781 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:30.558622 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:30.568248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b91cc7-1e4b-44e0-b000-a559dff2a2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:30.569511 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b91cc7-1e4b-44e0-b000-a559dff2a2df None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:30.570001 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b91cc7-1e4b-44e0-b000-a559dff2a2df None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:30.570479 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b91cc7-1e4b-44e0-b000-a559dff2a2df None admin] PATH_INFO: `/v3/services/compute` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:30.572144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b91cc7-1e4b-44e0-b000-a559dff2a2df None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:30.574446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b91cc7-1e4b-44e0-b000-a559dff2a2df None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:30.593334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-16b91cc7-1e4b-44e0-b000-a559dff2a2df None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:40:30.593334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:30.593334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:30.593334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:30.593334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:30.593334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:30.593334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:30.593334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:30.593334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:40:30.593334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:30.593334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:30.593334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:30.593334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:30.593334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:30.593334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:30.593334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:30.593334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:30.595267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:30.595267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:30.595267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:30.595267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:30.595267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:30.595267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:30.595267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:30.595267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:30.595267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:30.595267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:30.595267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:30.595267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:30.595267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:30.595267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:30.595267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:30.595267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:30.596851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:30.596851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:30.596851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:30.596851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:30.596851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:30.596851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:30.596851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:30.596851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:30.596851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:30.596851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:30.596851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:30.596851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:30.596851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:40:30.596851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:30.601914 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 490/968] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:40:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:30.606224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b91cc7-1e4b-44e0-b000-a559dff2a2df None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:30.752587 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b50afa-1394-47b9-b479-076485b37781 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:30.814005 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052268a-a9d0-434b-8498-c253c83cbc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:30.815376 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b91cc7-1e4b-44e0-b000-a559dff2a2df None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:30.815778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052268a-a9d0-434b-8498-c253c83cbc7c None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:30.816510 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052268a-a9d0-434b-8498-c253c83cbc7c None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:30.817390 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052268a-a9d0-434b-8498-c253c83cbc7c None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:30.819076 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052268a-a9d0-434b-8498-c253c83cbc7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:30.819960 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052268a-a9d0-434b-8498-c253c83cbc7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:30.822845 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052268a-a9d0-434b-8498-c253c83cbc7c None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:30.853639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 479/969] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:30.857880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052268a-a9d0-434b-8498-c253c83cbc7c None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:30.865150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:30.879668 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4eeff-59da-4042-9976-e68dd33844df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:30.881480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4eeff-59da-4042-9976-e68dd33844df None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:30.882128 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4eeff-59da-4042-9976-e68dd33844df None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:30.882747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4eeff-59da-4042-9976-e68dd33844df None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:30.884046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4eeff-59da-4042-9976-e68dd33844df None admin] RBAC: Adding query filter params (name=compute) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:30.884783 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4eeff-59da-4042-9976-e68dd33844df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:30.887287 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4eeff-59da-4042-9976-e68dd33844df None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:30.901282 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 491/970] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 23:40:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:30.906303 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4eeff-59da-4042-9976-e68dd33844df None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:31.027961 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:31.085510 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4eeff-59da-4042-9976-e68dd33844df None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:31.089204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052268a-a9d0-434b-8498-c253c83cbc7c None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:31.140777 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b2aad-8edc-4793-b89b-b60d29633f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:31.141778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b2aad-8edc-4793-b89b-b60d29633f36 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:31.142228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b2aad-8edc-4793-b89b-b60d29633f36 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:31.142676 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b2aad-8edc-4793-b89b-b60d29633f36 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:31.143733 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b2aad-8edc-4793-b89b-b60d29633f36 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:31.144224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b2aad-8edc-4793-b89b-b60d29633f36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:31.144765 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510af616-f44c-4ce4-bf5f-1c7885ddeb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:31.145932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510af616-f44c-4ce4-bf5f-1c7885ddeb0c None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:31.146374 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510af616-f44c-4ce4-bf5f-1c7885ddeb0c None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:31.146580 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b2aad-8edc-4793-b89b-b60d29633f36 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:31.146807 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510af616-f44c-4ce4-bf5f-1c7885ddeb0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:31.154206 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 492/971] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 23:40:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:31.156132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737767cd-e067-49b8-8631-ebfaa67965d6 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:31.156552 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737767cd-e067-49b8-8631-ebfaa67965d6 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:31.156986 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737767cd-e067-49b8-8631-ebfaa67965d6 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:31.157945 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510af616-f44c-4ce4-bf5f-1c7885ddeb0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:31.161415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 493/972] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:31.161697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510af616-f44c-4ce4-bf5f-1c7885ddeb0c None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:31.161840 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71785a7a-8a9b-4415-bf9d-6b72e1a74c56 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:31.161840 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71785a7a-8a9b-4415-bf9d-6b72e1a74c56 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:31.161840 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71785a7a-8a9b-4415-bf9d-6b72e1a74c56 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:31.163991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 494/973] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:31.165501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db35f-d1a5-461a-bace-4f1f46d5fb19 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:31.165922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db35f-d1a5-461a-bace-4f1f46d5fb19 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:31.166316 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db35f-d1a5-461a-bace-4f1f46d5fb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:31.188105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-510af616-f44c-4ce4-bf5f-1c7885ddeb0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:31.188105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:31.188105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:31.188105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:31.188105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:31.188105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:31.188105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:31.188105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:31.188105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:31.188105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:31.188105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:31.188105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:31.188105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:40:31.188105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:40:31.188105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:40:31.189135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:40:31.189135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:31.189135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:31.189135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:31.189135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:31.189135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:31.189135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:31.189135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:31.189135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:31.189135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:31.189135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:31.189135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:31.189135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:31.189135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:31.189135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:31.189135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:31.189135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:31.190353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:40:31.190353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:40:31.190353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:40:31.190353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:40:31.190353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:40:31.190353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:40:31.190353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:31.190353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:31.191164 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 480/974] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:40:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:31.192767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfee77-a39c-4322-a1c1-f80bef6289fb None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:31.193400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfee77-a39c-4322-a1c1-f80bef6289fb None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:31.193879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfee77-a39c-4322-a1c1-f80bef6289fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:31.195894 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-b33db35f-d1a5-461a-bace-4f1f46d5fb19 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:31.198054 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b33db35f-d1a5-461a-bace-4f1f46d5fb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:31.215987 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-76cfee77-a39c-4322-a1c1-f80bef6289fb None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:31.217267 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-76cfee77-a39c-4322-a1c1-f80bef6289fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:31.292958 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 495/975] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:31.293968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33db35f-d1a5-461a-bace-4f1f46d5fb19 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:31.308741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:31.327106 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 481/976] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:31.405051 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:31.503199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33db35f-d1a5-461a-bace-4f1f46d5fb19 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:31.570440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313a3df-86dc-4696-8e05-234e931c69c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:31.571475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313a3df-86dc-4696-8e05-234e931c69c0 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:31.571974 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313a3df-86dc-4696-8e05-234e931c69c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:31.572484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313a3df-86dc-4696-8e05-234e931c69c0 None admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:31.573806 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313a3df-86dc-4696-8e05-234e931c69c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:31.574361 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313a3df-86dc-4696-8e05-234e931c69c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:31.577401 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfee77-a39c-4322-a1c1-f80bef6289fb None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:31.580955 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313a3df-86dc-4696-8e05-234e931c69c0 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:31.596123 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 496/977] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:40:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:31.601312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313a3df-86dc-4696-8e05-234e931c69c0 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:31.727202 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfee77-a39c-4322-a1c1-f80bef6289fb None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:31.731716 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313a3df-86dc-4696-8e05-234e931c69c0 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:31.755127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:31.777333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc43df0-c5b3-4a99-9321-33857ab3150b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:31.778229 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc43df0-c5b3-4a99-9321-33857ab3150b None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:31.778703 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc43df0-c5b3-4a99-9321-33857ab3150b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:31.779062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc43df0-c5b3-4a99-9321-33857ab3150b None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:31.779319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d39b2-1b0a-4453-b069-c4829937383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:31.779969 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc43df0-c5b3-4a99-9321-33857ab3150b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:31.780140 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d39b2-1b0a-4453-b069-c4829937383e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:31.780285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d39b2-1b0a-4453-b069-c4829937383e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:31.780547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d39b2-1b0a-4453-b069-c4829937383e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:31.781176 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d39b2-1b0a-4453-b069-c4829937383e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:31.782099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc43df0-c5b3-4a99-9321-33857ab3150b None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:31.782578 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d39b2-1b0a-4453-b069-c4829937383e None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:31.792597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-756d39b2-1b0a-4453-b069-c4829937383e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:40:31.792597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:31.792597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:31.792597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:31.792597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:31.792597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:31.792597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:31.792597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:31.792597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:40:31.792597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:31.792597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:31.792597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:31.792597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:31.792597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:31.792597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:31.792597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:31.792597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:31.794615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:31.794615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:31.794615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:31.794615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:31.794615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:31.794615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:31.794615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:31.794615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:31.794615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:31.794615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:31.794615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:31.794615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:31.794615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:31.794615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:31.794615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:31.794615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:31.798154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:31.798154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:31.798154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:31.798154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:31.798154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:31.798154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:31.798154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:31.798154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:31.798154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:31.798154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:31.798154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:31.798154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:31.798154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:40:31.798154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:31.798154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 497/978] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 23:40:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:31.802528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d39b2-1b0a-4453-b069-c4829937383e None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:31.808003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.sql.core [None req-bbc43df0-c5b3-4a99-9321-33857ab3150b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 12 23:40:31.808003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 12 23:40:31.808003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [parameters: {'user_id': 'dea5ff36ed224cb68dfcc931f9e73683', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 12 23:40:31.808003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87848) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 12 23:40:31.818012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-bbc43df0-c5b3-4a99-9321-33857ab3150b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 12 23:40:31.818012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:31.818012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 23:40:31.818012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 23:40:31.818012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 23:40:31.818012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 23:40:31.818012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 23:40:31.818012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 23:40:31.818012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 23:40:31.818012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application conn.query(q) Sep 12 23:40:31.818012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 23:40:31.818012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 23:40:31.818012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 23:40:31.818012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application result.read() Sep 12 23:40:31.818012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 23:40:31.818992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application next(self.gen) Sep 12 23:40:31.819980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 12 23:40:31.819980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application yield resource Sep 12 23:40:31.819980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 12 23:40:31.819980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application next(self.gen) Sep 12 23:40:31.819980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 12 23:40:31.819980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self.session.rollback() Sep 12 23:40:31.819980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 12 23:40:31.819980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self.force_reraise() Sep 12 23:40:31.819980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 12 23:40:31.819980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise self.value Sep 12 23:40:31.819980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 12 23:40:31.819980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 12 23:40:31.819980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 12 23:40:31.819980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application session.commit() Sep 12 23:40:31.819980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 12 23:40:31.819980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 12 23:40:31.819980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 12 23:40:31.821415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._prepare_impl() Sep 12 23:40:31.821415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 12 23:40:31.821415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self.session.flush() Sep 12 23:40:31.821415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 12 23:40:31.821415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._flush(objects) Sep 12 23:40:31.821415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 12 23:40:31.821415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 12 23:40:31.821415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 12 23:40:31.821415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application compat.raise_( Sep 12 23:40:31.821415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 23:40:31.821415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception Sep 12 23:40:31.821415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 12 23:40:31.821415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application flush_context.execute() Sep 12 23:40:31.821415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 12 23:40:31.821415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rec.execute(self) Sep 12 23:40:31.821415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 12 23:40:31.821415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 12 23:40:31.823003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 12 23:40:31.823003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 12 23:40:31.823003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 12 23:40:31.823003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 12 23:40:31.823003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 12 23:40:31.823003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 12 23:40:31.823003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 12 23:40:31.823003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 12 23:40:31.823003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 12 23:40:31.823003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 12 23:40:31.823003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 12 23:40:31.823003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 12 23:40:31.823003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 12 23:40:31.823003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 12 23:40:31.823003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 12 23:40:31.823003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception Sep 12 23:40:31.824546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 12 23:40:31.824546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 12 23:40:31.824546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 12 23:40:31.824546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 12 23:40:31.824546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 12 23:40:31.824546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application result = self._query(query) Sep 12 23:40:31.824546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 12 23:40:31.824546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application conn.query(q) Sep 12 23:40:31.824546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 12 23:40:31.824546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 12 23:40:31.824546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 12 23:40:31.824546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application result.read() Sep 12 23:40:31.824546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 12 23:40:31.824546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 12 23:40:31.824546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 12 23:40:31.824546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 12 23:40:31.826041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 12 23:40:31.826041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 12 23:40:31.826041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 12 23:40:31.826041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 12 23:40:31.826041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 12 23:40:31.826041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 12 23:40:31.826041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [parameters: {'user_id': 'dea5ff36ed224cb68dfcc931f9e73683', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 12 23:40:31.826041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 12 23:40:31.826041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:31.826041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:31.826041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:31.826041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:31.826041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:31.826041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:31.826041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:31.828365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:31.828365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:31.828365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:31.828365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:31.828365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:31.828365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:31.828365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:31.828365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 12 23:40:31.828365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 12 23:40:31.828365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:31.828365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:31.828365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:40:31.828365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:31.828365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:40:31.828365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:31.828365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 12 23:40:31.828365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 12 23:40:31.829610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 12 23:40:31.829610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 12 23:40:31.829610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 12 23:40:31.829610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 12 23:40:31.829610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 12 23:40:31.829610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:31.829610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 482/979] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Sep 12 23:40:31 2022] POST /identity/v3/users => generated 160 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:31.829610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc43df0-c5b3-4a99-9321-33857ab3150b None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:31.899429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:31.941204 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d39b2-1b0a-4453-b069-c4829937383e None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:31.967522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc43df0-c5b3-4a99-9321-33857ab3150b None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:31.999112 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8251e56-e955-4d00-ab96-c945c696cbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:32.000055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8251e56-e955-4d00-ab96-c945c696cbc4 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:32.000470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8251e56-e955-4d00-ab96-c945c696cbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:32.000881 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8251e56-e955-4d00-ab96-c945c696cbc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:32.002799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8251e56-e955-4d00-ab96-c945c696cbc4 None admin] RBAC: Adding query filter params (role.id=3c77102a55e849eb882b984ac3e3dfb4, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=e1f49820de264982aeec97fa0be3c290) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:32.003258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8251e56-e955-4d00-ab96-c945c696cbc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:32.005867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8251e56-e955-4d00-ab96-c945c696cbc4 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:32.016310 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 498/980] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:40:31 2022] GET /identity/v3/role_assignments?user.id=e1f49820de264982aeec97fa0be3c290&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=3c77102a55e849eb882b984ac3e3dfb4 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:32.017538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8251e56-e955-4d00-ab96-c945c696cbc4 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:32.024803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e71d6d-3aee-4a7f-a77e-759ad2d4c462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:32.025814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e71d6d-3aee-4a7f-a77e-759ad2d4c462 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:32.026262 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e71d6d-3aee-4a7f-a77e-759ad2d4c462 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:32.026700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e71d6d-3aee-4a7f-a77e-759ad2d4c462 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:32.027809 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e71d6d-3aee-4a7f-a77e-759ad2d4c462 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:32.028296 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e71d6d-3aee-4a7f-a77e-759ad2d4c462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:32.031175 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e71d6d-3aee-4a7f-a77e-759ad2d4c462 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:32.049801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 483/981] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 23:40:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:32.054631 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e71d6d-3aee-4a7f-a77e-759ad2d4c462 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:32.106697 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:32.230549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8251e56-e955-4d00-ab96-c945c696cbc4 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:32.269201 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e71d6d-3aee-4a7f-a77e-759ad2d4c462 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:32.296482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce79b9-a59b-42af-9aa6-3ab312a1df7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:32.297917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce79b9-a59b-42af-9aa6-3ab312a1df7f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:32.298609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce79b9-a59b-42af-9aa6-3ab312a1df7f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:32.299247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce79b9-a59b-42af-9aa6-3ab312a1df7f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:32.311165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:32.317750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce79b9-a59b-42af-9aa6-3ab312a1df7f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:32.321685 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce79b9-a59b-42af-9aa6-3ab312a1df7f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:32.339826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd475b3-eacf-418a-99eb-a3cd84604d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:32.340791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd475b3-eacf-418a-99eb-a3cd84604d0b None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:32.341251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd475b3-eacf-418a-99eb-a3cd84604d0b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:32.341759 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd475b3-eacf-418a-99eb-a3cd84604d0b None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:32.342859 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd475b3-eacf-418a-99eb-a3cd84604d0b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:32.343435 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd475b3-eacf-418a-99eb-a3cd84604d0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:32.345458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-20ce79b9-a59b-42af-9aa6-3ab312a1df7f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 23:40:32.345458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:32.345458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:32.345458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:32.345458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:32.345458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:32.345458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:32.345458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:32.345458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:32.345458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:32.345458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:32.345458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:32.345458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:40:32.345458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:40:32.345458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:40:32.345458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:32.347454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:32.349235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:32.349235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:32.349235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:40:32.349235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:40:32.349235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:40:32.349235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:40:32.349235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:40:32.349235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:40:32.349235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 12 23:40:32.349235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:32.350302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd475b3-eacf-418a-99eb-a3cd84604d0b None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:32.357874 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 499/983] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:40:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:32.358062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 484/983] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 23:40:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:32.366764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd475b3-eacf-418a-99eb-a3cd84604d0b None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:32.371030 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce79b9-a59b-42af-9aa6-3ab312a1df7f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:32.569894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd475b3-eacf-418a-99eb-a3cd84604d0b None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:32.598619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce79b9-a59b-42af-9aa6-3ab312a1df7f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:32.603273 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:32.615748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e4b43-1be2-4f7a-af9d-9ed82baf04ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:32.616506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e4b43-1be2-4f7a-af9d-9ed82baf04ba None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:32.616506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e4b43-1be2-4f7a-af9d-9ed82baf04ba None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:32.616772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e4b43-1be2-4f7a-af9d-9ed82baf04ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:32.617531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e4b43-1be2-4f7a-af9d-9ed82baf04ba None admin] RBAC: Adding query filter params (interface=admin, service_id=c8a5f2887a604e72818289114239e86e, region_id=RegionOne) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:32.617845 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e4b43-1be2-4f7a-af9d-9ed82baf04ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:32.619243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e4b43-1be2-4f7a-af9d-9ed82baf04ba None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:32.629662 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 485/984] 10.222.0.23 () {56 vars in 1249 bytes} [Mon Sep 12 23:40:32 2022] GET /identity/v3/endpoints?service_id=c8a5f2887a604e72818289114239e86e&interface=admin®ion_id=RegionOne => generated 193 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:32.631672 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e4b43-1be2-4f7a-af9d-9ed82baf04ba None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:32.667130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b070f7-c64a-4579-9a1b-58936e12c863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:32.667766 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b070f7-c64a-4579-9a1b-58936e12c863 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:32.668110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b070f7-c64a-4579-9a1b-58936e12c863 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:32.668388 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b070f7-c64a-4579-9a1b-58936e12c863 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:32.669102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b070f7-c64a-4579-9a1b-58936e12c863 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:32.669436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b070f7-c64a-4579-9a1b-58936e12c863 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:32.670987 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b070f7-c64a-4579-9a1b-58936e12c863 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:32.718628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 500/985] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 12 23:40:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:32.720274 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:32.829252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e4b43-1be2-4f7a-af9d-9ed82baf04ba None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:32.913871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30b0b9-cdf6-4b1b-b906-d10bef0e583b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:32.915521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30b0b9-cdf6-4b1b-b906-d10bef0e583b None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:32.916234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30b0b9-cdf6-4b1b-b906-d10bef0e583b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:32.916932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30b0b9-cdf6-4b1b-b906-d10bef0e583b None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:32.918531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30b0b9-cdf6-4b1b-b906-d10bef0e583b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:32.921521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30b0b9-cdf6-4b1b-b906-d10bef0e583b None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:32.934911 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 486/986] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 23:40:32 2022] GET /identity/v3/services => generated 1497 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:40:34.002872 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d9c5c-07c6-424d-bb81-8b4a9b01af74 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:34.003665 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d9c5c-07c6-424d-bb81-8b4a9b01af74 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:34.003665 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d9c5c-07c6-424d-bb81-8b4a9b01af74 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:34.005388 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 501/987] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:40:34.013524 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3776a70-9647-4b17-89c1-3a13c7b92a70 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:34.014077 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3776a70-9647-4b17-89c1-3a13c7b92a70 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:34.014424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3776a70-9647-4b17-89c1-3a13c7b92a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:34.043537 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-e3776a70-9647-4b17-89c1-3a13c7b92a70 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:34.046227 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e3776a70-9647-4b17-89c1-3a13c7b92a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:34.177790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 487/988] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:34.562600 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d9c5c-07c6-424d-bb81-8b4a9b01af74 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:34.608147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e228bff-f520-481a-89d4-f2a448ec75ac None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:34.608416 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e228bff-f520-481a-89d4-f2a448ec75ac None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:34.608948 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e228bff-f520-481a-89d4-f2a448ec75ac None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:34.610365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 488/989] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:40:34.616112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b043-616c-4bdd-86ec-27a03e8860f4 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:34.616387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b043-616c-4bdd-86ec-27a03e8860f4 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:34.616901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b043-616c-4bdd-86ec-27a03e8860f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:34.636203 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-2f63b043-616c-4bdd-86ec-27a03e8860f4 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:34.637434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-2f63b043-616c-4bdd-86ec-27a03e8860f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:34.686565 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:34.716721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d9c5c-07c6-424d-bb81-8b4a9b01af74 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:34.724801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 489/990] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:34.762824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3940d0d-bb62-445a-a6b8-9b6cf7ca6827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:34.763539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3940d0d-bb62-445a-a6b8-9b6cf7ca6827 None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:34.764000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3940d0d-bb62-445a-a6b8-9b6cf7ca6827 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:34.764272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3940d0d-bb62-445a-a6b8-9b6cf7ca6827 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:34.765089 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3940d0d-bb62-445a-a6b8-9b6cf7ca6827 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:34.766763 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3940d0d-bb62-445a-a6b8-9b6cf7ca6827 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:34.789389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 502/991] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 23:40:34 2022] POST /identity/v3/services => generated 242 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:40:34.986594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63b043-616c-4bdd-86ec-27a03e8860f4 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:35.129076 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63b043-616c-4bdd-86ec-27a03e8860f4 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:35.173081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b748d5b-28cc-417e-95c4-c1db389fc776 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:35.173907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b748d5b-28cc-417e-95c4-c1db389fc776 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:35.173907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b748d5b-28cc-417e-95c4-c1db389fc776 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:35.175250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 503/992] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:40:35.178017 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c01db-d124-4aa1-826d-a16d357bf3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:35.178672 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c01db-d124-4aa1-826d-a16d357bf3ea None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:35.178946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c01db-d124-4aa1-826d-a16d357bf3ea None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:35.179294 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c01db-d124-4aa1-826d-a16d357bf3ea None admin] PATH_INFO: `/v3/services/image` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:35.179887 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c01db-d124-4aa1-826d-a16d357bf3ea None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:35.180744 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03364f-1eda-45ed-8ade-0389cde0e7d0 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:35.181036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03364f-1eda-45ed-8ade-0389cde0e7d0 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:35.181308 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c01db-d124-4aa1-826d-a16d357bf3ea None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:35.181425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03364f-1eda-45ed-8ade-0389cde0e7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:35.193243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-233c01db-d124-4aa1-826d-a16d357bf3ea None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:40:35.193243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:35.193243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:35.193243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:35.193243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:35.193243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:35.193243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:35.193243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:35.193243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:40:35.193243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:35.193243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:35.193243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:35.193243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:35.193243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:35.193243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:35.193243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:35.193243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:35.194685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:35.194685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:35.194685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:35.194685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:35.194685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:35.194685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:35.194685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:35.194685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:35.194685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:35.194685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:35.194685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:35.194685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:35.194685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:35.194685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:35.194685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:35.194685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:35.195767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:35.195767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:35.195767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:35.195767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:35.195767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:35.195767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:35.195767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:35.195767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:35.195767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:35.195767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:35.195767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:35.195767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:35.195767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:40:35.195767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:35.195767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 490/993] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Sep 12 23:40:34 2022] GET /identity/v3/services/image => generated 86 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:35.201010 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-2f03364f-1eda-45ed-8ade-0389cde0e7d0 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:35.202261 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2f03364f-1eda-45ed-8ade-0389cde0e7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:35.204305 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c01db-d124-4aa1-826d-a16d357bf3ea None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:35.219550 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:35.246483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:35.283918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 504/994] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:35.346721 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c01db-d124-4aa1-826d-a16d357bf3ea None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:35.397289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa3341-c992-415b-bd0c-42e9ad1481b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:35.397976 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa3341-c992-415b-bd0c-42e9ad1481b5 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:35.398355 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa3341-c992-415b-bd0c-42e9ad1481b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:35.398796 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa3341-c992-415b-bd0c-42e9ad1481b5 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:35.399633 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa3341-c992-415b-bd0c-42e9ad1481b5 None admin] RBAC: Adding query filter params (name=image) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:35.400147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa3341-c992-415b-bd0c-42e9ad1481b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:35.406412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa3341-c992-415b-bd0c-42e9ad1481b5 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:35.414794 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 491/995] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:35.423968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03364f-1eda-45ed-8ade-0389cde0e7d0 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:35.548301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa3341-c992-415b-bd0c-42e9ad1481b5 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:35.602280 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03364f-1eda-45ed-8ade-0389cde0e7d0 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:35.675284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c96a2-6b27-4398-9300-5a6dbf159c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:35.676793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c96a2-6b27-4398-9300-5a6dbf159c9e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:35.677234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c96a2-6b27-4398-9300-5a6dbf159c9e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:35.677689 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c96a2-6b27-4398-9300-5a6dbf159c9e None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:35.679017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c96a2-6b27-4398-9300-5a6dbf159c9e None admin] RBAC: Adding query filter params (type=image) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:35.679517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c96a2-6b27-4398-9300-5a6dbf159c9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:35.680150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:35.681913 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c96a2-6b27-4398-9300-5a6dbf159c9e None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:35.701381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 505/996] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:35.701648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa3341-c992-415b-bd0c-42e9ad1481b5 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:35.749531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa27b67-cf44-4a0b-8afc-c7929e9f3cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:35.750198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa27b67-cf44-4a0b-8afc-c7929e9f3cee None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:35.750472 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa27b67-cf44-4a0b-8afc-c7929e9f3cee None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:35.750738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa27b67-cf44-4a0b-8afc-c7929e9f3cee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:35.751336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa27b67-cf44-4a0b-8afc-c7929e9f3cee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:35.752755 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa27b67-cf44-4a0b-8afc-c7929e9f3cee None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:35.762729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-3fa27b67-cf44-4a0b-8afc-c7929e9f3cee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:40:35.762729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:35.762729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:35.762729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:35.762729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:35.762729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:35.762729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:35.762729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:35.762729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:40:35.762729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:35.762729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:35.762729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:35.762729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:35.762729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:35.762729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:35.762729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:35.762729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:35.764787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:35.764787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:35.764787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:35.764787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:35.764787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:35.764787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:35.764787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:35.764787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:35.764787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:35.764787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:35.764787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:35.764787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:35.764787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:35.764787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:35.764787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:35.764787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:35.766525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:35.766525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:35.766525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:35.766525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:35.766525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:35.766525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:35.766525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:35.766525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:35.766525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:35.766525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:35.766525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:35.766525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:35.766525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 12 23:40:35.766525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:35.766525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 492/997] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 12 23:40:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:35.770539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c96a2-6b27-4398-9300-5a6dbf159c9e None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:35.791278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:35.943183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c96a2-6b27-4398-9300-5a6dbf159c9e None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:35.987348 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbbe0f-b708-46c6-8820-e5a142050774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:35.987994 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbbe0f-b708-46c6-8820-e5a142050774 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:35.988275 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbbe0f-b708-46c6-8820-e5a142050774 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:35.988548 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbbe0f-b708-46c6-8820-e5a142050774 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:35.989191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbbe0f-b708-46c6-8820-e5a142050774 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:35.989533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbbe0f-b708-46c6-8820-e5a142050774 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:35.990934 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbbe0f-b708-46c6-8820-e5a142050774 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:35.997294 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 506/998] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 23:40:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:36.003387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa27b67-cf44-4a0b-8afc-c7929e9f3cee None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:36.134893 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa27b67-cf44-4a0b-8afc-c7929e9f3cee None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:36.201724 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c009f-4380-48b0-b104-917b4f666dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:36.202821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c009f-4380-48b0-b104-917b4f666dfd None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:36.203314 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c009f-4380-48b0-b104-917b4f666dfd None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:36.203794 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c009f-4380-48b0-b104-917b4f666dfd None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:36.204946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c009f-4380-48b0-b104-917b4f666dfd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:36.205533 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c009f-4380-48b0-b104-917b4f666dfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:36.207923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c009f-4380-48b0-b104-917b4f666dfd None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:36.222991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 493/999] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 12 23:40:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:36.224846 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbbe0f-b708-46c6-8820-e5a142050774 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:36.326668 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:36.352007 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbbe0f-b708-46c6-8820-e5a142050774 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:36.394862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f22425-1490-4fcb-bd9e-44bfc4463c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:36.395625 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f22425-1490-4fcb-bd9e-44bfc4463c8d None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:36.395927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f22425-1490-4fcb-bd9e-44bfc4463c8d None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:36.396353 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f22425-1490-4fcb-bd9e-44bfc4463c8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:36.397195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f22425-1490-4fcb-bd9e-44bfc4463c8d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:36.403184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f22425-1490-4fcb-bd9e-44bfc4463c8d None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:36.422751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 507/1000] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:40:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:40:37.251065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b164c-84f4-44b1-acbf-025af335804b None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:37.251615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b164c-84f4-44b1-acbf-025af335804b None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:37.251615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b164c-84f4-44b1-acbf-025af335804b None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:37.253137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 494/1001] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:37.258735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10c91-6ac7-4553-93ce-2dafb8cc71d7 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:37.259201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10c91-6ac7-4553-93ce-2dafb8cc71d7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:37.259299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10c91-6ac7-4553-93ce-2dafb8cc71d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:37.278799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-6ba10c91-6ac7-4553-93ce-2dafb8cc71d7 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:37.280015 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6ba10c91-6ac7-4553-93ce-2dafb8cc71d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:37.367032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 508/1002] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:37 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:37.631260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b164c-84f4-44b1-acbf-025af335804b None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:37.659154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:37.743839 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b164c-84f4-44b1-acbf-025af335804b None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:37.780054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb5233-6ad3-4e34-acb5-0c2375f008fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:37.780786 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb5233-6ad3-4e34-acb5-0c2375f008fb None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:37.781054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb5233-6ad3-4e34-acb5-0c2375f008fb None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:37.781305 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb5233-6ad3-4e34-acb5-0c2375f008fb None admin] PATH_INFO: `/v3/services/compute` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:37.781936 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb5233-6ad3-4e34-acb5-0c2375f008fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:37.783310 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb5233-6ad3-4e34-acb5-0c2375f008fb None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:37.792682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-eaeb5233-6ad3-4e34-acb5-0c2375f008fb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:40:37.792682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:37.792682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:37.792682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:37.792682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:37.792682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:37.792682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:37.792682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:37.792682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:40:37.792682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:37.792682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:37.792682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:37.792682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:37.792682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:37.792682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:37.792682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:37.792682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:37.793783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:37.793783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:37.793783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:37.793783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:37.793783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:37.793783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:37.793783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:37.793783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:37.793783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:37.793783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:37.793783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:37.793783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:37.793783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:37.793783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:37.793783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:37.793783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:37.798502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:37.798502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:37.798502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:37.798502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:37.798502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:37.798502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:37.798502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:37.798502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:37.798502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:37.798502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:37.798502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:37.798502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:37.798502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:40:37.798502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:37.798502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 495/1003] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:40:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:37.800892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba10c91-6ac7-4553-93ce-2dafb8cc71d7 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:37.878058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:37.920828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba10c91-6ac7-4553-93ce-2dafb8cc71d7 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:37.956785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec9cf5-c20f-43e5-b435-f4af5891201c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:37.957440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec9cf5-c20f-43e5-b435-f4af5891201c None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:37.957722 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec9cf5-c20f-43e5-b435-f4af5891201c None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:37.957992 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec9cf5-c20f-43e5-b435-f4af5891201c None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:37.958637 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec9cf5-c20f-43e5-b435-f4af5891201c None admin] RBAC: Adding query filter params (name=compute) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:37.958941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec9cf5-c20f-43e5-b435-f4af5891201c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:37.960312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec9cf5-c20f-43e5-b435-f4af5891201c None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:37.963483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2e878-8839-4406-9adf-b580d2fa5acc None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:37.963888 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2e878-8839-4406-9adf-b580d2fa5acc None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:37.964223 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2e878-8839-4406-9adf-b580d2fa5acc None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:37.965815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 496/1004] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:37.969019 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 509/1005] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 23:40:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:37.971485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92adcb8-8fdf-4106-9847-8f4d0e495670 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:37.971770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92adcb8-8fdf-4106-9847-8f4d0e495670 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:37.972049 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92adcb8-8fdf-4106-9847-8f4d0e495670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:37.974613 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec9cf5-c20f-43e5-b435-f4af5891201c None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:37.991228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-f92adcb8-8fdf-4106-9847-8f4d0e495670 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:37.992446 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f92adcb8-8fdf-4106-9847-8f4d0e495670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:38.079729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 497/1006] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:37 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:38.091631 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec9cf5-c20f-43e5-b435-f4af5891201c None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:38.120662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:38.130378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a63392-0478-44b4-a3b1-50de75cdab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:38.131141 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a63392-0478-44b4-a3b1-50de75cdab73 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:38.131428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a63392-0478-44b4-a3b1-50de75cdab73 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:38.131698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a63392-0478-44b4-a3b1-50de75cdab73 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:38.132405 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a63392-0478-44b4-a3b1-50de75cdab73 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:38.132720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a63392-0478-44b4-a3b1-50de75cdab73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:38.134155 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a63392-0478-44b4-a3b1-50de75cdab73 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:38.140346 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 510/1007] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 23:40:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:38.146659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92adcb8-8fdf-4106-9847-8f4d0e495670 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:38.169135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:38.263737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92adcb8-8fdf-4106-9847-8f4d0e495670 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:38.302431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff27640-75e1-41fa-990f-6af2cefd0c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:38.303155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff27640-75e1-41fa-990f-6af2cefd0c4d None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:38.303442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff27640-75e1-41fa-990f-6af2cefd0c4d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:38.303706 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff27640-75e1-41fa-990f-6af2cefd0c4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:38.304413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff27640-75e1-41fa-990f-6af2cefd0c4d None admin] RBAC: Adding query filter params (interface=public, service_id=fbb2308f60024ead8f222a9259fbb36f, region_id=RegionOne) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:38.304708 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff27640-75e1-41fa-990f-6af2cefd0c4d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:38.306148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff27640-75e1-41fa-990f-6af2cefd0c4d None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:38.312391 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 498/1008] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 12 23:40:38 2022] GET /identity/v3/endpoints?service_id=fbb2308f60024ead8f222a9259fbb36f&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:38.318184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a63392-0478-44b4-a3b1-50de75cdab73 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:38.340780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff27640-75e1-41fa-990f-6af2cefd0c4d None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:38.439037 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:38.440537 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a63392-0478-44b4-a3b1-50de75cdab73 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:38.465835 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff27640-75e1-41fa-990f-6af2cefd0c4d None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:38.480218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44628352-c8fa-415c-b0c1-2ec1f0c15943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:38.480842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628352-c8fa-415c-b0c1-2ec1f0c15943 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:38.481120 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628352-c8fa-415c-b0c1-2ec1f0c15943 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:38.481410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628352-c8fa-415c-b0c1-2ec1f0c15943 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:38.482030 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44628352-c8fa-415c-b0c1-2ec1f0c15943 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:38.483411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44628352-c8fa-415c-b0c1-2ec1f0c15943 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:38.490775 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 511/1009] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 23:40:38 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:40:38.520472 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec5eb6-ceba-46ee-897b-de568e2038e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:38.522029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec5eb6-ceba-46ee-897b-de568e2038e7 None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:38.522775 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec5eb6-ceba-46ee-897b-de568e2038e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:38.523522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec5eb6-ceba-46ee-897b-de568e2038e7 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:38.525006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec5eb6-ceba-46ee-897b-de568e2038e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:38.528024 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec5eb6-ceba-46ee-897b-de568e2038e7 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:38.558000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 499/1010] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 23:40:38 2022] POST /identity/v3/services => generated 242 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:40:38.736786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaf62e-eee2-46d5-b3ac-95bd3d16246e None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:38.737187 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaf62e-eee2-46d5-b3ac-95bd3d16246e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:38.737445 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eaf62e-eee2-46d5-b3ac-95bd3d16246e None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:38.739717 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 512/1011] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:38.745996 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0956da3-a664-425a-bc8b-cb0f79e17a3b None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:38.746284 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0956da3-a664-425a-bc8b-cb0f79e17a3b None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:38.746717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0956da3-a664-425a-bc8b-cb0f79e17a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:38.769973 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-f0956da3-a664-425a-bc8b-cb0f79e17a3b None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:38.771180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f0956da3-a664-425a-bc8b-cb0f79e17a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:38.862144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 500/1012] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:38 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:39.126779 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eaf62e-eee2-46d5-b3ac-95bd3d16246e None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:39.202069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:39.257677 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eaf62e-eee2-46d5-b3ac-95bd3d16246e None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:39.296808 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf3f3e-2ef0-4080-91e3-3ae83f8cbc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:39.297904 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf3f3e-2ef0-4080-91e3-3ae83f8cbc03 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:39.298453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf3f3e-2ef0-4080-91e3-3ae83f8cbc03 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:39.298918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf3f3e-2ef0-4080-91e3-3ae83f8cbc03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:39.300629 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf3f3e-2ef0-4080-91e3-3ae83f8cbc03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:39.302660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf3f3e-2ef0-4080-91e3-3ae83f8cbc03 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:39.305169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 513/1013] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:39.312095 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0956da3-a664-425a-bc8b-cb0f79e17a3b None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:39.391206 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:39.445678 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0956da3-a664-425a-bc8b-cb0f79e17a3b None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:39.505589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4ed91-ec6c-4b3f-95c7-1aed66494f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:39.506648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4ed91-ec6c-4b3f-95c7-1aed66494f04 None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:39.507059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4ed91-ec6c-4b3f-95c7-1aed66494f04 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:39.507491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4ed91-ec6c-4b3f-95c7-1aed66494f04 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:39.508722 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4ed91-ec6c-4b3f-95c7-1aed66494f04 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:39.511385 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4ed91-ec6c-4b3f-95c7-1aed66494f04 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:39.573205 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 501/1014] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 23:40:39 2022] POST /identity/v3/projects => generated 311 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:40:40.903542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38acb5a-6060-4841-86a4-da2a8d6202c9 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:40.904083 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38acb5a-6060-4841-86a4-da2a8d6202c9 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:40.904567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38acb5a-6060-4841-86a4-da2a8d6202c9 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:40.907265 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 514/1015] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:40:40.914163 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472c16-3c76-4bce-ab12-ca049e89e80c None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:40.914921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472c16-3c76-4bce-ab12-ca049e89e80c None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:40.914921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19472c16-3c76-4bce-ab12-ca049e89e80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:40.945007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-19472c16-3c76-4bce-ab12-ca049e89e80c None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:40.947109 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-19472c16-3c76-4bce-ab12-ca049e89e80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:41.082929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 502/1016] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:40 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:41.367648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38acb5a-6060-4841-86a4-da2a8d6202c9 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:41.439025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdd553-da9c-40e7-a91e-48664a45b59f None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:41.439025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdd553-da9c-40e7-a91e-48664a45b59f None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:41.439466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdd553-da9c-40e7-a91e-48664a45b59f None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:41.440821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 503/1017] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:40:41.446597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c146cd-61b2-401c-98e9-b577d74727f4 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:41.446964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c146cd-61b2-401c-98e9-b577d74727f4 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:41.447209 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c146cd-61b2-401c-98e9-b577d74727f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:41.466310 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-c4c146cd-61b2-401c-98e9-b577d74727f4 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:41.467518 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c4c146cd-61b2-401c-98e9-b577d74727f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:41.509652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38acb5a-6060-4841-86a4-da2a8d6202c9 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:41.529479 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:41.543416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:41.558054 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69bd4d-994e-413b-9608-1b65299df827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:41.559003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69bd4d-994e-413b-9608-1b65299df827 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:41.559346 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69bd4d-994e-413b-9608-1b65299df827 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:41.559620 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69bd4d-994e-413b-9608-1b65299df827 None admin] PATH_INFO: `/v3/services/image` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:41.560215 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69bd4d-994e-413b-9608-1b65299df827 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:41.565660 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 504/1018] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:41 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:41.565885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69bd4d-994e-413b-9608-1b65299df827 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:41.574791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-bc69bd4d-994e-413b-9608-1b65299df827 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:40:41.574791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:41.574791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:41.574791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:41.574791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:41.574791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:41.574791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:41.574791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:41.574791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:40:41.574791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:41.574791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:41.574791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:41.574791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:41.574791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:41.574791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:41.574791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:41.574791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:41.577931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:41.577931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:41.577931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:41.577931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:41.577931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:41.577931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:41.577931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:41.577931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:41.577931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:41.577931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:41.577931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:41.577931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:41.577931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:41.577931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:41.577931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:41.577931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:41.578785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:41.578785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:41.578785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:41.578785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:41.578785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:41.578785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:41.578785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:41.578785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:41.578785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:41.578785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:41.578785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:41.578785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:41.578785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:40:41.578785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:41.578785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 515/1019] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Sep 12 23:40:41 2022] GET /identity/v3/services/image => generated 86 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:41.585489 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c146cd-61b2-401c-98e9-b577d74727f4 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:41.750406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c146cd-61b2-401c-98e9-b577d74727f4 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:41.793326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46191a2b-be0d-4608-a708-87ca4b438f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:41.793998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46191a2b-be0d-4608-a708-87ca4b438f64 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:41.794283 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46191a2b-be0d-4608-a708-87ca4b438f64 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:41.794553 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46191a2b-be0d-4608-a708-87ca4b438f64 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:41.795264 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46191a2b-be0d-4608-a708-87ca4b438f64 None admin] RBAC: Adding query filter params (name=image) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:41.795568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46191a2b-be0d-4608-a708-87ca4b438f64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:41.797196 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46191a2b-be0d-4608-a708-87ca4b438f64 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:41.805864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 505/1020] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:41.810164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69bd4d-994e-413b-9608-1b65299df827 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:41.832580 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46191a2b-be0d-4608-a708-87ca4b438f64 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:41.905266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:41.971893 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46191a2b-be0d-4608-a708-87ca4b438f64 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:41.979540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69bd4d-994e-413b-9608-1b65299df827 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:42.012377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e4988-379d-45a4-abd0-8e89d0d56e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:42.013260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e4988-379d-45a4-abd0-8e89d0d56e63 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:42.013724 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e4988-379d-45a4-abd0-8e89d0d56e63 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:42.014160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e4988-379d-45a4-abd0-8e89d0d56e63 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:42.015129 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e4988-379d-45a4-abd0-8e89d0d56e63 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:42.016553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b9b0c-afa5-418a-a1c0-66ebdb954819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:42.017172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b9b0c-afa5-418a-a1c0-66ebdb954819 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:42.017440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e4988-379d-45a4-abd0-8e89d0d56e63 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:42.017556 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b9b0c-afa5-418a-a1c0-66ebdb954819 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:42.017758 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b9b0c-afa5-418a-a1c0-66ebdb954819 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:42.018431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b9b0c-afa5-418a-a1c0-66ebdb954819 None admin] RBAC: Adding query filter params (type=image) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:42.018831 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b9b0c-afa5-418a-a1c0-66ebdb954819 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:42.020239 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b9b0c-afa5-418a-a1c0-66ebdb954819 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:42.027096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 516/1021] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:42.028632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f3681-361f-4933-b335-2ee9b29cc2c2 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:42.028917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f3681-361f-4933-b335-2ee9b29cc2c2 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:42.029182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f3681-361f-4933-b335-2ee9b29cc2c2 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:42.030986 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 517/1022] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:42.033271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-c18e4988-379d-45a4-abd0-8e89d0d56e63 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:40:42.033271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:42.033271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:42.033271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:42.033271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:42.033271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:42.033271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:42.033271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:42.033271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:40:42.033271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:42.033271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:42.033271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:42.033271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:42.033271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:42.033271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:42.033271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:42.033271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:42.035228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:42.035228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:42.035228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:42.035228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:42.035228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:42.035228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:42.035228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:42.035228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:42.035228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:42.035228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:42.035228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:42.035228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:42.035228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:42.035228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:42.035228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:42.035228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:42.036826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:42.036826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:42.036826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:42.036826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:42.036826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:42.036826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:42.036826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:42.036826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:42.036826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:42.036826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:42.036826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:42.036826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:42.036826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 12 23:40:42.036826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:42.038293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f3681-361f-4933-b335-2ee9b29cc2c2 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:42.038425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 506/1023] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:40:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:42.038425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb6fea-acb0-4bff-bc77-b4c48a157251 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:42.038425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb6fea-acb0-4bff-bc77-b4c48a157251 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:42.038746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb6fea-acb0-4bff-bc77-b4c48a157251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:42.060260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-85eb6fea-acb0-4bff-bc77-b4c48a157251 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:42.061985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-85eb6fea-acb0-4bff-bc77-b4c48a157251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:42.096724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:42.134705 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 507/1024] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:42 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:42.135566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb6fea-acb0-4bff-bc77-b4c48a157251 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:42.149446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f3681-361f-4933-b335-2ee9b29cc2c2 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:42.189713 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f83b1-e393-4c59-8cd0-97ed6cef91ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:42.190366 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f83b1-e393-4c59-8cd0-97ed6cef91ad None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:42.190649 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f83b1-e393-4c59-8cd0-97ed6cef91ad None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:42.190930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f83b1-e393-4c59-8cd0-97ed6cef91ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:42.191650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f83b1-e393-4c59-8cd0-97ed6cef91ad None admin] RBAC: Adding query filter params (interface=public, service_id=3e727beba805445db00cd481ea6056fd, region_id=RegionOne) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:42.191958 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f83b1-e393-4c59-8cd0-97ed6cef91ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:42.193331 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f83b1-e393-4c59-8cd0-97ed6cef91ad None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:42.198277 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:42.204581 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 518/1025] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 12 23:40:42 2022] GET /identity/v3/endpoints?service_id=3e727beba805445db00cd481ea6056fd&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:42.205582 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f83b1-e393-4c59-8cd0-97ed6cef91ad None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:42.283231 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb6fea-acb0-4bff-bc77-b4c48a157251 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:42.323448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bde8bb-c298-4362-880f-9d2d56ac6d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:42.324252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bde8bb-c298-4362-880f-9d2d56ac6d7b None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:42.324703 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bde8bb-c298-4362-880f-9d2d56ac6d7b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:42.325177 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bde8bb-c298-4362-880f-9d2d56ac6d7b None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:42.326386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bde8bb-c298-4362-880f-9d2d56ac6d7b None admin] RBAC: Adding query filter params (name=compute) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:42.326949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bde8bb-c298-4362-880f-9d2d56ac6d7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:42.329639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bde8bb-c298-4362-880f-9d2d56ac6d7b None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:42.347358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 508/1026] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 23:40:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:42.349379 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bde8bb-c298-4362-880f-9d2d56ac6d7b None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:42.349686 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f83b1-e393-4c59-8cd0-97ed6cef91ad None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:42.370374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:42.402025 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac792a1-af25-40ab-a608-c64cf591d03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:42.402837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac792a1-af25-40ab-a608-c64cf591d03f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:42.403295 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac792a1-af25-40ab-a608-c64cf591d03f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:42.403755 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac792a1-af25-40ab-a608-c64cf591d03f None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:42.404949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac792a1-af25-40ab-a608-c64cf591d03f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:42.407328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac792a1-af25-40ab-a608-c64cf591d03f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:42.418493 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 519/1027] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 23:40:42 2022] GET /identity/v3/services => generated 1957 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:40:42.419781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac792a1-af25-40ab-a608-c64cf591d03f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:42.505749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bde8bb-c298-4362-880f-9d2d56ac6d7b None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:42.507665 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:42.547338 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac792a1-af25-40ab-a608-c64cf591d03f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:42.556279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55184390-5d9c-4d40-b733-4a1bac3c60b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:42.557681 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55184390-5d9c-4d40-b733-4a1bac3c60b7 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:42.558122 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55184390-5d9c-4d40-b733-4a1bac3c60b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:42.560077 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55184390-5d9c-4d40-b733-4a1bac3c60b7 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:42.560077 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55184390-5d9c-4d40-b733-4a1bac3c60b7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:42.560625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55184390-5d9c-4d40-b733-4a1bac3c60b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:42.564302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55184390-5d9c-4d40-b733-4a1bac3c60b7 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:42.575960 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 509/1028] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 12 23:40:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:42.582531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55184390-5d9c-4d40-b733-4a1bac3c60b7 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:42.599579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8c6e3-5089-45d2-8771-d854dde5c48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:42.600860 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c6e3-5089-45d2-8771-d854dde5c48a None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:42.601744 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c6e3-5089-45d2-8771-d854dde5c48a None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:42.602026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c6e3-5089-45d2-8771-d854dde5c48a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:42.603491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8c6e3-5089-45d2-8771-d854dde5c48a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:42.605136 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8c6e3-5089-45d2-8771-d854dde5c48a None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:42.607154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 520/1029] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:42.616384 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8c6e3-5089-45d2-8771-d854dde5c48a None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:42.693693 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:42.754271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55184390-5d9c-4d40-b733-4a1bac3c60b7 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:42.772476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8c6e3-5089-45d2-8771-d854dde5c48a None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:42.802348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cae1c-f3aa-4cb3-93cf-f2fc7d25b1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:42.802888 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cae1c-f3aa-4cb3-93cf-f2fc7d25b1ef None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:42.803175 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cae1c-f3aa-4cb3-93cf-f2fc7d25b1ef None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:42.803449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cae1c-f3aa-4cb3-93cf-f2fc7d25b1ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:42.804158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1cae1c-f3aa-4cb3-93cf-f2fc7d25b1ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:42.805741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1cae1c-f3aa-4cb3-93cf-f2fc7d25b1ef None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:42.824615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0056916-bbe6-4f6d-8712-17485336e76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:42.825374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0056916-bbe6-4f6d-8712-17485336e76a None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:42.825673 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0056916-bbe6-4f6d-8712-17485336e76a None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:42.826279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0056916-bbe6-4f6d-8712-17485336e76a None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:42.828485 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0056916-bbe6-4f6d-8712-17485336e76a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:42.836849 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0056916-bbe6-4f6d-8712-17485336e76a None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:42.838349 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 510/1030] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:40:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:40:42.863895 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 521/1031] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:40:42 2022] POST /identity/v3/users => generated 285 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:40:44.703016 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f74f2b-2a4d-4b31-b825-465e5dae3e51 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:44.703689 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f74f2b-2a4d-4b31-b825-465e5dae3e51 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:44.704061 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f74f2b-2a4d-4b31-b825-465e5dae3e51 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:44.706535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 511/1032] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:44.715047 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e65d-2dbb-42aa-9e33-9866c4aeff9c None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:44.718672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e65d-2dbb-42aa-9e33-9866c4aeff9c None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:44.718672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e65d-2dbb-42aa-9e33-9866c4aeff9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:44.742351 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-a3e5e65d-2dbb-42aa-9e33-9866c4aeff9c None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:44.744027 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a3e5e65d-2dbb-42aa-9e33-9866c4aeff9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:44.827468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 522/1033] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:45.093896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f74f2b-2a4d-4b31-b825-465e5dae3e51 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:45.121710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:45.225861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f74f2b-2a4d-4b31-b825-465e5dae3e51 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:45.263438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce4489-0b29-447e-9398-7f0a193a5a20 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:45.263726 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce4489-0b29-447e-9398-7f0a193a5a20 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:45.264004 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce4489-0b29-447e-9398-7f0a193a5a20 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:45.265993 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 523/1034] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:40:45.271985 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cf09a-bd5e-439f-87b7-a02f0d937be0 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:45.272332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cf09a-bd5e-439f-87b7-a02f0d937be0 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:45.272638 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cf09a-bd5e-439f-87b7-a02f0d937be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:45.277437 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f3352-e591-4425-914e-64114052e2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:45.278177 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3352-e591-4425-914e-64114052e2bc None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:45.278601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3352-e591-4425-914e-64114052e2bc None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:45.279247 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3352-e591-4425-914e-64114052e2bc None admin] PATH_INFO: `/v3/services/image` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:45.279882 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f3352-e591-4425-914e-64114052e2bc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:45.283038 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f3352-e591-4425-914e-64114052e2bc None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:45.293609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-109cf09a-bd5e-439f-87b7-a02f0d937be0 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:45.294909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-109cf09a-bd5e-439f-87b7-a02f0d937be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:45.299764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-a63f3352-e591-4425-914e-64114052e2bc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:40:45.299764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:45.299764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:40:45.299764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:40:45.299764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:40:45.299764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:40:45.299764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:40:45.299764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:45.299764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:40:45.299764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:45.299764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:40:45.299764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:45.299764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:45.299764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:45.299764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:45.299764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:45.299764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:45.300846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:45.300846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:45.300846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:45.300846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:45.300846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:45.300846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:45.300846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:40:45.300846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:40:45.300846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:40:45.300846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:40:45.300846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:45.300846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:45.300846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:45.300846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:45.300846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:45.300846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:45.302168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:45.302168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:45.302168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:45.302168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:45.302168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:45.302168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:45.302168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:45.302168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:45.302168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:45.302168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:45.302168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:40:45.302168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:40:45.302168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 12 23:40:45.302168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:45.303481 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 512/1035] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Sep 12 23:40:45 2022] GET /identity/v3/services/image => generated 86 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:45.308754 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f3352-e591-4425-914e-64114052e2bc None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:45.330603 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:45.401478 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 524/1036] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:45.402767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb44940-e1e6-4458-94f3-284f2dd3b4be None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:45.403228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb44940-e1e6-4458-94f3-284f2dd3b4be None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:45.403703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb44940-e1e6-4458-94f3-284f2dd3b4be None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:45.406428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 525/1037] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:45.414469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc08f1d-20be-4737-b98f-e78611a9c012 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:45.414858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc08f1d-20be-4737-b98f-e78611a9c012 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:45.415109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc08f1d-20be-4737-b98f-e78611a9c012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:45.438998 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-9cc08f1d-20be-4737-b98f-e78611a9c012 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:45.440222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9cc08f1d-20be-4737-b98f-e78611a9c012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:45.447683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:45.470029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f3352-e591-4425-914e-64114052e2bc None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:45.524043 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82bfa1-2346-4245-b107-0a097b46e99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:45.524754 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82bfa1-2346-4245-b107-0a097b46e99a None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:45.525038 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82bfa1-2346-4245-b107-0a097b46e99a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:45.525358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82bfa1-2346-4245-b107-0a097b46e99a None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:45.526185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82bfa1-2346-4245-b107-0a097b46e99a None admin] RBAC: Adding query filter params (name=image) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:45.526498 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82bfa1-2346-4245-b107-0a097b46e99a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:45.528119 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82bfa1-2346-4245-b107-0a097b46e99a None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:45.530904 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 526/1038] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:45.537809 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 513/1039] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:45.546136 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc08f1d-20be-4737-b98f-e78611a9c012 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:45.664980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82bfa1-2346-4245-b107-0a097b46e99a None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:45.672118 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:45.686524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc08f1d-20be-4737-b98f-e78611a9c012 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:45.728470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c96fa-379d-4330-b5ed-dd363d06ed7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:45.729694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c96fa-379d-4330-b5ed-dd363d06ed7a None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:45.729694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c96fa-379d-4330-b5ed-dd363d06ed7a None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:45.729694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c96fa-379d-4330-b5ed-dd363d06ed7a None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:45.730284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c96fa-379d-4330-b5ed-dd363d06ed7a None admin] RBAC: Adding query filter params (type=image) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:45.730586 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c96fa-379d-4330-b5ed-dd363d06ed7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:45.732313 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c96fa-379d-4330-b5ed-dd363d06ed7a None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:45.738209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 527/1040] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:45.744050 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c96fa-379d-4330-b5ed-dd363d06ed7a None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:45.810014 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82bfa1-2346-4245-b107-0a097b46e99a None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:45.846600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bad6d-b9ba-4065-baab-f29848b0ca9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:45.847239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bad6d-b9ba-4065-baab-f29848b0ca9f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:45.847514 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bad6d-b9ba-4065-baab-f29848b0ca9f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:45.847787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bad6d-b9ba-4065-baab-f29848b0ca9f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:45.859534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1bad6d-b9ba-4065-baab-f29848b0ca9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:40:45.865111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-7c1bad6d-b9ba-4065-baab-f29848b0ca9f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:40:45.865111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:45.865111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:45.865111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:45.865111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:45.865111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:45.865111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:45.865111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:45.865111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:45.865111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:45.865111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:45.865111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:45.865111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:40:45.865111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:40:45.865111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:40:45.865111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:40:45.866166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:40:45.866166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:40:45.866166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:40:45.866166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:40:45.866166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:45.866166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:45.866166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:45.866166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:45.866166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:45.866166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:45.866166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:45.866166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:45.866166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:45.866166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:45.866166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:45.866166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:45.867001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:45.867001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:45.867001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:45.867001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:45.867001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:40:45.867001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:40:45.867001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:40:45.867001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:40:45.867001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:40:45.867001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:40:45.867001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:40:45.867001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:45.867001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 514/1041] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 12 23:40:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:45.867749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bad6d-b9ba-4065-baab-f29848b0ca9f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:45.875131 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c96fa-379d-4330-b5ed-dd363d06ed7a None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:45.880578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:45.925388 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dadfbe-717f-4a16-a11a-f925efc24e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:45.926059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dadfbe-717f-4a16-a11a-f925efc24e10 None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:45.926392 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dadfbe-717f-4a16-a11a-f925efc24e10 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:45.926715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dadfbe-717f-4a16-a11a-f925efc24e10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:45.927549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dadfbe-717f-4a16-a11a-f925efc24e10 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:45.929391 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dadfbe-717f-4a16-a11a-f925efc24e10 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:45.954334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 528/1042] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:40:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:40:45.955536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dadfbe-717f-4a16-a11a-f925efc24e10 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:45.980825 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:45.987597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1bad6d-b9ba-4065-baab-f29848b0ca9f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:46.041673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dce06-5d92-44d3-8e54-f784b3f943b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:46.042339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dce06-5d92-44d3-8e54-f784b3f943b8 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:46.042624 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dce06-5d92-44d3-8e54-f784b3f943b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:46.043023 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dce06-5d92-44d3-8e54-f784b3f943b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:46.059004 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1dce06-5d92-44d3-8e54-f784b3f943b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:40:46.064666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-ca1dce06-5d92-44d3-8e54-f784b3f943b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:40:46.064666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:46.064666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:46.064666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:46.064666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:46.064666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:46.064666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:46.064666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:46.064666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:46.064666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:46.064666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:46.064666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:46.064666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:40:46.064666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:40:46.064666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:40:46.064666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:40:46.066403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:40:46.066403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:40:46.066403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:40:46.066403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:40:46.066403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:46.066403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:46.066403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:46.066403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:46.066403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:46.066403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:46.066403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:46.066403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:46.066403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:46.066403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:46.066403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:46.066403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:46.068463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:46.068463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:46.068463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:46.068463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:46.068463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:40:46.068463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:40:46.068463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:40:46.068463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:40:46.068463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:40:46.068463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:40:46.068463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:40:46.068463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:46.068463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 515/1043] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:40:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:46.075497 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dce06-5d92-44d3-8e54-f784b3f943b8 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:46.148017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dadfbe-717f-4a16-a11a-f925efc24e10 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:46.180339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:46.215594 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82121d-d267-4514-b405-98f4edf7f262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:46.216757 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82121d-d267-4514-b405-98f4edf7f262 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:46.217251 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82121d-d267-4514-b405-98f4edf7f262 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:46.217767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82121d-d267-4514-b405-98f4edf7f262 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:46.219134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82121d-d267-4514-b405-98f4edf7f262 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:46.219672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82121d-d267-4514-b405-98f4edf7f262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:46.223669 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82121d-d267-4514-b405-98f4edf7f262 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:46.230577 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dce06-5d92-44d3-8e54-f784b3f943b8 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:46.247383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 529/1044] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 12 23:40:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:46.249920 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82121d-d267-4514-b405-98f4edf7f262 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:46.278713 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d941f01-4950-4f48-bd1e-11bdf3105230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:46.279617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d941f01-4950-4f48-bd1e-11bdf3105230 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:46.280297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d941f01-4950-4f48-bd1e-11bdf3105230 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:46.280649 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d941f01-4950-4f48-bd1e-11bdf3105230 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:46.281636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d941f01-4950-4f48-bd1e-11bdf3105230 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:46.281993 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d941f01-4950-4f48-bd1e-11bdf3105230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:46.284052 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d941f01-4950-4f48-bd1e-11bdf3105230 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:46.305418 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 516/1045] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:40:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:46.309436 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d941f01-4950-4f48-bd1e-11bdf3105230 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:46.346173 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:46.401858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82121d-d267-4514-b405-98f4edf7f262 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:46.446774 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d941f01-4950-4f48-bd1e-11bdf3105230 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:46.460809 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6910564-6165-4309-a091-4cfa2e5c6be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:46.461730 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6910564-6165-4309-a091-4cfa2e5c6be2 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:46.462131 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6910564-6165-4309-a091-4cfa2e5c6be2 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:46.462541 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6910564-6165-4309-a091-4cfa2e5c6be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:46.475515 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6910564-6165-4309-a091-4cfa2e5c6be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:46.477286 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6910564-6165-4309-a091-4cfa2e5c6be2 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:46.483397 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:46.495241 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0787e-17dc-4259-926d-fffbbb18305e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:46.496106 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0787e-17dc-4259-926d-fffbbb18305e None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:46.496409 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0787e-17dc-4259-926d-fffbbb18305e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:46.496803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0787e-17dc-4259-926d-fffbbb18305e None admin] PATH_INFO: `/v3/users/3b847761d29a4e2ab24c912286588f08` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:46.498784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-b6910564-6165-4309-a091-4cfa2e5c6be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:46.498784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:46.498784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:46.498784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:46.498784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:46.498784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:46.498784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:46.498784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:46.498784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:46.498784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:46.498784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:46.498784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:46.498784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:46.498784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:46.498784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:46.498784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:46.500666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:46.500666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:46.500666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:46.500666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:46.500666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:46.500666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:46.500666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:46.500666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:46.500666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:46.500666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:46.500666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:46.500666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:46.500666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:46.500666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:46.500666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:46.500666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:46.500666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:46.502519 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:46.502519 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:46.502519 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:46.502519 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 530/1046] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:46.508574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6910564-6165-4309-a091-4cfa2e5c6be2 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:46.519642 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0787e-17dc-4259-926d-fffbbb18305e None admin] RBAC: Authorizing `identity:get_user(user_id=3b847761d29a4e2ab24c912286588f08)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:46.521107 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0787e-17dc-4259-926d-fffbbb18305e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:46.523036 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 517/1047] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:40:46 2022] GET /identity/v3/users/3b847761d29a4e2ab24c912286588f08 => generated 285 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:46.528758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0787e-17dc-4259-926d-fffbbb18305e None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:46.659006 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6910564-6165-4309-a091-4cfa2e5c6be2 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:46.660661 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0787e-17dc-4259-926d-fffbbb18305e None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:46.687840 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:46.705200 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbc213-5ec4-4172-9eff-21248b04dd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:46.705757 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbc213-5ec4-4172-9eff-21248b04dd3c None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:46.706024 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbc213-5ec4-4172-9eff-21248b04dd3c None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:46.706307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbc213-5ec4-4172-9eff-21248b04dd3c None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:46.706937 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbc213-5ec4-4172-9eff-21248b04dd3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:46.707234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbc213-5ec4-4172-9eff-21248b04dd3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:46.707904 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c12831-696b-4e74-9e50-b1381bbf8c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:46.708618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fbc213-5ec4-4172-9eff-21248b04dd3c None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:46.708787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c12831-696b-4e74-9e50-b1381bbf8c41 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:46.709044 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c12831-696b-4e74-9e50-b1381bbf8c41 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:46.709309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c12831-696b-4e74-9e50-b1381bbf8c41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:46.733796 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 531/1048] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:46.734961 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbc213-5ec4-4172-9eff-21248b04dd3c None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:46.803032 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:46.822548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c12831-696b-4e74-9e50-b1381bbf8c41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:46.824009 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c12831-696b-4e74-9e50-b1381bbf8c41 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:46.858824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbc213-5ec4-4172-9eff-21248b04dd3c None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:46.907316 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4060b6-fdf1-47cf-9e20-2ae13230a8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:46.908374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4060b6-fdf1-47cf-9e20-2ae13230a8e9 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:46.908843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4060b6-fdf1-47cf-9e20-2ae13230a8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:46.909287 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4060b6-fdf1-47cf-9e20-2ae13230a8e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:46.919915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4060b6-fdf1-47cf-9e20-2ae13230a8e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:46.921611 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4060b6-fdf1-47cf-9e20-2ae13230a8e9 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:46.935148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-4d4060b6-fdf1-47cf-9e20-2ae13230a8e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:40:46.935148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:46.935148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:46.935148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:46.935148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:46.935148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:46.935148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:46.935148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:46.935148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:46.935148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:46.935148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:46.935148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:46.935148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:40:46.935148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:40:46.935148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:40:46.935148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:46.936574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:46.937591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:46.937591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:46.937591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:40:46.937591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:40:46.937591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:40:46.937591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:40:46.937591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:40:46.937591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:40:46.937591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:40:46.937591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:46.937591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 532/1049] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 23:40:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:46.943332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4060b6-fdf1-47cf-9e20-2ae13230a8e9 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:46.972207 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 518/1050] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:40:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 12 23:40:46.974110 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c12831-696b-4e74-9e50-b1381bbf8c41 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:47.011902 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:47.103885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4060b6-fdf1-47cf-9e20-2ae13230a8e9 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:47.118514 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:47.144338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c12831-696b-4e74-9e50-b1381bbf8c41 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:47.165816 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8172a5a-f6d6-4b8d-8299-2efcb8c26b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:47.166539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8172a5a-f6d6-4b8d-8299-2efcb8c26b6b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:47.166864 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8172a5a-f6d6-4b8d-8299-2efcb8c26b6b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:47.167316 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8172a5a-f6d6-4b8d-8299-2efcb8c26b6b None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:47.168565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8172a5a-f6d6-4b8d-8299-2efcb8c26b6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:47.169063 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8172a5a-f6d6-4b8d-8299-2efcb8c26b6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:47.171451 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8172a5a-f6d6-4b8d-8299-2efcb8c26b6b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:47.203933 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef4f3e-371b-42f0-b293-e2c0c8cba912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:47.204989 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4f3e-371b-42f0-b293-e2c0c8cba912 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:47.205486 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4f3e-371b-42f0-b293-e2c0c8cba912 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:47.205949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4f3e-371b-42f0-b293-e2c0c8cba912 None admin] PATH_INFO: `/v3/projects/3cbbe9f822d942809c7136bcd226b2b5` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:47.208059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef4f3e-371b-42f0-b293-e2c0c8cba912 None admin] RBAC: Authorizing `identity:get_project(project_id=3cbbe9f822d942809c7136bcd226b2b5)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:47.209431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 533/1051] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 23:40:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:47.211029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef4f3e-371b-42f0-b293-e2c0c8cba912 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:47.212541 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8172a5a-f6d6-4b8d-8299-2efcb8c26b6b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:47.219215 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 519/1052] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:40:46 2022] GET /identity/v3/projects/3cbbe9f822d942809c7136bcd226b2b5 => generated 311 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:47.220486 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef4f3e-371b-42f0-b293-e2c0c8cba912 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:47.358624 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8172a5a-f6d6-4b8d-8299-2efcb8c26b6b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:47.360724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:47.372470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef4f3e-371b-42f0-b293-e2c0c8cba912 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:47.413217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb24f69-eb73-4ebb-9974-78cb7fb334d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:47.414242 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb24f69-eb73-4ebb-9974-78cb7fb334d7 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:47.414685 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb24f69-eb73-4ebb-9974-78cb7fb334d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:47.415400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb24f69-eb73-4ebb-9974-78cb7fb334d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:47.437054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb69bc3-e5e3-424e-8624-2873f902908f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:47.438003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb69bc3-e5e3-424e-8624-2873f902908f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:47.438426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb69bc3-e5e3-424e-8624-2873f902908f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:47.438833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb69bc3-e5e3-424e-8624-2873f902908f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:47.439981 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb69bc3-e5e3-424e-8624-2873f902908f None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.project.id=3cbbe9f822d942809c7136bcd226b2b5, user.id=3b847761d29a4e2ab24c912286588f08) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:47.440459 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb69bc3-e5e3-424e-8624-2873f902908f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:47.442817 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb69bc3-e5e3-424e-8624-2873f902908f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:47.452377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 520/1053] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:40:47 2022] GET /identity/v3/role_assignments?user.id=3b847761d29a4e2ab24c912286588f08&scope.project.id=3cbbe9f822d942809c7136bcd226b2b5&role.id=440092230f024959a90e846ab29c6367 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:47.549051 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb24f69-eb73-4ebb-9974-78cb7fb334d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:47.551751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb24f69-eb73-4ebb-9974-78cb7fb334d7 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:47.703332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 534/1054] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:40:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 12 23:40:47.708977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb69bc3-e5e3-424e-8624-2873f902908f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:47.729289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:47.832765 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb69bc3-e5e3-424e-8624-2873f902908f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:47.868956 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f166a-07a0-43a8-9bff-e27914742b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:47.869641 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f166a-07a0-43a8-9bff-e27914742b10 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:47.869924 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f166a-07a0-43a8-9bff-e27914742b10 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:47.870211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f166a-07a0-43a8-9bff-e27914742b10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:47.882333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f166a-07a0-43a8-9bff-e27914742b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:47.883817 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f166a-07a0-43a8-9bff-e27914742b10 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:47.899192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-350f166a-07a0-43a8-9bff-e27914742b10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:47.899192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:47.899192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:47.899192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:47.899192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:47.899192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:47.899192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:47.899192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:47.899192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:47.899192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:47.899192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:47.899192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:47.899192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:47.899192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:47.899192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:47.899192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:47.900411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:47.900411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:47.900411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:47.900411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:47.900411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:47.900411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:47.900411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:47.900411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:47.900411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:47.900411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:47.900411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:47.900411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:47.900411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:47.900411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:47.900411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:47.900411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:47.900411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:47.902153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:47.902153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:47.902153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:47.902673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 521/1055] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:47.906664 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb24f69-eb73-4ebb-9974-78cb7fb334d7 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:47.908924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:48.022505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb24f69-eb73-4ebb-9974-78cb7fb334d7 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:48.059453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3636abd-1aaf-4b2e-88e2-26696858dba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:48.060080 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3636abd-1aaf-4b2e-88e2-26696858dba8 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:48.060356 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3636abd-1aaf-4b2e-88e2-26696858dba8 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:48.060984 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3636abd-1aaf-4b2e-88e2-26696858dba8 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:48.061726 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3636abd-1aaf-4b2e-88e2-26696858dba8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:48.062053 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3636abd-1aaf-4b2e-88e2-26696858dba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:48.063447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3636abd-1aaf-4b2e-88e2-26696858dba8 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:48.077429 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 535/1056] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:48.083272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f166a-07a0-43a8-9bff-e27914742b10 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:48.173492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:48.219444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f166a-07a0-43a8-9bff-e27914742b10 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:48.264556 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a264c-bbc1-4b47-827c-504b76bb20f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:48.265256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a264c-bbc1-4b47-827c-504b76bb20f6 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:48.265566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a264c-bbc1-4b47-827c-504b76bb20f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:48.265691 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00579d6b-1096-43f4-805e-574c713f5b5a None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:48.265820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a264c-bbc1-4b47-827c-504b76bb20f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:48.266170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00579d6b-1096-43f4-805e-574c713f5b5a None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:48.266734 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00579d6b-1096-43f4-805e-574c713f5b5a None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:48.269975 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 536/1057] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:48.273677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a264c-bbc1-4b47-827c-504b76bb20f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:48.275074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a264c-bbc1-4b47-827c-504b76bb20f6 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:48.276584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8a5da-f045-4a46-9542-45aea623c4cc None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:48.277082 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8a5da-f045-4a46-9542-45aea623c4cc None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:48.277414 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8a5da-f045-4a46-9542-45aea623c4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:48.290991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-0d8a264c-bbc1-4b47-827c-504b76bb20f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:48.290991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:48.290991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:48.290991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:48.290991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:48.290991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:48.290991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:48.290991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:48.290991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:48.290991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:48.290991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:48.290991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:48.290991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:40:48.290991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:40:48.290991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:40:48.293211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:40:48.293211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:48.293211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:48.293211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:48.293211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:48.293211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:48.293211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:48.293211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:48.293211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:48.293211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:48.293211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:48.293211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:48.293211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:48.293211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:48.293211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:48.293211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:48.293211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:48.295057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:40:48.295057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:40:48.295057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:40:48.295057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:40:48.295057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:40:48.295057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:40:48.295057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:48.295057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:48.295057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 522/1058] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:40:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:48.298283 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a264c-bbc1-4b47-827c-504b76bb20f6 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:48.303338 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-4cf8a5da-f045-4a46-9542-45aea623c4cc None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:48.304597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4cf8a5da-f045-4a46-9542-45aea623c4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:48.397515 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:48.419925 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 537/1059] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:48.440923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a264c-bbc1-4b47-827c-504b76bb20f6 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:48.473513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:48.481019 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2230844-109c-4209-93c3-317149390cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:48.481732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2230844-109c-4209-93c3-317149390cdf None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:48.482016 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2230844-109c-4209-93c3-317149390cdf None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:48.482283 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2230844-109c-4209-93c3-317149390cdf None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:48.482990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2230844-109c-4209-93c3-317149390cdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:48.483297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2230844-109c-4209-93c3-317149390cdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:48.484831 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2230844-109c-4209-93c3-317149390cdf None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:48.498715 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 523/1060] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:40:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:48.504815 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8a5da-f045-4a46-9542-45aea623c4cc None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:48.622020 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8a5da-f045-4a46-9542-45aea623c4cc None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:48.664819 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141956a4-75f9-4603-89fa-2e29f138f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:48.665474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141956a4-75f9-4603-89fa-2e29f138f791 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:48.665876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141956a4-75f9-4603-89fa-2e29f138f791 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:48.666295 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141956a4-75f9-4603-89fa-2e29f138f791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:48.667168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141956a4-75f9-4603-89fa-2e29f138f791 None admin] RBAC: Adding query filter params (role.id=3c77102a55e849eb882b984ac3e3dfb4, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=4a87e18c89ff419f8e428e376d33462c) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:48.667507 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141956a4-75f9-4603-89fa-2e29f138f791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:48.669185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141956a4-75f9-4603-89fa-2e29f138f791 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:48.686072 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 538/1061] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:40:48 2022] GET /identity/v3/role_assignments?user.id=4a87e18c89ff419f8e428e376d33462c&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=3c77102a55e849eb882b984ac3e3dfb4 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:48.763180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2230844-109c-4209-93c3-317149390cdf None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:48.894805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2230844-109c-4209-93c3-317149390cdf None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:48.938933 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b10d84-975e-49bc-8acf-fa781c3f7014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:48.939564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b10d84-975e-49bc-8acf-fa781c3f7014 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:48.939931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b10d84-975e-49bc-8acf-fa781c3f7014 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:48.940202 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b10d84-975e-49bc-8acf-fa781c3f7014 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:49.012778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:49.032632 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b10d84-975e-49bc-8acf-fa781c3f7014 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:49.035459 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b10d84-975e-49bc-8acf-fa781c3f7014 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:49.186101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 524/1062] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:40:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 12 23:40:49.188994 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141956a4-75f9-4603-89fa-2e29f138f791 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:49.263735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:49.337283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141956a4-75f9-4603-89fa-2e29f138f791 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:49.381692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e3025-5b48-4f49-a675-a2443b30f27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:49.382402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e3025-5b48-4f49-a675-a2443b30f27e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:49.382684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e3025-5b48-4f49-a675-a2443b30f27e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:49.382943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e3025-5b48-4f49-a675-a2443b30f27e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:49.395436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e3025-5b48-4f49-a675-a2443b30f27e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:49.396933 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e3025-5b48-4f49-a675-a2443b30f27e None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:49.428988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-345e3025-5b48-4f49-a675-a2443b30f27e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:49.428988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:49.428988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:49.428988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:49.428988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:49.428988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:49.428988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:49.428988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:49.428988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:49.428988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:49.428988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:49.428988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:49.428988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:49.428988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:49.428988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:49.428988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:49.430709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:49.430709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:49.430709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:49.430709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:49.430709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:49.430709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:49.430709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:49.430709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:49.430709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:49.430709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:49.430709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:49.430709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:49.430709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:49.430709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:49.430709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:49.430709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:49.430709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:49.438026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:49.438026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:49.438026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:49.438026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 539/1063] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:49.441661 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b10d84-975e-49bc-8acf-fa781c3f7014 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:49.615011 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:49.630933 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b10d84-975e-49bc-8acf-fa781c3f7014 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:49.683798 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca11916-a244-4cb5-ad14-44410a01b46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:49.684732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca11916-a244-4cb5-ad14-44410a01b46d None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:49.685013 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca11916-a244-4cb5-ad14-44410a01b46d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:49.685312 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca11916-a244-4cb5-ad14-44410a01b46d None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:49.686369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca11916-a244-4cb5-ad14-44410a01b46d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:49.686813 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca11916-a244-4cb5-ad14-44410a01b46d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:49.688968 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca11916-a244-4cb5-ad14-44410a01b46d None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:49.709407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 525/1064] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:49.905501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3210f-de0f-4d01-aadd-03565d0a6717 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:49.905792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3210f-de0f-4d01-aadd-03565d0a6717 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:49.906068 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3210f-de0f-4d01-aadd-03565d0a6717 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:49.907725 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 540/1065] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:49.914351 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de5295-dcff-4f5b-b763-8ced10773651 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:49.914351 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de5295-dcff-4f5b-b763-8ced10773651 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:49.914351 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de5295-dcff-4f5b-b763-8ced10773651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:49.936725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-95de5295-dcff-4f5b-b763-8ced10773651 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:49.937968 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-95de5295-dcff-4f5b-b763-8ced10773651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:50.030461 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 526/1066] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:50.296366 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3210f-de0f-4d01-aadd-03565d0a6717 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:50.414833 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3210f-de0f-4d01-aadd-03565d0a6717 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:50.426307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:50.458389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379b5c4-f55f-4821-895e-99c0ae152caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:50.459066 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379b5c4-f55f-4821-895e-99c0ae152caf None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:50.459343 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379b5c4-f55f-4821-895e-99c0ae152caf None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:50.459614 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379b5c4-f55f-4821-895e-99c0ae152caf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:50.472668 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379b5c4-f55f-4821-895e-99c0ae152caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:40:50.477826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-a379b5c4-f55f-4821-895e-99c0ae152caf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:40:50.477826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:50.477826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:50.477826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:50.477826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:50.477826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:50.477826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:50.477826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:50.477826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:50.477826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:50.477826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:50.477826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:50.477826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:40:50.477826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:40:50.477826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:40:50.477826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:40:50.479573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:40:50.479573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:40:50.479573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:40:50.479573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:40:50.479573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:50.479573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:50.479573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:50.479573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:50.479573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:50.479573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:50.479573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:50.479573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:50.479573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:50.479573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:50.479573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:50.479573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:50.481094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:50.481094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:50.481094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:50.481094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:50.481094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:40:50.481094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:40:50.481094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:40:50.481094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:40:50.481094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:40:50.481094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:40:50.481094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:40:50.481094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:50.481094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 541/1067] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:40:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:50.485803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de5295-dcff-4f5b-b763-8ced10773651 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:50.589626 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:50.615449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de5295-dcff-4f5b-b763-8ced10773651 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:50.655470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a4ed6-7866-4530-a012-9a2796b83967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:50.656114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a4ed6-7866-4530-a012-9a2796b83967 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:50.656431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a4ed6-7866-4530-a012-9a2796b83967 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:50.656784 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a4ed6-7866-4530-a012-9a2796b83967 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:50.657509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a4ed6-7866-4530-a012-9a2796b83967 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:50.657934 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a4ed6-7866-4530-a012-9a2796b83967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:50.659805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a4ed6-7866-4530-a012-9a2796b83967 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:50.672483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 527/1068] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:40:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:50.681125 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379b5c4-f55f-4821-895e-99c0ae152caf None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:50.794039 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379b5c4-f55f-4821-895e-99c0ae152caf None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:50.831978 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba71bb0-f207-4b7d-b22d-779fa07d8852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:50.832724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba71bb0-f207-4b7d-b22d-779fa07d8852 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:50.833077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba71bb0-f207-4b7d-b22d-779fa07d8852 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:50.833460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba71bb0-f207-4b7d-b22d-779fa07d8852 None admin] PATH_INFO: `/v3/users/3b847761d29a4e2ab24c912286588f08` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:50.834764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba71bb0-f207-4b7d-b22d-779fa07d8852 None admin] RBAC: Authorizing `identity:get_user(user_id=3b847761d29a4e2ab24c912286588f08)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:50.836363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba71bb0-f207-4b7d-b22d-779fa07d8852 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:50.838255 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 542/1069] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:40:50 2022] GET /identity/v3/users/3b847761d29a4e2ab24c912286588f08 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:50.844969 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a4ed6-7866-4530-a012-9a2796b83967 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:50.969160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a4ed6-7866-4530-a012-9a2796b83967 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:51.012337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb170a-4044-469f-814e-b434151fff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:51.013031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb170a-4044-469f-814e-b434151fff22 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:51.013310 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb170a-4044-469f-814e-b434151fff22 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:51.013587 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb170a-4044-469f-814e-b434151fff22 None admin] PATH_INFO: `/v3/projects/3cbbe9f822d942809c7136bcd226b2b5` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:51.015010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb170a-4044-469f-814e-b434151fff22 None admin] RBAC: Authorizing `identity:get_project(project_id=3cbbe9f822d942809c7136bcd226b2b5)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:51.016580 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb170a-4044-469f-814e-b434151fff22 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:51.018808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 528/1070] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:40:50 2022] GET /identity/v3/projects/3cbbe9f822d942809c7136bcd226b2b5 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:51.024672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba71bb0-f207-4b7d-b22d-779fa07d8852 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:51.046701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a6ab6-2360-48f3-8dff-ec27a3531177 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:51.047132 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a6ab6-2360-48f3-8dff-ec27a3531177 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:51.047616 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a6ab6-2360-48f3-8dff-ec27a3531177 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:51.049987 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 529/1071] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:40:51.056132 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606534a9-2041-48e6-bc92-30a51b5a7f4b None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:51.056634 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606534a9-2041-48e6-bc92-30a51b5a7f4b None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:51.057123 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606534a9-2041-48e6-bc92-30a51b5a7f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:51.063078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:51.086753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-606534a9-2041-48e6-bc92-30a51b5a7f4b None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:51.087972 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-606534a9-2041-48e6-bc92-30a51b5a7f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:51.092274 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:51.136722 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba71bb0-f207-4b7d-b22d-779fa07d8852 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:51.186320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 530/1072] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:51.194206 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0fcad-c0a7-4887-a6b4-5e83f58b4310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:51.194884 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0fcad-c0a7-4887-a6b4-5e83f58b4310 None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:51.195157 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0fcad-c0a7-4887-a6b4-5e83f58b4310 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:51.195423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0fcad-c0a7-4887-a6b4-5e83f58b4310 None admin] PATH_INFO: `/v3/projects/3cbbe9f822d942809c7136bcd226b2b5/users/3b847761d29a4e2ab24c912286588f08/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:51.197393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0fcad-c0a7-4887-a6b4-5e83f58b4310 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cbbe9f822d942809c7136bcd226b2b5, user_id=3b847761d29a4e2ab24c912286588f08, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:51.198821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0fcad-c0a7-4887-a6b4-5e83f58b4310 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:51.214388 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 543/1073] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:40:51 2022] PUT /identity/v3/projects/3cbbe9f822d942809c7136bcd226b2b5/users/3b847761d29a4e2ab24c912286588f08/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:40:51.456492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606534a9-2041-48e6-bc92-30a51b5a7f4b None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:51.560250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606534a9-2041-48e6-bc92-30a51b5a7f4b None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:51.596195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cba0ee-42d1-40af-8a54-72ea935b7496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:51.596834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cba0ee-42d1-40af-8a54-72ea935b7496 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:51.597107 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cba0ee-42d1-40af-8a54-72ea935b7496 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:51.597399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cba0ee-42d1-40af-8a54-72ea935b7496 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:51.605982 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:51.609735 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cba0ee-42d1-40af-8a54-72ea935b7496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:40:51.614757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-68cba0ee-42d1-40af-8a54-72ea935b7496 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:40:51.614757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:51.614757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:51.614757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:51.614757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:51.614757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:51.614757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:51.614757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:51.614757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:51.614757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:51.614757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:51.614757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:51.614757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:40:51.614757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:40:51.614757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:40:51.614757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:40:51.617850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:40:51.617850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:40:51.617850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:40:51.617850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:40:51.617850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:51.617850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:51.617850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:51.617850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:51.617850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:51.617850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:51.617850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:51.617850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:51.617850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:51.617850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:51.617850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:51.617850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:51.618694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:51.618694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:51.618694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:51.618694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:51.618694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:40:51.618694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:40:51.618694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:40:51.618694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:40:51.618694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:40:51.618694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:40:51.618694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:40:51.618694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:51.618694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 531/1074] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 12 23:40:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:51.622692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0fcad-c0a7-4887-a6b4-5e83f58b4310 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:51.725164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:51.734119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0fcad-c0a7-4887-a6b4-5e83f58b4310 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:51.771241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db630e-f165-4a8c-b8ef-4e348ecc2cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:51.771861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db630e-f165-4a8c-b8ef-4e348ecc2cac None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:51.772128 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db630e-f165-4a8c-b8ef-4e348ecc2cac None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:51.772395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db630e-f165-4a8c-b8ef-4e348ecc2cac None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:51.773058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db630e-f165-4a8c-b8ef-4e348ecc2cac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:51.773393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db630e-f165-4a8c-b8ef-4e348ecc2cac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:51.774753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db630e-f165-4a8c-b8ef-4e348ecc2cac None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:51.783600 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 544/1075] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 12 23:40:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:51.789577 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cba0ee-42d1-40af-8a54-72ea935b7496 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:51.894648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cba0ee-42d1-40af-8a54-72ea935b7496 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:51.930205 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c174ece-022c-4823-a02c-8be51258a5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:51.930835 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c174ece-022c-4823-a02c-8be51258a5e3 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:51.931125 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c174ece-022c-4823-a02c-8be51258a5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:51.931395 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c174ece-022c-4823-a02c-8be51258a5e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:51.943124 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c174ece-022c-4823-a02c-8be51258a5e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:51.944601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c174ece-022c-4823-a02c-8be51258a5e3 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:51.960332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-6c174ece-022c-4823-a02c-8be51258a5e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:51.960332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:51.960332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:51.960332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:51.960332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:51.960332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:51.960332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:51.960332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:51.960332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:51.960332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:51.960332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:51.960332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:51.960332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:51.960332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:51.960332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:51.960332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:51.961422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:51.961422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:51.961422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:51.961422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:51.961422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:51.961422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:51.961422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:51.961422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:51.961422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:51.961422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:51.961422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:51.961422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:51.961422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:51.961422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:51.961422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:51.961422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:51.961422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:51.962377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:51.962377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:51.962377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:51.962377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 532/1076] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:51.967678 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db630e-f165-4a8c-b8ef-4e348ecc2cac None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:52.078368 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db630e-f165-4a8c-b8ef-4e348ecc2cac None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:52.137895 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef3a74-0d40-4db9-b293-bb05fc114649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:52.138978 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef3a74-0d40-4db9-b293-bb05fc114649 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:52.139470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef3a74-0d40-4db9-b293-bb05fc114649 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:52.140091 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef3a74-0d40-4db9-b293-bb05fc114649 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:52.141381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef3a74-0d40-4db9-b293-bb05fc114649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:52.141882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef3a74-0d40-4db9-b293-bb05fc114649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:52.144639 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef3a74-0d40-4db9-b293-bb05fc114649 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:52.166995 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 545/1077] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:52.173610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c174ece-022c-4823-a02c-8be51258a5e3 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:52.264056 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:52.347873 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c174ece-022c-4823-a02c-8be51258a5e3 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:52.407737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110d21e-54b9-4d1d-9485-ae58f7618f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:52.408832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110d21e-54b9-4d1d-9485-ae58f7618f38 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:52.409327 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110d21e-54b9-4d1d-9485-ae58f7618f38 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:52.409852 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110d21e-54b9-4d1d-9485-ae58f7618f38 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:52.424656 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110d21e-54b9-4d1d-9485-ae58f7618f38 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:52.427462 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110d21e-54b9-4d1d-9485-ae58f7618f38 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:52.444031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-3110d21e-54b9-4d1d-9485-ae58f7618f38 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:40:52.444031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:52.444031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:52.444031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:52.444031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:52.444031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:52.444031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:52.444031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:52.444031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:52.444031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:52.444031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:52.444031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:52.444031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:40:52.444031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:40:52.444031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:40:52.444031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:52.445134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:52.446137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:52.446137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:52.446137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:40:52.446137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:40:52.446137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:40:52.446137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:40:52.446137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:40:52.446137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:40:52.446137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:40:52.446137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:52.446137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 533/1078] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 23:40:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:52.451382 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef3a74-0d40-4db9-b293-bb05fc114649 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:52.473390 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:52.566041 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef3a74-0d40-4db9-b293-bb05fc114649 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:52.600372 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96530de-7ffb-4c75-94ba-cbd19457ae28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:52.600905 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96530de-7ffb-4c75-94ba-cbd19457ae28 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:52.601187 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96530de-7ffb-4c75-94ba-cbd19457ae28 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:52.601493 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96530de-7ffb-4c75-94ba-cbd19457ae28 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:52.602241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96530de-7ffb-4c75-94ba-cbd19457ae28 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:52.602551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96530de-7ffb-4c75-94ba-cbd19457ae28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:52.603991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96530de-7ffb-4c75-94ba-cbd19457ae28 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:52.623101 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 546/1079] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 23:40:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:52.629588 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110d21e-54b9-4d1d-9485-ae58f7618f38 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:52.765160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110d21e-54b9-4d1d-9485-ae58f7618f38 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:52.787708 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:52.825723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd19e61-f76a-430f-9e7f-0bc665e936e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:52.826761 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd19e61-f76a-430f-9e7f-0bc665e936e4 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:52.827280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd19e61-f76a-430f-9e7f-0bc665e936e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:52.827753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd19e61-f76a-430f-9e7f-0bc665e936e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:52.846873 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd19e61-f76a-430f-9e7f-0bc665e936e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:52.849610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd19e61-f76a-430f-9e7f-0bc665e936e4 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:52.875758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-4fd19e61-f76a-430f-9e7f-0bc665e936e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:52.875758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:52.875758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:52.875758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:52.875758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:52.875758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:52.875758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:52.875758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:52.875758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:52.875758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:52.875758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:52.875758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:52.875758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:52.875758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:52.875758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:52.875758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:52.876871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:52.876871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:52.876871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:52.876871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:52.876871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:52.876871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:52.876871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:52.876871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:52.876871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:52.876871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:52.876871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:52.876871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:52.876871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:52.876871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:52.876871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:52.876871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:52.876871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:52.878072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:52.878072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:52.878072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:52.878072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 534/1080] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:52.886372 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96530de-7ffb-4c75-94ba-cbd19457ae28 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:52.968178 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:52.992462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96530de-7ffb-4c75-94ba-cbd19457ae28 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:53.027399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716499b-55b2-4c5e-9a12-4c825917293b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:53.028013 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716499b-55b2-4c5e-9a12-4c825917293b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:53.028300 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716499b-55b2-4c5e-9a12-4c825917293b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:53.028570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716499b-55b2-4c5e-9a12-4c825917293b None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:53.029226 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716499b-55b2-4c5e-9a12-4c825917293b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:53.029553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716499b-55b2-4c5e-9a12-4c825917293b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:53.030988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716499b-55b2-4c5e-9a12-4c825917293b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:53.044115 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 547/1081] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:53.050526 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd19e61-f76a-430f-9e7f-0bc665e936e4 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:53.173679 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd19e61-f76a-430f-9e7f-0bc665e936e4 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:53.210994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b5e25-dfa0-40be-9c67-d91b3516d954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:53.211634 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b5e25-dfa0-40be-9c67-d91b3516d954 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:53.211908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b5e25-dfa0-40be-9c67-d91b3516d954 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:53.212175 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b5e25-dfa0-40be-9c67-d91b3516d954 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:53.219932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b5e25-dfa0-40be-9c67-d91b3516d954 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:53.221428 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b5e25-dfa0-40be-9c67-d91b3516d954 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:53.244892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-507b5e25-dfa0-40be-9c67-d91b3516d954 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:53.244892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:53.244892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:53.244892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:53.244892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:53.244892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:53.244892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:53.244892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:53.244892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:53.244892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:53.244892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:53.244892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:53.244892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:40:53.244892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:40:53.244892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:40:53.245952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:40:53.245952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:53.245952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:53.245952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:53.245952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:53.245952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:53.245952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:53.245952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:53.245952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:53.245952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:53.245952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:53.245952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:53.245952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:53.245952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:53.245952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:53.245952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:53.245952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:53.247337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:40:53.247337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:40:53.247337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:40:53.247337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:40:53.247337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:40:53.247337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:40:53.247337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:53.247337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:53.247337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 535/1082] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:40:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:53.252340 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716499b-55b2-4c5e-9a12-4c825917293b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:53.412119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716499b-55b2-4c5e-9a12-4c825917293b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:53.414733 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8f5e7-2b96-401a-8894-4543ec1ccb1d None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:53.415204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8f5e7-2b96-401a-8894-4543ec1ccb1d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:53.415637 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8f5e7-2b96-401a-8894-4543ec1ccb1d None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:53.417519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 536/1083] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:53.425649 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb82bab-2483-4182-8ae0-b34e2cd70a0b None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:53.425891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb82bab-2483-4182-8ae0-b34e2cd70a0b None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:53.426099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb82bab-2483-4182-8ae0-b34e2cd70a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:53.448554 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-3bb82bab-2483-4182-8ae0-b34e2cd70a0b None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:53.449767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-3bb82bab-2483-4182-8ae0-b34e2cd70a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:53.454608 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15adfea-9f20-409a-90ec-4953c2c7f92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:53.455301 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15adfea-9f20-409a-90ec-4953c2c7f92f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:53.455673 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15adfea-9f20-409a-90ec-4953c2c7f92f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:53.456009 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15adfea-9f20-409a-90ec-4953c2c7f92f None admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:53.456899 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15adfea-9f20-409a-90ec-4953c2c7f92f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:53.457257 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15adfea-9f20-409a-90ec-4953c2c7f92f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:53.459092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15adfea-9f20-409a-90ec-4953c2c7f92f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:53.462397 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:53.469196 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:53.476049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 548/1084] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:40:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:53.483266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15adfea-9f20-409a-90ec-4953c2c7f92f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:53.531782 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 537/1085] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:40:53.591480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15adfea-9f20-409a-90ec-4953c2c7f92f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:53.628058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e491133-1c0e-43b4-9b86-9abf582947e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:53.628824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e491133-1c0e-43b4-9b86-9abf582947e8 None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:53.629003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e491133-1c0e-43b4-9b86-9abf582947e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:53.629279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e491133-1c0e-43b4-9b86-9abf582947e8 None admin] PATH_INFO: `/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/4a87e18c89ff419f8e428e376d33462c/roles/3c77102a55e849eb882b984ac3e3dfb4` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:53.631533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e491133-1c0e-43b4-9b86-9abf582947e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=21118e9e4fa94603b2c0880dd0d5f5ba, user_id=4a87e18c89ff419f8e428e376d33462c, role_id=3c77102a55e849eb882b984ac3e3dfb4)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:53.633001 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e491133-1c0e-43b4-9b86-9abf582947e8 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:53.651881 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 549/1086] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:40:53 2022] PUT /identity/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/4a87e18c89ff419f8e428e376d33462c/roles/3c77102a55e849eb882b984ac3e3dfb4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:40:53.801794 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb82bab-2483-4182-8ae0-b34e2cd70a0b None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:53.923711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb82bab-2483-4182-8ae0-b34e2cd70a0b None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:53.960342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523088e8-b399-4740-ae20-49df174fa5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:53.960986 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523088e8-b399-4740-ae20-49df174fa5c1 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:53.961259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523088e8-b399-4740-ae20-49df174fa5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:53.961545 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523088e8-b399-4740-ae20-49df174fa5c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:53.972654 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523088e8-b399-4740-ae20-49df174fa5c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:40:53.977808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-523088e8-b399-4740-ae20-49df174fa5c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:40:53.977808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:53.977808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:53.977808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:53.977808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:53.977808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:53.977808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:53.977808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:53.977808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:53.977808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:53.977808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:53.977808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:53.977808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:40:53.977808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:40:53.977808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:40:53.977808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:40:53.978785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:40:53.978785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:40:53.978785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:40:53.978785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:40:53.978785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:53.978785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:53.978785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:53.978785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:53.978785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:53.978785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:53.978785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:53.978785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:53.978785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:53.978785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:53.978785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:53.978785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:53.979619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:53.979619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:53.979619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:53.979619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:53.979619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:40:53.979619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:40:53.979619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:40:53.979619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:40:53.979619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:40:53.979619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:40:53.979619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:40:53.979619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:53.979619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 538/1087] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:40:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:53.985319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e491133-1c0e-43b4-9b86-9abf582947e8 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:54.047619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:54.110044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e491133-1c0e-43b4-9b86-9abf582947e8 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:54.149514 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9921a9b-089b-4ce3-8ac1-6171d6fdea5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:54.150171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9921a9b-089b-4ce3-8ac1-6171d6fdea5f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:54.150452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9921a9b-089b-4ce3-8ac1-6171d6fdea5f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:54.150723 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9921a9b-089b-4ce3-8ac1-6171d6fdea5f None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:54.151449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9921a9b-089b-4ce3-8ac1-6171d6fdea5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:54.151759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9921a9b-089b-4ce3-8ac1-6171d6fdea5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:54.153224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9921a9b-089b-4ce3-8ac1-6171d6fdea5f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:54.164456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 550/1088] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:40:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:54.170633 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523088e8-b399-4740-ae20-49df174fa5c1 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:54.190724 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:54.322938 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523088e8-b399-4740-ae20-49df174fa5c1 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:54.360234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04fa5e-fb48-426d-91b7-d45309c84024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:54.360779 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04fa5e-fb48-426d-91b7-d45309c84024 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:54.361051 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04fa5e-fb48-426d-91b7-d45309c84024 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:54.361314 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04fa5e-fb48-426d-91b7-d45309c84024 None admin] PATH_INFO: `/v3/users/3b847761d29a4e2ab24c912286588f08` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:54.362533 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04fa5e-fb48-426d-91b7-d45309c84024 None admin] RBAC: Authorizing `identity:get_user(user_id=3b847761d29a4e2ab24c912286588f08)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:54.364016 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04fa5e-fb48-426d-91b7-d45309c84024 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:54.365663 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 539/1089] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:40:54 2022] GET /identity/v3/users/3b847761d29a4e2ab24c912286588f08 => generated 285 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:54.375236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9921a9b-089b-4ce3-8ac1-6171d6fdea5f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:54.494149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9921a9b-089b-4ce3-8ac1-6171d6fdea5f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:54.516189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:54.534922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa57c5-f185-4f41-8f49-b61a7b944a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:54.535556 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa57c5-f185-4f41-8f49-b61a7b944a20 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:54.535832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa57c5-f185-4f41-8f49-b61a7b944a20 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:54.536082 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa57c5-f185-4f41-8f49-b61a7b944a20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:54.615280 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa57c5-f185-4f41-8f49-b61a7b944a20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:54.616638 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa57c5-f185-4f41-8f49-b61a7b944a20 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:54.737227 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 551/1090] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:40:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:40:54.743910 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04fa5e-fb48-426d-91b7-d45309c84024 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:54.848274 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:54.869335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04fa5e-fb48-426d-91b7-d45309c84024 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:54.914292 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b53a9-f977-4ec6-96ba-77fa35050815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:54.914959 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b53a9-f977-4ec6-96ba-77fa35050815 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:54.915240 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b53a9-f977-4ec6-96ba-77fa35050815 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:54.915514 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b53a9-f977-4ec6-96ba-77fa35050815 None admin] PATH_INFO: `/v3/projects/3cbbe9f822d942809c7136bcd226b2b5` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:54.916701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b53a9-f977-4ec6-96ba-77fa35050815 None admin] RBAC: Authorizing `identity:get_project(project_id=3cbbe9f822d942809c7136bcd226b2b5)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:54.918211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b53a9-f977-4ec6-96ba-77fa35050815 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:54.919942 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 540/1091] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:40:54 2022] GET /identity/v3/projects/3cbbe9f822d942809c7136bcd226b2b5 => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:54.926403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa57c5-f185-4f41-8f49-b61a7b944a20 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:54.947173 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:55.042622 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa57c5-f185-4f41-8f49-b61a7b944a20 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:55.081912 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadba8ce-f259-43d0-9865-71b4f05d8d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:55.082525 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadba8ce-f259-43d0-9865-71b4f05d8d10 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:55.082798 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadba8ce-f259-43d0-9865-71b4f05d8d10 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:55.083065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadba8ce-f259-43d0-9865-71b4f05d8d10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:55.083797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadba8ce-f259-43d0-9865-71b4f05d8d10 None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.project.id=3cbbe9f822d942809c7136bcd226b2b5, user.id=3b847761d29a4e2ab24c912286588f08) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:55.084105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadba8ce-f259-43d0-9865-71b4f05d8d10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:55.085551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadba8ce-f259-43d0-9865-71b4f05d8d10 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:55.091719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 552/1092] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:40:54 2022] GET /identity/v3/role_assignments?user.id=3b847761d29a4e2ab24c912286588f08&scope.project.id=3cbbe9f822d942809c7136bcd226b2b5&role.id=440092230f024959a90e846ab29c6367 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:55.861122 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55494a-4004-436f-8ac0-51849f944bb9 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:55.861771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55494a-4004-436f-8ac0-51849f944bb9 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:55.861771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55494a-4004-436f-8ac0-51849f944bb9 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:55.863022 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 541/1093] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:55.869383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d71c8a-6895-46ef-9721-692276360df4 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:55.869973 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d71c8a-6895-46ef-9721-692276360df4 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:55.869973 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d71c8a-6895-46ef-9721-692276360df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:55.890335 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-61d71c8a-6895-46ef-9721-692276360df4 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:55.892975 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-61d71c8a-6895-46ef-9721-692276360df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:55.975037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 553/1094] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:56.242604 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55494a-4004-436f-8ac0-51849f944bb9 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:56.352487 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55494a-4004-436f-8ac0-51849f944bb9 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:56.388688 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840a43c-b038-4e05-ba08-9813efd06256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:56.389330 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840a43c-b038-4e05-ba08-9813efd06256 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:56.389631 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840a43c-b038-4e05-ba08-9813efd06256 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:56.390167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840a43c-b038-4e05-ba08-9813efd06256 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:56.401265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840a43c-b038-4e05-ba08-9813efd06256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:40:56.406133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-7840a43c-b038-4e05-ba08-9813efd06256 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:40:56.406133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:56.406133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:56.406133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:56.406133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:56.406133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:56.406133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:56.406133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:56.406133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:56.406133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:56.406133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:56.406133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:56.406133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:40:56.406133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:40:56.406133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:40:56.406133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:40:56.407304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:40:56.407304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:40:56.407304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:40:56.407304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:40:56.407304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:56.407304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:56.407304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:56.407304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:56.407304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:56.407304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:56.407304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:56.407304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:56.407304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:56.407304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:56.407304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:56.407304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:56.408159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:56.408159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:56.408159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:56.408159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:56.408159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:40:56.408159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:40:56.408159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:40:56.408159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:40:56.408159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:40:56.408159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:40:56.408159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 12 23:40:56.408159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:56.408159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 542/1095] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 12 23:40:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:56.414008 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d71c8a-6895-46ef-9721-692276360df4 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:56.430790 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:56.529904 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d71c8a-6895-46ef-9721-692276360df4 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:56.564991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656062d-d505-4cd7-8049-ae6fe8e977c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:56.565639 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656062d-d505-4cd7-8049-ae6fe8e977c7 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:56.565922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656062d-d505-4cd7-8049-ae6fe8e977c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:56.566194 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656062d-d505-4cd7-8049-ae6fe8e977c7 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:56.566854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656062d-d505-4cd7-8049-ae6fe8e977c7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:56.567168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656062d-d505-4cd7-8049-ae6fe8e977c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:56.568525 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656062d-d505-4cd7-8049-ae6fe8e977c7 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:56.577037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 554/1096] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 12 23:40:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:56.583204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840a43c-b038-4e05-ba08-9813efd06256 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:56.596401 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:56.688282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840a43c-b038-4e05-ba08-9813efd06256 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:56.722933 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdf1ef-022b-4fa2-9e1b-cf66a9922c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:56.723563 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdf1ef-022b-4fa2-9e1b-cf66a9922c24 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:56.723840 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdf1ef-022b-4fa2-9e1b-cf66a9922c24 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:56.724107 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdf1ef-022b-4fa2-9e1b-cf66a9922c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:56.734681 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdf1ef-022b-4fa2-9e1b-cf66a9922c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:56.736160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdf1ef-022b-4fa2-9e1b-cf66a9922c24 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:56.751625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-8bbdf1ef-022b-4fa2-9e1b-cf66a9922c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:56.751625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:56.751625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:56.751625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:56.751625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:56.751625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:56.751625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:56.751625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:56.751625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:56.751625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:56.751625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:56.751625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:56.751625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:56.751625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:56.751625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:56.751625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:56.752829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:56.752829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:56.752829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:56.752829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:56.752829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:56.752829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:56.752829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:56.752829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:56.752829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:56.752829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:56.752829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:56.752829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:56.752829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:56.752829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:56.752829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:56.752829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:56.752829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:56.753774 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:56.753774 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:56.753774 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:56.753774 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 543/1097] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:56.758789 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656062d-d505-4cd7-8049-ae6fe8e977c7 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:56.844410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:56.871449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656062d-d505-4cd7-8049-ae6fe8e977c7 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:56.908636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc798287-e52c-4e86-9ddd-e9e1e0135a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:56.909248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc798287-e52c-4e86-9ddd-e9e1e0135a5b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:56.909560 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc798287-e52c-4e86-9ddd-e9e1e0135a5b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:56.909835 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc798287-e52c-4e86-9ddd-e9e1e0135a5b None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:56.910489 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc798287-e52c-4e86-9ddd-e9e1e0135a5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:56.910791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc798287-e52c-4e86-9ddd-e9e1e0135a5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:56.912161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc798287-e52c-4e86-9ddd-e9e1e0135a5b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:56.924883 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 555/1098] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:56.930705 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdf1ef-022b-4fa2-9e1b-cf66a9922c24 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:57.001713 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:57.047515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdf1ef-022b-4fa2-9e1b-cf66a9922c24 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:57.084170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f317c5-4579-461d-bf44-8bb37e5d9616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:57.084801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f317c5-4579-461d-bf44-8bb37e5d9616 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:57.085072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f317c5-4579-461d-bf44-8bb37e5d9616 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:57.085332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f317c5-4579-461d-bf44-8bb37e5d9616 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:57.093648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f317c5-4579-461d-bf44-8bb37e5d9616 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:57.095159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f317c5-4579-461d-bf44-8bb37e5d9616 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:57.106781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-e3f317c5-4579-461d-bf44-8bb37e5d9616 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:40:57.106781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:57.106781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:57.106781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:57.106781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:57.106781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:57.106781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:57.106781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:57.106781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:57.106781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:57.106781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:57.106781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:57.106781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:40:57.106781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:40:57.106781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:40:57.106781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:57.107954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:57.109007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:57.109007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:57.109007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:40:57.109007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:40:57.109007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:40:57.109007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:40:57.109007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:40:57.109007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:40:57.109007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 12 23:40:57.109007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:40:57.109007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 544/1099] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 12 23:40:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:57.114537 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc798287-e52c-4e86-9ddd-e9e1e0135a5b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:57.231212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc798287-e52c-4e86-9ddd-e9e1e0135a5b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:57.268786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b05f3-2175-40cd-afcc-ffb46fcf7da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:57.269371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b05f3-2175-40cd-afcc-ffb46fcf7da6 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:57.269666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b05f3-2175-40cd-afcc-ffb46fcf7da6 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:57.269947 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b05f3-2175-40cd-afcc-ffb46fcf7da6 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:57.270677 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b05f3-2175-40cd-afcc-ffb46fcf7da6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:57.270981 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b05f3-2175-40cd-afcc-ffb46fcf7da6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:57.272413 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b05f3-2175-40cd-afcc-ffb46fcf7da6 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:57.274320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:57.294154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 556/1100] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 12 23:40:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:57.300288 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f317c5-4579-461d-bf44-8bb37e5d9616 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:57.332759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c79f42-b014-4dd2-9757-6ea4dc17f765 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:57.333076 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c79f42-b014-4dd2-9757-6ea4dc17f765 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:57.333311 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c79f42-b014-4dd2-9757-6ea4dc17f765 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:57.334710 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 557/1101] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:40:57.340021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70284a36-2084-4811-9d27-acb6466fbd32 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:57.340295 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70284a36-2084-4811-9d27-acb6466fbd32 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:57.340564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70284a36-2084-4811-9d27-acb6466fbd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:57.358973 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-70284a36-2084-4811-9d27-acb6466fbd32 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:40:57.360083 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-70284a36-2084-4811-9d27-acb6466fbd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:40:57.416864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f317c5-4579-461d-bf44-8bb37e5d9616 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:57.435058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 558/1102] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:40:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:40:57.444435 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:57.457762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c9f7b-c3a8-45c1-9a6c-b829912c88bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:57.458379 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c9f7b-c3a8-45c1-9a6c-b829912c88bf None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:57.458650 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c9f7b-c3a8-45c1-9a6c-b829912c88bf None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:57.458911 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c9f7b-c3a8-45c1-9a6c-b829912c88bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:57.528905 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c9f7b-c3a8-45c1-9a6c-b829912c88bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:57.530428 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c9f7b-c3a8-45c1-9a6c-b829912c88bf None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:57.644777 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 545/1103] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:40:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:40:57.650874 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70284a36-2084-4811-9d27-acb6466fbd32 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:57.699942 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c9f7b-c3a8-45c1-9a6c-b829912c88bf None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:57.724983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:57.758263 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70284a36-2084-4811-9d27-acb6466fbd32 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:57.782868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:57.797199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df7015-7b9f-4d3f-bff5-706bd3ee676f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:57.797894 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df7015-7b9f-4d3f-bff5-706bd3ee676f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:57.798176 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df7015-7b9f-4d3f-bff5-706bd3ee676f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:57.798449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df7015-7b9f-4d3f-bff5-706bd3ee676f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:57.809829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df7015-7b9f-4d3f-bff5-706bd3ee676f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:57.811701 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df7015-7b9f-4d3f-bff5-706bd3ee676f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:57.813484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c9f7b-c3a8-45c1-9a6c-b829912c88bf None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:57.827557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-25df7015-7b9f-4d3f-bff5-706bd3ee676f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:57.827557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:57.827557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:57.827557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:57.827557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:57.827557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:57.827557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:57.827557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:57.827557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:57.827557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:57.827557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:57.827557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:57.827557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:40:57.827557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:40:57.827557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:40:57.827557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:40:57.829332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:57.829332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:57.829332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:57.829332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:57.829332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:57.829332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:57.829332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:57.829332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:57.829332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:57.829332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:57.829332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:57.829332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:57.829332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:57.829332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:57.829332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:57.829332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:57.829332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:40:57.831073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:40:57.831073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:40:57.831073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:57.831073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 559/1104] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:40:57.834799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df7015-7b9f-4d3f-bff5-706bd3ee676f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:57.857819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cd49f-bd23-404d-88cd-77ba810c1c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:57.861476 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cd49f-bd23-404d-88cd-77ba810c1c1f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:57.862000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cd49f-bd23-404d-88cd-77ba810c1c1f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:57.862419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cd49f-bd23-404d-88cd-77ba810c1c1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:57.865621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848cd49f-bd23-404d-88cd-77ba810c1c1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:57.868260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848cd49f-bd23-404d-88cd-77ba810c1c1f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:57.875552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 546/1105] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:40:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:40:57.882062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cd49f-bd23-404d-88cd-77ba810c1c1f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:57.949276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df7015-7b9f-4d3f-bff5-706bd3ee676f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:57.988008 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17035b7d-0817-4d66-964a-68d72648b6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:57.988652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17035b7d-0817-4d66-964a-68d72648b6f5 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:57.988927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17035b7d-0817-4d66-964a-68d72648b6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:57.989196 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17035b7d-0817-4d66-964a-68d72648b6f5 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:57.989923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17035b7d-0817-4d66-964a-68d72648b6f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:57.990230 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17035b7d-0817-4d66-964a-68d72648b6f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:57.991700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17035b7d-0817-4d66-964a-68d72648b6f5 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:57.993914 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:58.005914 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 560/1106] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:58.006323 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cd49f-bd23-404d-88cd-77ba810c1c1f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:58.012066 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17035b7d-0817-4d66-964a-68d72648b6f5 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:58.046638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319d26e-f6a3-4484-a90f-3e327d7dc99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:58.047259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319d26e-f6a3-4484-a90f-3e327d7dc99a None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:58.047532 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319d26e-f6a3-4484-a90f-3e327d7dc99a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:58.047792 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319d26e-f6a3-4484-a90f-3e327d7dc99a None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:58.048441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319d26e-f6a3-4484-a90f-3e327d7dc99a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:58.049374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:58.049967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319d26e-f6a3-4484-a90f-3e327d7dc99a None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:58.074536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 547/1107] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:40:57 2022] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:40:58.142097 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17035b7d-0817-4d66-964a-68d72648b6f5 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:58.183869 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c506e1-9970-4aa8-a172-3253d7a875af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:58.184538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c506e1-9970-4aa8-a172-3253d7a875af None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:58.184814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c506e1-9970-4aa8-a172-3253d7a875af None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:58.185092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c506e1-9970-4aa8-a172-3253d7a875af None admin] PATH_INFO: `/v3/projects/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:58.197456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c506e1-9970-4aa8-a172-3253d7a875af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:58.200269 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c506e1-9970-4aa8-a172-3253d7a875af None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:58.216432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-68c506e1-9970-4aa8-a172-3253d7a875af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:58.216432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:40:58.216432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:40:58.216432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:40:58.216432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:40:58.216432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:40:58.216432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:40:58.216432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:40:58.216432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:40:58.216432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:40:58.216432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:40:58.216432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:40:58.216432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:40:58.216432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:40:58.216432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:40:58.217918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:40:58.217918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:40:58.217918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:40:58.217918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:40:58.217918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:40:58.217918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:40:58.217918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:40:58.217918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:40:58.217918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:40:58.217918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:40:58.217918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:40:58.217918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:40:58.217918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:40:58.217918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:40:58.217918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:40:58.217918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:40:58.217918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:40:58.219455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:40:58.219455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:40:58.219455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:40:58.219455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:40:58.219455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:40:58.219455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:40:58.219455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:40:58.219455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:40:58.219455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 561/1108] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:40:58.224285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319d26e-f6a3-4484-a90f-3e327d7dc99a None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:58.339358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319d26e-f6a3-4484-a90f-3e327d7dc99a None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:58.374985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c7ecb-e3e6-4604-aa84-ca5923c44ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:58.375603 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c7ecb-e3e6-4604-aa84-ca5923c44ef5 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:58.375880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c7ecb-e3e6-4604-aa84-ca5923c44ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:58.376145 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c7ecb-e3e6-4604-aa84-ca5923c44ef5 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:58.376855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c7ecb-e3e6-4604-aa84-ca5923c44ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:58.377160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c7ecb-e3e6-4604-aa84-ca5923c44ef5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:58.378650 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c7ecb-e3e6-4604-aa84-ca5923c44ef5 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:58.391019 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 548/1109] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:40:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:40:58.397219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c506e1-9970-4aa8-a172-3253d7a875af None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:40:58.497808 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:40:58.505972 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c506e1-9970-4aa8-a172-3253d7a875af None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:40:58.548778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c7561-7ad4-45a6-b430-816c8aee71f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:40:58.549861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c7561-7ad4-45a6-b430-816c8aee71f0 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:40:58.550385 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c7561-7ad4-45a6-b430-816c8aee71f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:40:58.550862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c7561-7ad4-45a6-b430-816c8aee71f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:40:58.552219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c7561-7ad4-45a6-b430-816c8aee71f0 None admin] RBAC: Adding query filter params (role.id=3c77102a55e849eb882b984ac3e3dfb4, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=4a87e18c89ff419f8e428e376d33462c) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:40:58.552578 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c7561-7ad4-45a6-b430-816c8aee71f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:40:58.554876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c7561-7ad4-45a6-b430-816c8aee71f0 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:40:58.566026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 562/1110] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:40:58 2022] GET /identity/v3/role_assignments?user.id=4a87e18c89ff419f8e428e376d33462c&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=3c77102a55e849eb882b984ac3e3dfb4 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:00.293140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70664f03-3cea-4ef9-b82f-1688c71cb7d8 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:00.293749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70664f03-3cea-4ef9-b82f-1688c71cb7d8 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:00.293749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70664f03-3cea-4ef9-b82f-1688c71cb7d8 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:00.295062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 549/1111] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:41:00.300814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eed2a5-d1b5-40ec-9da2-6ec44bf6e22b None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:00.301311 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eed2a5-d1b5-40ec-9da2-6ec44bf6e22b None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:00.301311 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eed2a5-d1b5-40ec-9da2-6ec44bf6e22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:00.320505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-32eed2a5-d1b5-40ec-9da2-6ec44bf6e22b None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:41:00.321751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-32eed2a5-d1b5-40ec-9da2-6ec44bf6e22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:41:00.390815 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 563/1112] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:41:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:41:00.654245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70664f03-3cea-4ef9-b82f-1688c71cb7d8 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:00.664659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:00.777183 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70664f03-3cea-4ef9-b82f-1688c71cb7d8 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:00.819746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39907ab-4c00-4dee-afd1-6dbf8b226793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:00.820406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39907ab-4c00-4dee-afd1-6dbf8b226793 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:00.820680 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39907ab-4c00-4dee-afd1-6dbf8b226793 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:00.820951 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39907ab-4c00-4dee-afd1-6dbf8b226793 None admin] PATH_INFO: `/v3/roles/e4d659212810456798a60c1902537d7d` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:00.822411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39907ab-4c00-4dee-afd1-6dbf8b226793 None admin] RBAC: Authorizing `identity:get_role(role_id=e4d659212810456798a60c1902537d7d)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:00.823816 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39907ab-4c00-4dee-afd1-6dbf8b226793 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:00.825208 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 550/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:41:00 2022] GET /identity/v3/roles/e4d659212810456798a60c1902537d7d => generated 223 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:00.831503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eed2a5-d1b5-40ec-9da2-6ec44bf6e22b None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:00.938783 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:00.952944 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eed2a5-d1b5-40ec-9da2-6ec44bf6e22b None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:01.000205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b265ab8-e74f-4873-ad70-c8696de2158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:01.001289 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b265ab8-e74f-4873-ad70-c8696de2158e None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:01.001802 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b265ab8-e74f-4873-ad70-c8696de2158e None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:01.002266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b265ab8-e74f-4873-ad70-c8696de2158e None admin] PATH_INFO: `/v3/users/8e976a6342754133a92693232a3fbe55` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:01.020315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b265ab8-e74f-4873-ad70-c8696de2158e None admin] RBAC: Authorizing `identity:get_user(user_id=8e976a6342754133a92693232a3fbe55)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:01.021831 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b265ab8-e74f-4873-ad70-c8696de2158e None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:01.023623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 564/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:41:00 2022] GET /identity/v3/users/8e976a6342754133a92693232a3fbe55 => generated 286 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:01.029947 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39907ab-4c00-4dee-afd1-6dbf8b226793 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:01.120181 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:01.150833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39907ab-4c00-4dee-afd1-6dbf8b226793 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:01.188973 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b8035-6fd0-4d9f-be8f-380ca05f0dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:01.189537 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b8035-6fd0-4d9f-be8f-380ca05f0dea None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:01.189827 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b8035-6fd0-4d9f-be8f-380ca05f0dea None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:01.190098 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b8035-6fd0-4d9f-be8f-380ca05f0dea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:01.263538 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b8035-6fd0-4d9f-be8f-380ca05f0dea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:01.265090 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b8035-6fd0-4d9f-be8f-380ca05f0dea None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:01.342373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:01.369164 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 551/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:41:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:41:01.375909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b265ab8-e74f-4873-ad70-c8696de2158e None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:01.483111 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b265ab8-e74f-4873-ad70-c8696de2158e None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:01.519519 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a7a43-3baf-4d65-8cf9-7589bd6e68f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:01.520157 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a7a43-3baf-4d65-8cf9-7589bd6e68f5 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:01.520420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a7a43-3baf-4d65-8cf9-7589bd6e68f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:01.520681 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a7a43-3baf-4d65-8cf9-7589bd6e68f5 None admin] PATH_INFO: `/v3/projects/3cbbe9f822d942809c7136bcd226b2b5` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:01.521849 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a7a43-3baf-4d65-8cf9-7589bd6e68f5 None admin] RBAC: Authorizing `identity:get_project(project_id=3cbbe9f822d942809c7136bcd226b2b5)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:01.523277 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a7a43-3baf-4d65-8cf9-7589bd6e68f5 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:01.524936 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 565/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:41:01 2022] GET /identity/v3/projects/3cbbe9f822d942809c7136bcd226b2b5 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:01.531450 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b8035-6fd0-4d9f-be8f-380ca05f0dea None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:01.640808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b8035-6fd0-4d9f-be8f-380ca05f0dea None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:01.676611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a69308-3297-424a-a79d-b83835e78b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:01.677211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a69308-3297-424a-a79d-b83835e78b53 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:01.677511 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a69308-3297-424a-a79d-b83835e78b53 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:01.677775 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a69308-3297-424a-a79d-b83835e78b53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:01.678502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a69308-3297-424a-a79d-b83835e78b53 None admin] RBAC: Adding query filter params (role.id=e4d659212810456798a60c1902537d7d, scope.project.id=3cbbe9f822d942809c7136bcd226b2b5, user.id=8e976a6342754133a92693232a3fbe55) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:41:01.678805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a69308-3297-424a-a79d-b83835e78b53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:01.680246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a69308-3297-424a-a79d-b83835e78b53 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:01.686801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 552/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:41:01 2022] GET /identity/v3/role_assignments?user.id=8e976a6342754133a92693232a3fbe55&scope.project.id=3cbbe9f822d942809c7136bcd226b2b5&role.id=e4d659212810456798a60c1902537d7d => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:03.780869 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a82ea1-0e8d-4685-b4fe-5cc6b975cfc1 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:03.781491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a82ea1-0e8d-4685-b4fe-5cc6b975cfc1 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:03.781491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a82ea1-0e8d-4685-b4fe-5cc6b975cfc1 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:03.782789 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 566/1118] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:41:03.788184 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776ae6e-5ea5-4026-90ed-115f8f8156a2 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:03.788631 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776ae6e-5ea5-4026-90ed-115f8f8156a2 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:03.788720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776ae6e-5ea5-4026-90ed-115f8f8156a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:03.807245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-3776ae6e-5ea5-4026-90ed-115f8f8156a2 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:41:03.808434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-3776ae6e-5ea5-4026-90ed-115f8f8156a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:41:03.841222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:03.880899 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 553/1119] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:41:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:41:04.144230 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a82ea1-0e8d-4685-b4fe-5cc6b975cfc1 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:04.161846 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:04.258004 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a82ea1-0e8d-4685-b4fe-5cc6b975cfc1 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:04.293946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6fcb7-3312-431b-85a4-5f7925207f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:04.294573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6fcb7-3312-431b-85a4-5f7925207f39 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:04.294851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6fcb7-3312-431b-85a4-5f7925207f39 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:04.295119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6fcb7-3312-431b-85a4-5f7925207f39 None admin] PATH_INFO: `/v3/roles/e4d659212810456798a60c1902537d7d` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:04.296596 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6fcb7-3312-431b-85a4-5f7925207f39 None admin] RBAC: Authorizing `identity:get_role(role_id=e4d659212810456798a60c1902537d7d)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:04.297991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6fcb7-3312-431b-85a4-5f7925207f39 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:04.299324 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 567/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:41:04 2022] GET /identity/v3/roles/e4d659212810456798a60c1902537d7d => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:04.305897 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776ae6e-5ea5-4026-90ed-115f8f8156a2 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:04.412510 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776ae6e-5ea5-4026-90ed-115f8f8156a2 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:04.448242 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daaaaf-1eb1-483d-a1c6-fc6a3d24f5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:04.448875 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daaaaf-1eb1-483d-a1c6-fc6a3d24f5a1 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:04.449149 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daaaaf-1eb1-483d-a1c6-fc6a3d24f5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:04.449442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daaaaf-1eb1-483d-a1c6-fc6a3d24f5a1 None admin] PATH_INFO: `/v3/users/8e976a6342754133a92693232a3fbe55` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:04.450598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94daaaaf-1eb1-483d-a1c6-fc6a3d24f5a1 None admin] RBAC: Authorizing `identity:get_user(user_id=8e976a6342754133a92693232a3fbe55)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:04.452022 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94daaaaf-1eb1-483d-a1c6-fc6a3d24f5a1 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:04.453710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 554/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:41:04 2022] GET /identity/v3/users/8e976a6342754133a92693232a3fbe55 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:04.459901 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6fcb7-3312-431b-85a4-5f7925207f39 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:04.552730 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:04.574369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6fcb7-3312-431b-85a4-5f7925207f39 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:04.611628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b2779-273a-4765-b2b6-291b480ccf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:04.612277 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b2779-273a-4765-b2b6-291b480ccf8c None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:04.612550 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b2779-273a-4765-b2b6-291b480ccf8c None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:04.612825 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b2779-273a-4765-b2b6-291b480ccf8c None admin] PATH_INFO: `/v3/projects/3cbbe9f822d942809c7136bcd226b2b5` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:04.614046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b2779-273a-4765-b2b6-291b480ccf8c None admin] RBAC: Authorizing `identity:get_project(project_id=3cbbe9f822d942809c7136bcd226b2b5)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:04.615501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b2779-273a-4765-b2b6-291b480ccf8c None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:04.617195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 568/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:41:04 2022] GET /identity/v3/projects/3cbbe9f822d942809c7136bcd226b2b5 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:04.623728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daaaaf-1eb1-483d-a1c6-fc6a3d24f5a1 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:04.665020 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:04.738051 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daaaaf-1eb1-483d-a1c6-fc6a3d24f5a1 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:04.776591 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80c065-686a-4abd-a7c4-359e47ac7b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:04.777268 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80c065-686a-4abd-a7c4-359e47ac7b47 None admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:04.777574 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80c065-686a-4abd-a7c4-359e47ac7b47 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:04.777840 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80c065-686a-4abd-a7c4-359e47ac7b47 None admin] PATH_INFO: `/v3/projects/3cbbe9f822d942809c7136bcd226b2b5/users/8e976a6342754133a92693232a3fbe55/roles/e4d659212810456798a60c1902537d7d` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:04.780113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80c065-686a-4abd-a7c4-359e47ac7b47 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cbbe9f822d942809c7136bcd226b2b5, user_id=8e976a6342754133a92693232a3fbe55, role_id=e4d659212810456798a60c1902537d7d)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:04.781628 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80c065-686a-4abd-a7c4-359e47ac7b47 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:04.796161 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 555/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:41:04 2022] PUT /identity/v3/projects/3cbbe9f822d942809c7136bcd226b2b5/users/8e976a6342754133a92693232a3fbe55/roles/e4d659212810456798a60c1902537d7d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:41:06.898020 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2e49a-4728-4872-9b93-e11cb4c19843 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:06.898579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2e49a-4728-4872-9b93-e11cb4c19843 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:06.898579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2e49a-4728-4872-9b93-e11cb4c19843 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:06.899891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 569/1124] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:41:06.905443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0845e0-a58d-4259-95a1-b2f4b181a469 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:06.905860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0845e0-a58d-4259-95a1-b2f4b181a469 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:06.905982 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0845e0-a58d-4259-95a1-b2f4b181a469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:06.924504 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-1f0845e0-a58d-4259-95a1-b2f4b181a469 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:41:06.925731 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-1f0845e0-a58d-4259-95a1-b2f4b181a469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:41:06.996405 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 556/1125] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:41:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:41:07.257262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2e49a-4728-4872-9b93-e11cb4c19843 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:07.368034 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2e49a-4728-4872-9b93-e11cb4c19843 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:07.404247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbaa364-0b0e-45e8-ba88-7f100913362d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:07.404979 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaa364-0b0e-45e8-ba88-7f100913362d None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:07.405335 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaa364-0b0e-45e8-ba88-7f100913362d None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:07.405775 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaa364-0b0e-45e8-ba88-7f100913362d None admin] PATH_INFO: `/v3/roles/e4d659212810456798a60c1902537d7d` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:07.407860 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbaa364-0b0e-45e8-ba88-7f100913362d None admin] RBAC: Authorizing `identity:get_role(role_id=e4d659212810456798a60c1902537d7d)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:07.409299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbaa364-0b0e-45e8-ba88-7f100913362d None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:07.410844 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 570/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:41:07 2022] GET /identity/v3/roles/e4d659212810456798a60c1902537d7d => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:07.417250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0845e0-a58d-4259-95a1-b2f4b181a469 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:07.450176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:07.530028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0845e0-a58d-4259-95a1-b2f4b181a469 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:07.565264 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f588a1-5ff6-4ec4-be65-a4ec56c884c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:07.565923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f588a1-5ff6-4ec4-be65-a4ec56c884c5 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:07.566198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f588a1-5ff6-4ec4-be65-a4ec56c884c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:07.566464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f588a1-5ff6-4ec4-be65-a4ec56c884c5 None admin] PATH_INFO: `/v3/users/8e976a6342754133a92693232a3fbe55` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:07.567638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f588a1-5ff6-4ec4-be65-a4ec56c884c5 None admin] RBAC: Authorizing `identity:get_user(user_id=8e976a6342754133a92693232a3fbe55)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:07.569087 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f588a1-5ff6-4ec4-be65-a4ec56c884c5 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:07.570713 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 557/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:41:07 2022] GET /identity/v3/users/8e976a6342754133a92693232a3fbe55 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:07.576798 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbaa364-0b0e-45e8-ba88-7f100913362d None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:07.596997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:07.687122 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbaa364-0b0e-45e8-ba88-7f100913362d None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:07.724709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a4794-00cf-42db-919e-c498aa57dd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:07.725326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a4794-00cf-42db-919e-c498aa57dd8b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:07.725637 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a4794-00cf-42db-919e-c498aa57dd8b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:07.725907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a4794-00cf-42db-919e-c498aa57dd8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:07.800043 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a4794-00cf-42db-919e-c498aa57dd8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:07.801392 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a4794-00cf-42db-919e-c498aa57dd8b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:07.820823 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:07.903745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 571/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:41:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:41:07.910155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f588a1-5ff6-4ec4-be65-a4ec56c884c5 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:08.009000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:08.016603 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f588a1-5ff6-4ec4-be65-a4ec56c884c5 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:08.052338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f55a4f-d826-4b40-9997-bac131108e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:08.052875 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f55a4f-d826-4b40-9997-bac131108e1b None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:08.053151 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f55a4f-d826-4b40-9997-bac131108e1b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:08.053455 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f55a4f-d826-4b40-9997-bac131108e1b None admin] PATH_INFO: `/v3/projects/3cbbe9f822d942809c7136bcd226b2b5` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:08.054658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f55a4f-d826-4b40-9997-bac131108e1b None admin] RBAC: Authorizing `identity:get_project(project_id=3cbbe9f822d942809c7136bcd226b2b5)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:08.056115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f55a4f-d826-4b40-9997-bac131108e1b None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:08.057804 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 558/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:41:07 2022] GET /identity/v3/projects/3cbbe9f822d942809c7136bcd226b2b5 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:08.064762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a4794-00cf-42db-919e-c498aa57dd8b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:08.169369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a4794-00cf-42db-919e-c498aa57dd8b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:08.187828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:08.206008 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c668842-547d-442c-ac1c-40270b43ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:08.206612 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c668842-547d-442c-ac1c-40270b43ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:08.206884 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c668842-547d-442c-ac1c-40270b43ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:08.207144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c668842-547d-442c-ac1c-40270b43ffe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:08.207870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c668842-547d-442c-ac1c-40270b43ffe5 None admin] RBAC: Adding query filter params (role.id=e4d659212810456798a60c1902537d7d, scope.project.id=3cbbe9f822d942809c7136bcd226b2b5, user.id=8e976a6342754133a92693232a3fbe55) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:41:08.208170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c668842-547d-442c-ac1c-40270b43ffe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:08.209631 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c668842-547d-442c-ac1c-40270b43ffe5 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:08.215312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 572/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:41:08 2022] GET /identity/v3/role_assignments?user.id=8e976a6342754133a92693232a3fbe55&scope.project.id=3cbbe9f822d942809c7136bcd226b2b5&role.id=e4d659212810456798a60c1902537d7d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:10.364608 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a1229-f285-4100-b008-77a1be187a50 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:10.365323 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a1229-f285-4100-b008-77a1be187a50 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:10.365323 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a1229-f285-4100-b008-77a1be187a50 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:10.366891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 559/1131] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:41:10.373222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c90cf-b819-4802-8c85-f24622517c47 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:10.373697 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c90cf-b819-4802-8c85-f24622517c47 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:10.373786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c90cf-b819-4802-8c85-f24622517c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:10.394711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-211c90cf-b819-4802-8c85-f24622517c47 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:41:10.395904 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-211c90cf-b819-4802-8c85-f24622517c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:41:10.468511 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 573/1132] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:41:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:41:10.732797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a1229-f285-4100-b008-77a1be187a50 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:10.846021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a1229-f285-4100-b008-77a1be187a50 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:10.886496 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7c5b2-6a9b-44db-a9ae-db24a54b9057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:10.887152 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7c5b2-6a9b-44db-a9ae-db24a54b9057 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:10.887428 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7c5b2-6a9b-44db-a9ae-db24a54b9057 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:10.887702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7c5b2-6a9b-44db-a9ae-db24a54b9057 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:10.888843 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7c5b2-6a9b-44db-a9ae-db24a54b9057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:10.890503 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7c5b2-6a9b-44db-a9ae-db24a54b9057 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:10.892113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 560/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:41:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:10.898296 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c90cf-b819-4802-8c85-f24622517c47 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:11.027344 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c90cf-b819-4802-8c85-f24622517c47 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:11.041536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:11.067375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade2d53-a376-4d46-bfda-7b58bd4c5395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:11.067991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade2d53-a376-4d46-bfda-7b58bd4c5395 None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:11.068264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade2d53-a376-4d46-bfda-7b58bd4c5395 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:11.068530 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade2d53-a376-4d46-bfda-7b58bd4c5395 None admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:11.069186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade2d53-a376-4d46-bfda-7b58bd4c5395 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:11.070658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade2d53-a376-4d46-bfda-7b58bd4c5395 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:11.102301 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 574/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 23:41:10 2022] POST /identity/v3/projects => generated 311 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:41:13.306425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9ef66-d41a-473d-89cb-d6889469d553 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:13.306994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9ef66-d41a-473d-89cb-d6889469d553 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:13.306994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9ef66-d41a-473d-89cb-d6889469d553 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:13.308348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 561/1135] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:41:13.317660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd841acb-8acb-4298-9640-1d9f549366cb None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:13.318228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd841acb-8acb-4298-9640-1d9f549366cb None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:13.318455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd841acb-8acb-4298-9640-1d9f549366cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:13.341401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-bd841acb-8acb-4298-9640-1d9f549366cb None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:41:13.342614 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-bd841acb-8acb-4298-9640-1d9f549366cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:41:13.414240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 575/1136] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:41:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:41:13.680032 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9ef66-d41a-473d-89cb-d6889469d553 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:13.721317 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:13.797003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9ef66-d41a-473d-89cb-d6889469d553 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:13.834869 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe19541-4dfb-48f8-b472-e7572bc1ca74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:13.835502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe19541-4dfb-48f8-b472-e7572bc1ca74 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:13.835786 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe19541-4dfb-48f8-b472-e7572bc1ca74 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:13.836057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe19541-4dfb-48f8-b472-e7572bc1ca74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:13.837301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe19541-4dfb-48f8-b472-e7572bc1ca74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:13.838785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe19541-4dfb-48f8-b472-e7572bc1ca74 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:13.840399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 562/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:41:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:13.846804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd841acb-8acb-4298-9640-1d9f549366cb None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:13.953211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:13.961934 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd841acb-8acb-4298-9640-1d9f549366cb None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:13.997879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd31fd-248b-471b-bf0b-993dd666670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:13.998494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd31fd-248b-471b-bf0b-993dd666670c None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:13.998772 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd31fd-248b-471b-bf0b-993dd666670c None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:13.999073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd31fd-248b-471b-bf0b-993dd666670c None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:13.999729 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd31fd-248b-471b-bf0b-993dd666670c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:14.001156 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd31fd-248b-471b-bf0b-993dd666670c None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:14.025702 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 576/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:41:13 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:41:16.234666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ba964-e0b4-4f9d-bdab-d3bc878a343e None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:16.235229 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ba964-e0b4-4f9d-bdab-d3bc878a343e None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:16.235229 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ba964-e0b4-4f9d-bdab-d3bc878a343e None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:16.236578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 563/1139] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:41:16.242321 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6195729-38a1-41a4-b482-baf3b913f08b None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:16.242799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6195729-38a1-41a4-b482-baf3b913f08b None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:16.242894 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6195729-38a1-41a4-b482-baf3b913f08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:16.267758 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-e6195729-38a1-41a4-b482-baf3b913f08b None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:41:16.268971 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-e6195729-38a1-41a4-b482-baf3b913f08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:41:16.347246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 577/1140] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:41:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:41:16.621819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ba964-e0b4-4f9d-bdab-d3bc878a343e None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:16.736926 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:16.742385 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ba964-e0b4-4f9d-bdab-d3bc878a343e None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:16.784692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd398d4-60ae-4ccb-a65d-1070a51748c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:16.785308 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd398d4-60ae-4ccb-a65d-1070a51748c5 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:16.785619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd398d4-60ae-4ccb-a65d-1070a51748c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:16.785886 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd398d4-60ae-4ccb-a65d-1070a51748c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:16.797826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd398d4-60ae-4ccb-a65d-1070a51748c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:41:16.802570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-4cd398d4-60ae-4ccb-a65d-1070a51748c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:41:16.802570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:41:16.802570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:41:16.802570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:41:16.802570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:41:16.802570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:41:16.802570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:41:16.802570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:41:16.802570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:41:16.802570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:41:16.802570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:41:16.802570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:41:16.802570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:41:16.802570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:41:16.802570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:41:16.802570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:41:16.803598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:41:16.803598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:41:16.803598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:41:16.803598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:41:16.803598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:41:16.803598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:41:16.803598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:41:16.803598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:41:16.803598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:41:16.803598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:41:16.803598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:41:16.803598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:41:16.803598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:41:16.803598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:41:16.803598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:41:16.803598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:41:16.804448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:41:16.804448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:41:16.804448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:41:16.804448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:41:16.804448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:41:16.804448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:41:16.804448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:41:16.804448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:41:16.804448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:41:16.804448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:41:16.804448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:41:16.804448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:41:16.804448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 564/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:41:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:41:16.810307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6195729-38a1-41a4-b482-baf3b913f08b None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:16.900347 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:16.921202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6195729-38a1-41a4-b482-baf3b913f08b None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:16.958067 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97c38-ea33-4e6f-acda-ceb3bd439196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:16.958751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97c38-ea33-4e6f-acda-ceb3bd439196 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:16.959029 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97c38-ea33-4e6f-acda-ceb3bd439196 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:16.959266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97c38-ea33-4e6f-acda-ceb3bd439196 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:16.959966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b97c38-ea33-4e6f-acda-ceb3bd439196 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:41:16.960267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b97c38-ea33-4e6f-acda-ceb3bd439196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:16.961837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b97c38-ea33-4e6f-acda-ceb3bd439196 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:16.971610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 578/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:41:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:16.978200 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd398d4-60ae-4ccb-a65d-1070a51748c5 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:17.093673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd398d4-60ae-4ccb-a65d-1070a51748c5 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:17.132101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053a5a7-5950-495b-865b-41b31114cb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:17.132736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053a5a7-5950-495b-865b-41b31114cb4a None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:17.133011 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053a5a7-5950-495b-865b-41b31114cb4a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:17.133286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053a5a7-5950-495b-865b-41b31114cb4a None admin] PATH_INFO: `/v3/users/69de6774bc414b2a955ab9c653ef8883` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:17.148323 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053a5a7-5950-495b-865b-41b31114cb4a None admin] RBAC: Authorizing `identity:get_user(user_id=69de6774bc414b2a955ab9c653ef8883)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:17.149844 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053a5a7-5950-495b-865b-41b31114cb4a None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:17.151599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 565/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:41:16 2022] GET /identity/v3/users/69de6774bc414b2a955ab9c653ef8883 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:17.157825 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97c38-ea33-4e6f-acda-ceb3bd439196 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:17.264002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97c38-ea33-4e6f-acda-ceb3bd439196 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:17.298730 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973d417-5145-4d4b-a7c5-53b6109c361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:17.299338 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973d417-5145-4d4b-a7c5-53b6109c361b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:17.299612 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973d417-5145-4d4b-a7c5-53b6109c361b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:17.299880 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973d417-5145-4d4b-a7c5-53b6109c361b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:17.313284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:17.368878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973d417-5145-4d4b-a7c5-53b6109c361b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:17.370357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973d417-5145-4d4b-a7c5-53b6109c361b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:17.471771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 579/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:41:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:41:17.478079 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053a5a7-5950-495b-865b-41b31114cb4a None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:17.499034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:17.584138 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053a5a7-5950-495b-865b-41b31114cb4a None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:17.619060 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674d3a7-a7c0-4c1b-be27-0e1c40c8d894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:17.619686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674d3a7-a7c0-4c1b-be27-0e1c40c8d894 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:17.619960 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674d3a7-a7c0-4c1b-be27-0e1c40c8d894 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:17.620231 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674d3a7-a7c0-4c1b-be27-0e1c40c8d894 None admin] PATH_INFO: `/v3/projects/24b13bf3a530476683cf296b816a9c8e` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:17.621389 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674d3a7-a7c0-4c1b-be27-0e1c40c8d894 None admin] RBAC: Authorizing `identity:get_project(project_id=24b13bf3a530476683cf296b816a9c8e)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:17.622851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674d3a7-a7c0-4c1b-be27-0e1c40c8d894 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:17.624583 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 566/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:41:17 2022] GET /identity/v3/projects/24b13bf3a530476683cf296b816a9c8e => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:17.631140 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973d417-5145-4d4b-a7c5-53b6109c361b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:17.676876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:17.743990 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973d417-5145-4d4b-a7c5-53b6109c361b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:17.778711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8011b1-c673-48c5-810e-7708f7e01296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:17.779309 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8011b1-c673-48c5-810e-7708f7e01296 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:17.779584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8011b1-c673-48c5-810e-7708f7e01296 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:17.779847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8011b1-c673-48c5-810e-7708f7e01296 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:17.780595 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8011b1-c673-48c5-810e-7708f7e01296 None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.project.id=24b13bf3a530476683cf296b816a9c8e, user.id=69de6774bc414b2a955ab9c653ef8883) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:41:17.780897 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8011b1-c673-48c5-810e-7708f7e01296 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:17.782334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8011b1-c673-48c5-810e-7708f7e01296 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:17.787830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 580/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:41:17 2022] GET /identity/v3/role_assignments?user.id=69de6774bc414b2a955ab9c653ef8883&scope.project.id=24b13bf3a530476683cf296b816a9c8e&role.id=440092230f024959a90e846ab29c6367 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:19.886639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805d0f3-e0dd-489c-b84b-8b4c5814f4f4 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:19.887233 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805d0f3-e0dd-489c-b84b-8b4c5814f4f4 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:19.887233 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805d0f3-e0dd-489c-b84b-8b4c5814f4f4 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:19.888517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 567/1147] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:41:19.894319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef3a45-ed0a-40fe-b792-78944fb8066f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:19.894942 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef3a45-ed0a-40fe-b792-78944fb8066f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:19.895040 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef3a45-ed0a-40fe-b792-78944fb8066f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:19.916981 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-0aef3a45-ed0a-40fe-b792-78944fb8066f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:41:19.918363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0aef3a45-ed0a-40fe-b792-78944fb8066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:41:19.989837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 581/1148] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:41:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:41:20.253095 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805d0f3-e0dd-489c-b84b-8b4c5814f4f4 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:20.340607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:20.363965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805d0f3-e0dd-489c-b84b-8b4c5814f4f4 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:20.404308 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa1f9b-0c54-419e-82dc-28ba40d5931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:20.404601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa1f9b-0c54-419e-82dc-28ba40d5931a None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:20.404873 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa1f9b-0c54-419e-82dc-28ba40d5931a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:20.405140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa1f9b-0c54-419e-82dc-28ba40d5931a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:20.416059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa1f9b-0c54-419e-82dc-28ba40d5931a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:41:20.420828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-3baa1f9b-0c54-419e-82dc-28ba40d5931a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:41:20.420828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:41:20.420828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:41:20.420828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:41:20.420828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:41:20.420828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:41:20.420828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:41:20.420828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:41:20.420828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:41:20.420828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:41:20.420828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:41:20.420828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:41:20.420828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:41:20.420828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:41:20.420828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:41:20.420828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:41:20.422097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:41:20.422097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:41:20.422097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:41:20.422097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:41:20.422097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:41:20.422097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:41:20.422097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:41:20.422097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:41:20.422097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:41:20.422097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:41:20.422097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:41:20.422097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:41:20.422097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:41:20.422097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:41:20.422097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:41:20.422097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:41:20.422994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:41:20.422994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:41:20.422994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:41:20.422994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:41:20.422994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:41:20.422994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:41:20.422994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:41:20.422994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:41:20.422994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:41:20.422994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:41:20.422994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:41:20.422994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:41:20.422994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 568/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:41:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:41:20.429012 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef3a45-ed0a-40fe-b792-78944fb8066f None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:20.466608 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:20.536906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef3a45-ed0a-40fe-b792-78944fb8066f None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:20.572429 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95ad9c-5588-4f59-bcff-39a82f6e556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:20.573040 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95ad9c-5588-4f59-bcff-39a82f6e556b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:20.573310 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95ad9c-5588-4f59-bcff-39a82f6e556b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:20.573618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95ad9c-5588-4f59-bcff-39a82f6e556b None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:20.574267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95ad9c-5588-4f59-bcff-39a82f6e556b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:41:20.574566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95ad9c-5588-4f59-bcff-39a82f6e556b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:20.575939 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95ad9c-5588-4f59-bcff-39a82f6e556b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:20.584602 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 582/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:41:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:20.593405 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa1f9b-0c54-419e-82dc-28ba40d5931a None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:20.707407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa1f9b-0c54-419e-82dc-28ba40d5931a None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:20.748479 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e6cd4-736e-4e4f-8abc-660899ba5eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:20.749132 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e6cd4-736e-4e4f-8abc-660899ba5eaa None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:20.749407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e6cd4-736e-4e4f-8abc-660899ba5eaa None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:20.749671 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e6cd4-736e-4e4f-8abc-660899ba5eaa None admin] PATH_INFO: `/v3/users/69de6774bc414b2a955ab9c653ef8883` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:20.751515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e6cd4-736e-4e4f-8abc-660899ba5eaa None admin] RBAC: Authorizing `identity:get_user(user_id=69de6774bc414b2a955ab9c653ef8883)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:20.753008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e6cd4-736e-4e4f-8abc-660899ba5eaa None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:20.754780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 569/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:41:20 2022] GET /identity/v3/users/69de6774bc414b2a955ab9c653ef8883 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:41:20.762861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95ad9c-5588-4f59-bcff-39a82f6e556b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:20.871693 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:20.875829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95ad9c-5588-4f59-bcff-39a82f6e556b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:20.910572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6cd2f-7542-4410-913f-14861fcba1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:20.911272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6cd2f-7542-4410-913f-14861fcba1fe None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:20.911460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6cd2f-7542-4410-913f-14861fcba1fe None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:20.911730 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6cd2f-7542-4410-913f-14861fcba1fe None admin] PATH_INFO: `/v3/projects/24b13bf3a530476683cf296b816a9c8e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:20.912848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6cd2f-7542-4410-913f-14861fcba1fe None admin] RBAC: Authorizing `identity:get_project(project_id=24b13bf3a530476683cf296b816a9c8e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:20.914297 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6cd2f-7542-4410-913f-14861fcba1fe None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:20.915922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 583/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:41:20 2022] GET /identity/v3/projects/24b13bf3a530476683cf296b816a9c8e => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:20.922310 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e6cd4-736e-4e4f-8abc-660899ba5eaa None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:20.939153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:21.029629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e6cd4-736e-4e4f-8abc-660899ba5eaa None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:21.065650 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75a4d8-3f30-4b6f-a2eb-18c0b5cd320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:21.066326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75a4d8-3f30-4b6f-a2eb-18c0b5cd320b None admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:21.066603 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75a4d8-3f30-4b6f-a2eb-18c0b5cd320b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:21.066872 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75a4d8-3f30-4b6f-a2eb-18c0b5cd320b None admin] PATH_INFO: `/v3/projects/24b13bf3a530476683cf296b816a9c8e/users/69de6774bc414b2a955ab9c653ef8883/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:21.068797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75a4d8-3f30-4b6f-a2eb-18c0b5cd320b None admin] RBAC: Authorizing `identity:create_grant(project_id=24b13bf3a530476683cf296b816a9c8e, user_id=69de6774bc414b2a955ab9c653ef8883, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:21.070264 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75a4d8-3f30-4b6f-a2eb-18c0b5cd320b None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:21.086723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 570/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:41:20 2022] PUT /identity/v3/projects/24b13bf3a530476683cf296b816a9c8e/users/69de6774bc414b2a955ab9c653ef8883/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:41:23.199120 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38648af3-4792-4145-be2d-f248b50826b7 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:23.199745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38648af3-4792-4145-be2d-f248b50826b7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:23.199745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38648af3-4792-4145-be2d-f248b50826b7 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:23.201489 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 584/1154] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:41:23.207605 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964d7e3-2518-4211-a5e8-00e53bb7aebf None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:23.208048 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964d7e3-2518-4211-a5e8-00e53bb7aebf None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:23.208156 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964d7e3-2518-4211-a5e8-00e53bb7aebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:23.228419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-5964d7e3-2518-4211-a5e8-00e53bb7aebf None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:41:23.229811 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5964d7e3-2518-4211-a5e8-00e53bb7aebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:41:23.303333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 571/1155] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:41:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:41:23.569139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38648af3-4792-4145-be2d-f248b50826b7 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:23.679726 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38648af3-4792-4145-be2d-f248b50826b7 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:23.715037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd8f1e-a05a-498f-9cbe-fb8f5d740886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:23.715662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd8f1e-a05a-498f-9cbe-fb8f5d740886 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:23.715936 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd8f1e-a05a-498f-9cbe-fb8f5d740886 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:23.716191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd8f1e-a05a-498f-9cbe-fb8f5d740886 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:23.726514 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd8f1e-a05a-498f-9cbe-fb8f5d740886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:41:23.731229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-4fcd8f1e-a05a-498f-9cbe-fb8f5d740886 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:41:23.731229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:41:23.731229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:41:23.731229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:41:23.731229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:41:23.731229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:41:23.731229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:41:23.731229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:41:23.731229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:41:23.731229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:41:23.731229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:41:23.731229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:41:23.731229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:41:23.731229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:41:23.731229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:41:23.731229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:41:23.732333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:41:23.732333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:41:23.732333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:41:23.732333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:41:23.732333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:41:23.732333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:41:23.732333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:41:23.732333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:41:23.732333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:41:23.732333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:41:23.732333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:41:23.732333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:41:23.732333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:41:23.732333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:41:23.732333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:41:23.732333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:41:23.733565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:41:23.733565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:41:23.733565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:41:23.733565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:41:23.733565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:41:23.733565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:41:23.733565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:41:23.733565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:41:23.733565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:41:23.733565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:41:23.733565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:41:23.733565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:41:23.733565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 585/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:41:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:41:23.739506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964d7e3-2518-4211-a5e8-00e53bb7aebf None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:23.741728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:23.849560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964d7e3-2518-4211-a5e8-00e53bb7aebf None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:23.884479 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c462cd-dd46-43f1-8eb8-bf362ec3f7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:23.885080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c462cd-dd46-43f1-8eb8-bf362ec3f7b4 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:23.885367 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c462cd-dd46-43f1-8eb8-bf362ec3f7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:23.885649 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c462cd-dd46-43f1-8eb8-bf362ec3f7b4 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:23.886309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c462cd-dd46-43f1-8eb8-bf362ec3f7b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:41:23.886607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c462cd-dd46-43f1-8eb8-bf362ec3f7b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:23.887962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c462cd-dd46-43f1-8eb8-bf362ec3f7b4 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:23.896613 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 572/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:41:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:23.903095 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd8f1e-a05a-498f-9cbe-fb8f5d740886 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:23.934515 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:24.015200 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd8f1e-a05a-498f-9cbe-fb8f5d740886 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:24.053481 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6762e0-6d0c-4a88-beec-dae1e374cb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:24.054115 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6762e0-6d0c-4a88-beec-dae1e374cb1b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:24.054389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6762e0-6d0c-4a88-beec-dae1e374cb1b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:24.054656 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6762e0-6d0c-4a88-beec-dae1e374cb1b None admin] PATH_INFO: `/v3/users/69de6774bc414b2a955ab9c653ef8883` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:24.055880 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6762e0-6d0c-4a88-beec-dae1e374cb1b None admin] RBAC: Authorizing `identity:get_user(user_id=69de6774bc414b2a955ab9c653ef8883)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:24.057312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6762e0-6d0c-4a88-beec-dae1e374cb1b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:24.059047 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 586/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:41:23 2022] GET /identity/v3/users/69de6774bc414b2a955ab9c653ef8883 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:24.065903 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c462cd-dd46-43f1-8eb8-bf362ec3f7b4 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:24.139304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:24.186696 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c462cd-dd46-43f1-8eb8-bf362ec3f7b4 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:24.222504 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70381a1a-cb7d-487a-a028-44ed9ad30492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:24.223163 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70381a1a-cb7d-487a-a028-44ed9ad30492 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:24.223380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70381a1a-cb7d-487a-a028-44ed9ad30492 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:24.223654 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70381a1a-cb7d-487a-a028-44ed9ad30492 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:24.293773 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70381a1a-cb7d-487a-a028-44ed9ad30492 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:24.295229 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70381a1a-cb7d-487a-a028-44ed9ad30492 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:24.358132 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:24.398208 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 573/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:41:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:41:24.404389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6762e0-6d0c-4a88-beec-dae1e374cb1b None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:24.503907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:24.511217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6762e0-6d0c-4a88-beec-dae1e374cb1b None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:24.545978 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f94ffb-e17c-4562-9e37-3a25eb5849d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:24.546656 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f94ffb-e17c-4562-9e37-3a25eb5849d9 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:24.546928 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f94ffb-e17c-4562-9e37-3a25eb5849d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:24.547198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f94ffb-e17c-4562-9e37-3a25eb5849d9 None admin] PATH_INFO: `/v3/projects/24b13bf3a530476683cf296b816a9c8e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:24.548368 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f94ffb-e17c-4562-9e37-3a25eb5849d9 None admin] RBAC: Authorizing `identity:get_project(project_id=24b13bf3a530476683cf296b816a9c8e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:24.549834 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f94ffb-e17c-4562-9e37-3a25eb5849d9 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:24.551479 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 587/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:41:24 2022] GET /identity/v3/projects/24b13bf3a530476683cf296b816a9c8e => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:24.557981 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70381a1a-cb7d-487a-a028-44ed9ad30492 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:24.663724 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70381a1a-cb7d-487a-a028-44ed9ad30492 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:24.700604 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448498c-837b-4ffb-81b0-aa3b3001648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:24.701199 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448498c-837b-4ffb-81b0-aa3b3001648f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:24.701506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448498c-837b-4ffb-81b0-aa3b3001648f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:24.701768 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448498c-837b-4ffb-81b0-aa3b3001648f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:24.702689 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448498c-837b-4ffb-81b0-aa3b3001648f None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.project.id=24b13bf3a530476683cf296b816a9c8e, user.id=69de6774bc414b2a955ab9c653ef8883) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:41:24.702989 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448498c-837b-4ffb-81b0-aa3b3001648f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:24.704424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448498c-837b-4ffb-81b0-aa3b3001648f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:24.710429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 574/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:41:24 2022] GET /identity/v3/role_assignments?user.id=69de6774bc414b2a955ab9c653ef8883&scope.project.id=24b13bf3a530476683cf296b816a9c8e&role.id=440092230f024959a90e846ab29c6367 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:26.946827 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30a503-1411-44e3-b1c3-6847ad3f6ef0 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:26.947419 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30a503-1411-44e3-b1c3-6847ad3f6ef0 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:26.947419 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30a503-1411-44e3-b1c3-6847ad3f6ef0 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:26.948728 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 588/1162] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:41:26.954368 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a67efe-329e-4687-a371-b9d9b9f505dd None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:26.954848 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a67efe-329e-4687-a371-b9d9b9f505dd None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:26.954848 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a67efe-329e-4687-a371-b9d9b9f505dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:26.973138 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-82a67efe-329e-4687-a371-b9d9b9f505dd None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:41:26.974358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-82a67efe-329e-4687-a371-b9d9b9f505dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:41:26.996877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:27.049601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 575/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:41:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:41:27.312717 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30a503-1411-44e3-b1c3-6847ad3f6ef0 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:27.430284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30a503-1411-44e3-b1c3-6847ad3f6ef0 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:27.468967 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55064a8-a1e5-4c18-8df0-cc47965e1698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:27.469621 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55064a8-a1e5-4c18-8df0-cc47965e1698 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:27.469900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55064a8-a1e5-4c18-8df0-cc47965e1698 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:27.470146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55064a8-a1e5-4c18-8df0-cc47965e1698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:27.516531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:27.581120 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55064a8-a1e5-4c18-8df0-cc47965e1698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:27.583589 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55064a8-a1e5-4c18-8df0-cc47965e1698 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:27.725926 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 589/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:41:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:41:27.732462 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a67efe-329e-4687-a371-b9d9b9f505dd None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:27.845746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a67efe-329e-4687-a371-b9d9b9f505dd None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:27.890726 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1769de8-a94e-4838-8351-39fcbf814bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:27.891359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769de8-a94e-4838-8351-39fcbf814bbf None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:27.891633 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769de8-a94e-4838-8351-39fcbf814bbf None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:27.891905 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769de8-a94e-4838-8351-39fcbf814bbf None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:27.899039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1769de8-a94e-4838-8351-39fcbf814bbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:27.900488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1769de8-a94e-4838-8351-39fcbf814bbf None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:27.912113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-c1769de8-a94e-4838-8351-39fcbf814bbf None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 12 23:41:27.912113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:41:27.912113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 12 23:41:27.912113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 12 23:41:27.912113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:41:27.912113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:41:27.912113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:41:27.912113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:41:27.912113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 12 23:41:27.912113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:41:27.912113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:41:27.912113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:41:27.912113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:41:27.912113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:41:27.912113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:41:27.912113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:41:27.912113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:41:27.913402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:41:27.913402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:41:27.913402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:41:27.913402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:41:27.913402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:41:27.913402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:41:27.913402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:41:27.913402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:41:27.913402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:41:27.913402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:41:27.913402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:41:27.913402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:41:27.913402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:41:27.913402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:41:27.913402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:41:27.913402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:41:27.914478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:41:27.914478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:41:27.914478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:41:27.914478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:41:27.914478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:41:27.914478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:41:27.914478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:41:27.914478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:41:27.914478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:41:27.914478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:41:27.914478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 12 23:41:27.914478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:41:27.914478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 12 23:41:27.914478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:41:27.914478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 576/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 23:41:27 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:41:27.919488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55064a8-a1e5-4c18-8df0-cc47965e1698 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:27.981215 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:28.021861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55064a8-a1e5-4c18-8df0-cc47965e1698 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:28.056511 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494f1bc-6c04-4838-9fb8-3c8e575c605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:28.057116 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494f1bc-6c04-4838-9fb8-3c8e575c605b None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:28.057426 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494f1bc-6c04-4838-9fb8-3c8e575c605b None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:28.057697 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494f1bc-6c04-4838-9fb8-3c8e575c605b None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:28.058361 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494f1bc-6c04-4838-9fb8-3c8e575c605b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:41:28.058654 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494f1bc-6c04-4838-9fb8-3c8e575c605b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:28.060012 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494f1bc-6c04-4838-9fb8-3c8e575c605b None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:28.070757 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 590/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 12 23:41:27 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:30.191620 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b571-ea3c-4511-bd52-897f68684c56 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:30.192210 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b571-ea3c-4511-bd52-897f68684c56 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:30.192210 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7b571-ea3c-4511-bd52-897f68684c56 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:30.193538 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 577/1167] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:41:30.198967 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d4cf7-2e54-4ad7-9343-f0021c977fc2 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:30.199405 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d4cf7-2e54-4ad7-9343-f0021c977fc2 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:30.199497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d4cf7-2e54-4ad7-9343-f0021c977fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:30.218500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-3f2d4cf7-2e54-4ad7-9343-f0021c977fc2 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:41:30.219681 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3f2d4cf7-2e54-4ad7-9343-f0021c977fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:41:30.290017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 591/1168] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:41:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:41:30.554784 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7b571-ea3c-4511-bd52-897f68684c56 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:30.575756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:30.669485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7b571-ea3c-4511-bd52-897f68684c56 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:30.704973 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6f882-6bb7-4672-96a6-ebe781090676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:30.705617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6f882-6bb7-4672-96a6-ebe781090676 None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:30.705888 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6f882-6bb7-4672-96a6-ebe781090676 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:30.706156 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6f882-6bb7-4672-96a6-ebe781090676 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:30.706806 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6f882-6bb7-4672-96a6-ebe781090676 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:30.708180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6f882-6bb7-4672-96a6-ebe781090676 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:30.725499 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 578/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Mon Sep 12 23:41:30 2022] POST /identity/v3/domains => generated 267 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:41:32.944172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45559deb-f2c6-4638-bb1d-029dad661df3 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:32.944767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45559deb-f2c6-4638-bb1d-029dad661df3 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:32.944767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45559deb-f2c6-4638-bb1d-029dad661df3 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:32.946100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 592/1170] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:41:32.951579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0c693-7445-4425-a015-ee1cfc958ada None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:32.952125 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0c693-7445-4425-a015-ee1cfc958ada None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:32.952125 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0c693-7445-4425-a015-ee1cfc958ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:32.970907 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-70c0c693-7445-4425-a015-ee1cfc958ada None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:41:32.972094 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-70c0c693-7445-4425-a015-ee1cfc958ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:41:33.042550 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 579/1171] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:41:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:41:33.311237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45559deb-f2c6-4638-bb1d-029dad661df3 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:33.373351 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:33.427104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45559deb-f2c6-4638-bb1d-029dad661df3 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:33.464690 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb08d9-21a5-40b7-93c1-dfba7e452164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:33.465319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb08d9-21a5-40b7-93c1-dfba7e452164 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:33.465627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb08d9-21a5-40b7-93c1-dfba7e452164 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:33.465894 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb08d9-21a5-40b7-93c1-dfba7e452164 None admin] PATH_INFO: `/v3/domains/13c870ef54054da396d23d564f6ddd94` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:33.476836 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb08d9-21a5-40b7-93c1-dfba7e452164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=13c870ef54054da396d23d564f6ddd94)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:33.478304 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb08d9-21a5-40b7-93c1-dfba7e452164 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:33.479935 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 593/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Sep 12 23:41:33 2022] GET /identity/v3/domains/13c870ef54054da396d23d564f6ddd94 => generated 267 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:33.486251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0c693-7445-4425-a015-ee1cfc958ada None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:33.497275 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:33.594554 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0c693-7445-4425-a015-ee1cfc958ada None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:33.633839 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe87dc-c2ec-48d1-b0f2-814f68feecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:33.634460 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe87dc-c2ec-48d1-b0f2-814f68feecba None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:33.634730 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe87dc-c2ec-48d1-b0f2-814f68feecba None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:33.634995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe87dc-c2ec-48d1-b0f2-814f68feecba None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:33.635656 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe87dc-c2ec-48d1-b0f2-814f68feecba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:33.637107 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe87dc-c2ec-48d1-b0f2-814f68feecba None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:33.668078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 580/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 23:41:33 2022] POST /identity/v3/projects => generated 361 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:41:35.844810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6989218-291b-4e1a-af91-9fa5579e0638 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:35.845423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6989218-291b-4e1a-af91-9fa5579e0638 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:35.845423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6989218-291b-4e1a-af91-9fa5579e0638 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:35.846724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 594/1174] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:41:35.853207 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db30ebe-b86f-42cb-b847-88b245c70475 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:35.853958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db30ebe-b86f-42cb-b847-88b245c70475 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:35.854113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db30ebe-b86f-42cb-b847-88b245c70475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:35.875077 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-1db30ebe-b86f-42cb-b847-88b245c70475 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:41:35.876268 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-1db30ebe-b86f-42cb-b847-88b245c70475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:41:35.938131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:35.952007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 581/1175] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:41:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:41:36.214127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6989218-291b-4e1a-af91-9fa5579e0638 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:36.332380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6989218-291b-4e1a-af91-9fa5579e0638 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:36.349842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:36.368832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b1534-f707-4ecb-aa74-789c7b62fd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:36.369512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b1534-f707-4ecb-aa74-789c7b62fd67 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:36.369790 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b1534-f707-4ecb-aa74-789c7b62fd67 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:36.370058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b1534-f707-4ecb-aa74-789c7b62fd67 None admin] PATH_INFO: `/v3/domains/13c870ef54054da396d23d564f6ddd94` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:36.371290 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b1534-f707-4ecb-aa74-789c7b62fd67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=13c870ef54054da396d23d564f6ddd94)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:36.372730 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b1534-f707-4ecb-aa74-789c7b62fd67 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:36.374415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 595/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Sep 12 23:41:36 2022] GET /identity/v3/domains/13c870ef54054da396d23d564f6ddd94 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:36.380374 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db30ebe-b86f-42cb-b847-88b245c70475 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:36.500761 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db30ebe-b86f-42cb-b847-88b245c70475 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:36.540240 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99595ffb-b0dc-479b-a079-fd3a8f8bcccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:36.540850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99595ffb-b0dc-479b-a079-fd3a8f8bcccf None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:36.541122 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99595ffb-b0dc-479b-a079-fd3a8f8bcccf None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:36.541394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99595ffb-b0dc-479b-a079-fd3a8f8bcccf None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:36.542078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99595ffb-b0dc-479b-a079-fd3a8f8bcccf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:36.543528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99595ffb-b0dc-479b-a079-fd3a8f8bcccf None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:36.568167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 582/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:41:36 2022] POST /identity/v3/users => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:41:38.752562 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac84819-9c96-4373-86a9-572c50aaf0fe None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:38.753150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac84819-9c96-4373-86a9-572c50aaf0fe None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:38.753150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac84819-9c96-4373-86a9-572c50aaf0fe None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:38.754475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 596/1178] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:41:38.761121 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a5efc-c57b-499f-aedd-f00221f1965e None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:38.761886 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a5efc-c57b-499f-aedd-f00221f1965e None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:38.762007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a5efc-c57b-499f-aedd-f00221f1965e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:38.782290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-eb1a5efc-c57b-499f-aedd-f00221f1965e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:41:38.783493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-eb1a5efc-c57b-499f-aedd-f00221f1965e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:41:38.828671 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:38.855960 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 583/1179] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:41:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:41:39.123428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac84819-9c96-4373-86a9-572c50aaf0fe None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:39.237788 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac84819-9c96-4373-86a9-572c50aaf0fe None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:39.282248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6d3dd-ca4d-4487-9d40-f1885dd87ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:39.282881 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6d3dd-ca4d-4487-9d40-f1885dd87ecd None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:39.283155 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6d3dd-ca4d-4487-9d40-f1885dd87ecd None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:39.283421 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6d3dd-ca4d-4487-9d40-f1885dd87ecd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:39.294325 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6d3dd-ca4d-4487-9d40-f1885dd87ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:41:39.299055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-f5d6d3dd-ca4d-4487-9d40-f1885dd87ecd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:41:39.299055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:41:39.299055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:41:39.299055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:41:39.299055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:41:39.299055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:41:39.299055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:41:39.299055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:41:39.299055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:41:39.299055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:41:39.299055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:41:39.299055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:41:39.299055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:41:39.299055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:41:39.299055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:41:39.299055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:41:39.300132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:41:39.300132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:41:39.300132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:41:39.300132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:41:39.300132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:41:39.300132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:41:39.300132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:41:39.300132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:41:39.300132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:41:39.300132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:41:39.300132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:41:39.300132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:41:39.300132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:41:39.300132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:41:39.300132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:41:39.300132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:41:39.301121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:41:39.301121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:41:39.301121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:41:39.301121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:41:39.301121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:41:39.301121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:41:39.301121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:41:39.301121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:41:39.301121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:41:39.301121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:41:39.301121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:41:39.301121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:41:39.301121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 597/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:41:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:41:39.308436 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a5efc-c57b-499f-aedd-f00221f1965e None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:39.417880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a5efc-c57b-499f-aedd-f00221f1965e None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:39.462265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde37f2-fe5a-4a03-95df-c2813ba35f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:39.462895 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde37f2-fe5a-4a03-95df-c2813ba35f05 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:39.463180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde37f2-fe5a-4a03-95df-c2813ba35f05 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:39.463475 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde37f2-fe5a-4a03-95df-c2813ba35f05 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:39.464154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde37f2-fe5a-4a03-95df-c2813ba35f05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:41:39.464453 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde37f2-fe5a-4a03-95df-c2813ba35f05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:39.465911 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde37f2-fe5a-4a03-95df-c2813ba35f05 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:39.475527 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 584/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:41:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:39.482186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6d3dd-ca4d-4487-9d40-f1885dd87ecd None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:39.535530 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:39.594910 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6d3dd-ca4d-4487-9d40-f1885dd87ecd None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:39.631662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce5be2-e053-4330-8c19-8a4fd4d3e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:39.632304 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce5be2-e053-4330-8c19-8a4fd4d3e819 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:39.632584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce5be2-e053-4330-8c19-8a4fd4d3e819 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:39.632856 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce5be2-e053-4330-8c19-8a4fd4d3e819 None admin] PATH_INFO: `/v3/users/e834da211e00441f9058e59479f9852f` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:39.647239 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce5be2-e053-4330-8c19-8a4fd4d3e819 None admin] RBAC: Authorizing `identity:get_user(user_id=e834da211e00441f9058e59479f9852f)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:39.648687 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce5be2-e053-4330-8c19-8a4fd4d3e819 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:39.650351 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 598/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:41:39 2022] GET /identity/v3/users/e834da211e00441f9058e59479f9852f => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:39.656799 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde37f2-fe5a-4a03-95df-c2813ba35f05 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:39.699860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:39.762589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde37f2-fe5a-4a03-95df-c2813ba35f05 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:39.798572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549be4f0-e755-4f0d-8837-8eb9fd097a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:39.799172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549be4f0-e755-4f0d-8837-8eb9fd097a5d None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:39.799447 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549be4f0-e755-4f0d-8837-8eb9fd097a5d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:39.799712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549be4f0-e755-4f0d-8837-8eb9fd097a5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:39.868520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549be4f0-e755-4f0d-8837-8eb9fd097a5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:39.870000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549be4f0-e755-4f0d-8837-8eb9fd097a5d None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:39.909034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:39.970755 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 585/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:41:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:41:39.977247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce5be2-e053-4330-8c19-8a4fd4d3e819 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:40.084359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce5be2-e053-4330-8c19-8a4fd4d3e819 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:40.086003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:40.120467 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae23348-adf9-44c7-a3f5-48e84f42f2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:40.121105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae23348-adf9-44c7-a3f5-48e84f42f2ac None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:40.121434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae23348-adf9-44c7-a3f5-48e84f42f2ac None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:40.121708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae23348-adf9-44c7-a3f5-48e84f42f2ac None admin] PATH_INFO: `/v3/projects/82b9718017b540258c95bee6797fb4d7` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:40.122885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae23348-adf9-44c7-a3f5-48e84f42f2ac None admin] RBAC: Authorizing `identity:get_project(project_id=82b9718017b540258c95bee6797fb4d7)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:40.124463 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae23348-adf9-44c7-a3f5-48e84f42f2ac None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:40.126135 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 599/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:41:39 2022] GET /identity/v3/projects/82b9718017b540258c95bee6797fb4d7 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:40.132733 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549be4f0-e755-4f0d-8837-8eb9fd097a5d None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:40.237001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549be4f0-e755-4f0d-8837-8eb9fd097a5d None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:40.272508 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a04dac-97de-4a6a-a7d1-c2dcf390ea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:40.273105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a04dac-97de-4a6a-a7d1-c2dcf390ea1f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:40.273401 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a04dac-97de-4a6a-a7d1-c2dcf390ea1f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:40.273670 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a04dac-97de-4a6a-a7d1-c2dcf390ea1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:40.274394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a04dac-97de-4a6a-a7d1-c2dcf390ea1f None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.project.id=82b9718017b540258c95bee6797fb4d7, user.id=e834da211e00441f9058e59479f9852f) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:41:40.274697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a04dac-97de-4a6a-a7d1-c2dcf390ea1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:40.276142 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a04dac-97de-4a6a-a7d1-c2dcf390ea1f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:40.282478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 586/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:41:40 2022] GET /identity/v3/role_assignments?user.id=e834da211e00441f9058e59479f9852f&scope.project.id=82b9718017b540258c95bee6797fb4d7&role.id=440092230f024959a90e846ab29c6367 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:42.385490 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93af32c-ccec-4b55-a559-94c09df021c0 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:42.386056 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93af32c-ccec-4b55-a559-94c09df021c0 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:42.386056 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93af32c-ccec-4b55-a559-94c09df021c0 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:42.387344 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 600/1186] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:41:42.393099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b27239-a6f4-4664-ada7-f4e2221744db None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:42.393605 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b27239-a6f4-4664-ada7-f4e2221744db None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:42.393699 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b27239-a6f4-4664-ada7-f4e2221744db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:42.400673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:42.415101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-14b27239-a6f4-4664-ada7-f4e2221744db None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:41:42.416494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-14b27239-a6f4-4664-ada7-f4e2221744db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:41:42.519704 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 587/1187] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:41:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:41:42.791520 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93af32c-ccec-4b55-a559-94c09df021c0 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:42.903409 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93af32c-ccec-4b55-a559-94c09df021c0 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:42.940982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d805a02-3dc6-48f6-adb1-731ca08e5622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:42.941700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d805a02-3dc6-48f6-adb1-731ca08e5622 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:42.941981 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d805a02-3dc6-48f6-adb1-731ca08e5622 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:42.942232 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d805a02-3dc6-48f6-adb1-731ca08e5622 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:42.958567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d805a02-3dc6-48f6-adb1-731ca08e5622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:41:42.963387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-4d805a02-3dc6-48f6-adb1-731ca08e5622 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:41:42.963387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:41:42.963387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:41:42.963387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:41:42.963387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:41:42.963387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:41:42.963387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:41:42.963387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:41:42.963387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:41:42.963387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:41:42.963387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:41:42.963387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:41:42.963387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:41:42.963387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:41:42.963387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:41:42.963387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:41:42.964488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:41:42.964488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:41:42.964488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:41:42.964488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:41:42.964488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:41:42.964488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:41:42.964488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:41:42.964488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:41:42.964488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:41:42.964488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:41:42.964488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:41:42.964488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:41:42.964488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:41:42.964488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:41:42.964488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:41:42.964488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:41:42.965563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:41:42.965563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:41:42.965563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:41:42.965563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:41:42.965563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:41:42.965563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:41:42.965563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:41:42.965563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:41:42.965563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:41:42.965563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:41:42.965563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:41:42.965563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:41:42.965563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 601/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:41:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:41:42.972251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b27239-a6f4-4664-ada7-f4e2221744db None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:43.079065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b27239-a6f4-4664-ada7-f4e2221744db None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:43.110583 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:43.116341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d24e5-6064-4bb3-b142-4d9bc7f88e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:43.116953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d24e5-6064-4bb3-b142-4d9bc7f88e58 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:43.117215 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d24e5-6064-4bb3-b142-4d9bc7f88e58 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:43.117513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d24e5-6064-4bb3-b142-4d9bc7f88e58 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:43.118195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d24e5-6064-4bb3-b142-4d9bc7f88e58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:41:43.118499 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d24e5-6064-4bb3-b142-4d9bc7f88e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:43.119877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d24e5-6064-4bb3-b142-4d9bc7f88e58 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:43.128851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 588/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:41:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:43.135395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d805a02-3dc6-48f6-adb1-731ca08e5622 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:43.170596 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:43.245258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d805a02-3dc6-48f6-adb1-731ca08e5622 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:43.286364 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d3815-6439-4b96-8147-d49aa0737569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:43.287003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d3815-6439-4b96-8147-d49aa0737569 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:43.287279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d3815-6439-4b96-8147-d49aa0737569 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:43.287549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d3815-6439-4b96-8147-d49aa0737569 None admin] PATH_INFO: `/v3/users/e834da211e00441f9058e59479f9852f` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:43.288745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d3815-6439-4b96-8147-d49aa0737569 None admin] RBAC: Authorizing `identity:get_user(user_id=e834da211e00441f9058e59479f9852f)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:43.291001 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d3815-6439-4b96-8147-d49aa0737569 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:43.292231 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 602/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:41:43 2022] GET /identity/v3/users/e834da211e00441f9058e59479f9852f => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:43.299261 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d24e5-6064-4bb3-b142-4d9bc7f88e58 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:43.406198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d24e5-6064-4bb3-b142-4d9bc7f88e58 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:43.443087 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8abcc-eb63-401d-a0c9-7a9e01a6a029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:43.443734 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8abcc-eb63-401d-a0c9-7a9e01a6a029 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:43.444028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8abcc-eb63-401d-a0c9-7a9e01a6a029 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:43.444305 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8abcc-eb63-401d-a0c9-7a9e01a6a029 None admin] PATH_INFO: `/v3/projects/82b9718017b540258c95bee6797fb4d7` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:43.445552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8abcc-eb63-401d-a0c9-7a9e01a6a029 None admin] RBAC: Authorizing `identity:get_project(project_id=82b9718017b540258c95bee6797fb4d7)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:43.447000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8abcc-eb63-401d-a0c9-7a9e01a6a029 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:43.448673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 589/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:41:43 2022] GET /identity/v3/projects/82b9718017b540258c95bee6797fb4d7 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:43.454992 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d3815-6439-4b96-8147-d49aa0737569 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:43.556637 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:43.561072 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d3815-6439-4b96-8147-d49aa0737569 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:43.596784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97042b1-e4cf-432b-aa4d-99cba7206279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:43.597467 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97042b1-e4cf-432b-aa4d-99cba7206279 None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:43.597743 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97042b1-e4cf-432b-aa4d-99cba7206279 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:43.598009 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97042b1-e4cf-432b-aa4d-99cba7206279 None admin] PATH_INFO: `/v3/projects/82b9718017b540258c95bee6797fb4d7/users/e834da211e00441f9058e59479f9852f/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:43.600000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97042b1-e4cf-432b-aa4d-99cba7206279 None admin] RBAC: Authorizing `identity:create_grant(project_id=82b9718017b540258c95bee6797fb4d7, user_id=e834da211e00441f9058e59479f9852f, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:43.601450 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97042b1-e4cf-432b-aa4d-99cba7206279 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:43.616545 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 603/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:41:43 2022] PUT /identity/v3/projects/82b9718017b540258c95bee6797fb4d7/users/e834da211e00441f9058e59479f9852f/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:41:45.743244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ba683-480f-4608-85a7-9236edb52465 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:45.743822 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ba683-480f-4608-85a7-9236edb52465 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:45.743822 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ba683-480f-4608-85a7-9236edb52465 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:45.745135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 590/1193] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:41:45.750890 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab253e6-b2dc-4c94-b13b-3c5d9b7af677 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:45.751328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab253e6-b2dc-4c94-b13b-3c5d9b7af677 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:45.751417 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab253e6-b2dc-4c94-b13b-3c5d9b7af677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:45.770339 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-eab253e6-b2dc-4c94-b13b-3c5d9b7af677 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:41:45.771534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-eab253e6-b2dc-4c94-b13b-3c5d9b7af677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:41:45.842265 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 604/1194] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:41:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:41:46.110869 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ba683-480f-4608-85a7-9236edb52465 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:46.177696 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:46.221151 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ba683-480f-4608-85a7-9236edb52465 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:46.257932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612cd45-9dff-412d-9353-dc169ab392c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:46.258574 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612cd45-9dff-412d-9353-dc169ab392c1 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:46.258852 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612cd45-9dff-412d-9353-dc169ab392c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:46.259117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612cd45-9dff-412d-9353-dc169ab392c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:46.270378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612cd45-9dff-412d-9353-dc169ab392c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:41:46.275170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-d612cd45-9dff-412d-9353-dc169ab392c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:41:46.275170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:41:46.275170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:41:46.275170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:41:46.275170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:41:46.275170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:41:46.275170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:41:46.275170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:41:46.275170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:41:46.275170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:41:46.275170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:41:46.275170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:41:46.275170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:41:46.275170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:41:46.275170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:41:46.275170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:41:46.276252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:41:46.276252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:41:46.276252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:41:46.276252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:41:46.276252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:41:46.276252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:41:46.276252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:41:46.276252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:41:46.276252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:41:46.276252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:41:46.276252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:41:46.276252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:41:46.276252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:41:46.276252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:41:46.276252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:41:46.276252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:41:46.277172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:41:46.277172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:41:46.277172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:41:46.277172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:41:46.277172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:41:46.277172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:41:46.277172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:41:46.277172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:41:46.277172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:41:46.277172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:41:46.277172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:41:46.277172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:41:46.277172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 591/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:41:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:41:46.285192 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab253e6-b2dc-4c94-b13b-3c5d9b7af677 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:46.380851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:46.395593 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab253e6-b2dc-4c94-b13b-3c5d9b7af677 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:46.432412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c47a6-ac62-4952-9006-7d4779ceb9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:46.433056 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c47a6-ac62-4952-9006-7d4779ceb9cc None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:46.433373 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c47a6-ac62-4952-9006-7d4779ceb9cc None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:46.433637 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c47a6-ac62-4952-9006-7d4779ceb9cc None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:46.434333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c47a6-ac62-4952-9006-7d4779ceb9cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:41:46.434633 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c47a6-ac62-4952-9006-7d4779ceb9cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:46.436408 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c47a6-ac62-4952-9006-7d4779ceb9cc None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:46.446369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 605/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:41:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:46.453114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612cd45-9dff-412d-9353-dc169ab392c1 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:46.566027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612cd45-9dff-412d-9353-dc169ab392c1 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:46.591362 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:46.605571 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77acf5e-0b2b-4f84-84bb-bdd614180864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:46.606215 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77acf5e-0b2b-4f84-84bb-bdd614180864 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:46.606490 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77acf5e-0b2b-4f84-84bb-bdd614180864 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:46.606787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77acf5e-0b2b-4f84-84bb-bdd614180864 None admin] PATH_INFO: `/v3/users/e834da211e00441f9058e59479f9852f` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:46.608039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77acf5e-0b2b-4f84-84bb-bdd614180864 None admin] RBAC: Authorizing `identity:get_user(user_id=e834da211e00441f9058e59479f9852f)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:46.609530 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77acf5e-0b2b-4f84-84bb-bdd614180864 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:46.611142 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 592/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 12 23:41:46 2022] GET /identity/v3/users/e834da211e00441f9058e59479f9852f => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:46.617892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c47a6-ac62-4952-9006-7d4779ceb9cc None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:46.721755 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c47a6-ac62-4952-9006-7d4779ceb9cc None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:46.756343 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ce479-a722-441c-8dc1-097bf4f503ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:46.756987 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ce479-a722-441c-8dc1-097bf4f503ab None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:46.757228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ce479-a722-441c-8dc1-097bf4f503ab None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:46.757531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ce479-a722-441c-8dc1-097bf4f503ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:46.776291 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:46.827591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ce479-a722-441c-8dc1-097bf4f503ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:46.829074 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ce479-a722-441c-8dc1-097bf4f503ab None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:46.929511 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 606/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:41:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:41:46.936162 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77acf5e-0b2b-4f84-84bb-bdd614180864 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:47.040830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77acf5e-0b2b-4f84-84bb-bdd614180864 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:47.079827 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd878bb-a31a-453a-b5b8-e6873263f82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:47.080493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd878bb-a31a-453a-b5b8-e6873263f82a None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:47.080776 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd878bb-a31a-453a-b5b8-e6873263f82a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:47.081146 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd878bb-a31a-453a-b5b8-e6873263f82a None admin] PATH_INFO: `/v3/projects/82b9718017b540258c95bee6797fb4d7` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:47.082677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd878bb-a31a-453a-b5b8-e6873263f82a None admin] RBAC: Authorizing `identity:get_project(project_id=82b9718017b540258c95bee6797fb4d7)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:47.084131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd878bb-a31a-453a-b5b8-e6873263f82a None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:47.085841 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 593/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 12 23:41:46 2022] GET /identity/v3/projects/82b9718017b540258c95bee6797fb4d7 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:47.092335 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ce479-a722-441c-8dc1-097bf4f503ab None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:41:47.143966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:47.195949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ce479-a722-441c-8dc1-097bf4f503ab None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:41:47.230177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff5e57-01bf-4672-b75d-ace12d0bd3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:41:47.230785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff5e57-01bf-4672-b75d-ace12d0bd3e0 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:41:47.231061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff5e57-01bf-4672-b75d-ace12d0bd3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:41:47.231326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff5e57-01bf-4672-b75d-ace12d0bd3e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:41:47.232049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff5e57-01bf-4672-b75d-ace12d0bd3e0 None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.project.id=82b9718017b540258c95bee6797fb4d7, user.id=e834da211e00441f9058e59479f9852f) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:41:47.232357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff5e57-01bf-4672-b75d-ace12d0bd3e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:41:47.233915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff5e57-01bf-4672-b75d-ace12d0bd3e0 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:41:47.239574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 607/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:41:47 2022] GET /identity/v3/role_assignments?user.id=e834da211e00441f9058e59479f9852f&scope.project.id=82b9718017b540258c95bee6797fb4d7&role.id=440092230f024959a90e846ab29c6367 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:41:57.074586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=71 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:41:57.237048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=43 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:44.684501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79044c3-df16-4122-953b-effe9f3c2b82 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:44.685803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79044c3-df16-4122-953b-effe9f3c2b82 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:44.685803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79044c3-df16-4122-953b-effe9f3c2b82 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:44.686967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 594/1201] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:42:44.693594 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f56c9-6f62-478e-855a-408900823350 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:44.694202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f56c9-6f62-478e-855a-408900823350 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:44.694556 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f56c9-6f62-478e-855a-408900823350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:44.725536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-a97f56c9-6f62-478e-855a-408900823350 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:42:44.727742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a97f56c9-6f62-478e-855a-408900823350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:42:44.837394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 608/1202] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:42:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:42:45.114979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79044c3-df16-4122-953b-effe9f3c2b82 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:45.340110 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79044c3-df16-4122-953b-effe9f3c2b82 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:45.410220 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0adbd7-5b53-4502-96ea-f467b30e2c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:45.411281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0adbd7-5b53-4502-96ea-f467b30e2c5c None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:45.411750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0adbd7-5b53-4502-96ea-f467b30e2c5c None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:45.412239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0adbd7-5b53-4502-96ea-f467b30e2c5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:45.433073 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0adbd7-5b53-4502-96ea-f467b30e2c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:45.433073 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0adbd7-5b53-4502-96ea-f467b30e2c5c None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:45.460522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-5e0adbd7-5b53-4502-96ea-f467b30e2c5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:42:45.460522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:42:45.460522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:42:45.460522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:42:45.460522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:42:45.460522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:42:45.460522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:42:45.460522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:42:45.460522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:42:45.460522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:42:45.460522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:42:45.460522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:42:45.460522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:42:45.460522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:42:45.460522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:42:45.460522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:42:45.468928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:42:45.468928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:42:45.468928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:42:45.468928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:42:45.468928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:42:45.468928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:42:45.468928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:42:45.468928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:42:45.468928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:42:45.468928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:42:45.468928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:42:45.468928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:42:45.468928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:42:45.468928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:42:45.468928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:42:45.468928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:42:45.468928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:42:45.470912 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:42:45.470912 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:42:45.470912 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:42:45.470912 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 595/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:42:45.471365 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f56c9-6f62-478e-855a-408900823350 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:45.626889 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f56c9-6f62-478e-855a-408900823350 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:45.686003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:45.702215 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dd0f7-d5b4-4b0c-89e8-75630c643904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:45.703295 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dd0f7-d5b4-4b0c-89e8-75630c643904 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:45.703770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dd0f7-d5b4-4b0c-89e8-75630c643904 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:45.704248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dd0f7-d5b4-4b0c-89e8-75630c643904 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:45.705650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dd0f7-d5b4-4b0c-89e8-75630c643904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:42:45.706395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dd0f7-d5b4-4b0c-89e8-75630c643904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:45.709493 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dd0f7-d5b4-4b0c-89e8-75630c643904 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:45.732415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 609/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:42:45.739518 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0adbd7-5b53-4502-96ea-f467b30e2c5c None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:45.834752 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:45.920649 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0adbd7-5b53-4502-96ea-f467b30e2c5c None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:45.990799 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112deac5-9b95-4a41-aa7f-6981f746abbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:45.991536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112deac5-9b95-4a41-aa7f-6981f746abbe None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:45.991748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112deac5-9b95-4a41-aa7f-6981f746abbe None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:45.991991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112deac5-9b95-4a41-aa7f-6981f746abbe None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:45.992636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112deac5-9b95-4a41-aa7f-6981f746abbe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:45.994106 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112deac5-9b95-4a41-aa7f-6981f746abbe None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:46.025400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 596/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 12 23:42:45 2022] POST /identity/v3/users => generated 251 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:42:49.074610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14743bd-f93b-4d65-8a52-f39727900343 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:49.075562 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14743bd-f93b-4d65-8a52-f39727900343 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:49.075722 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14743bd-f93b-4d65-8a52-f39727900343 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:49.078267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 610/1206] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:42:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:42:49.084709 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68024e36-d3e8-4ecc-9a44-29c852a1b81f None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:49.085668 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68024e36-d3e8-4ecc-9a44-29c852a1b81f None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:49.085668 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68024e36-d3e8-4ecc-9a44-29c852a1b81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:49.107585 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-68024e36-d3e8-4ecc-9a44-29c852a1b81f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:42:49.109083 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-68024e36-d3e8-4ecc-9a44-29c852a1b81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:42:49.213972 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 597/1207] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:42:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:42:49.519599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14743bd-f93b-4d65-8a52-f39727900343 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:49.680626 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14743bd-f93b-4d65-8a52-f39727900343 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:49.752520 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e0411-2aef-42b4-9a5a-7baae2534c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:49.753693 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e0411-2aef-42b4-9a5a-7baae2534c27 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:49.754189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e0411-2aef-42b4-9a5a-7baae2534c27 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:49.754589 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e0411-2aef-42b4-9a5a-7baae2534c27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:49.777860 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e0411-2aef-42b4-9a5a-7baae2534c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:42:49.784534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-383e0411-2aef-42b4-9a5a-7baae2534c27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:42:49.784534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:42:49.784534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:42:49.784534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:42:49.784534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:42:49.784534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:42:49.784534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:42:49.784534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:42:49.784534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:42:49.784534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:42:49.784534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:42:49.784534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:42:49.784534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:42:49.784534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:42:49.784534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:42:49.784534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:42:49.788105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:42:49.788105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:42:49.788105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:42:49.788105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:42:49.788105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:42:49.788105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:42:49.788105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:42:49.788105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:42:49.788105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:42:49.788105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:42:49.788105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:42:49.788105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:42:49.788105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:42:49.788105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:42:49.788105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:42:49.788105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:42:49.790841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:42:49.790841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:42:49.790841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:42:49.790841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:42:49.790841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:42:49.790841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:42:49.790841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:42:49.790841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:42:49.790841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:42:49.790841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:42:49.790841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:42:49.790841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:42:49.790841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 611/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:42:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:42:49.797360 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68024e36-d3e8-4ecc-9a44-29c852a1b81f None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:49.877950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:49.999728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68024e36-d3e8-4ecc-9a44-29c852a1b81f None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:50.053245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d368fb7-00e7-4217-a081-a233d7de5c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:50.054329 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d368fb7-00e7-4217-a081-a233d7de5c80 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:50.054683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d368fb7-00e7-4217-a081-a233d7de5c80 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:50.055104 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d368fb7-00e7-4217-a081-a233d7de5c80 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:50.056037 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d368fb7-00e7-4217-a081-a233d7de5c80 None admin] RBAC: Adding query filter params (name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:42:50.056420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d368fb7-00e7-4217-a081-a233d7de5c80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:50.058170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d368fb7-00e7-4217-a081-a233d7de5c80 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:50.077198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 598/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:42:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:42:50.079289 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e0411-2aef-42b4-9a5a-7baae2534c27 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:50.178464 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:50.268018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e0411-2aef-42b4-9a5a-7baae2534c27 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:50.320018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0dc426-8df6-4d63-ac23-4a2ac795edad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:50.320779 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dc426-8df6-4d63-ac23-4a2ac795edad None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:50.321119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dc426-8df6-4d63-ac23-4a2ac795edad None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:50.321490 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0dc426-8df6-4d63-ac23-4a2ac795edad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:50.335976 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0dc426-8df6-4d63-ac23-4a2ac795edad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:50.338274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0dc426-8df6-4d63-ac23-4a2ac795edad None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:50.359799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-fa0dc426-8df6-4d63-ac23-4a2ac795edad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:42:50.359799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:42:50.359799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:42:50.359799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:42:50.359799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:42:50.359799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:42:50.359799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:42:50.359799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:42:50.359799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:42:50.359799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:42:50.359799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:42:50.359799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:42:50.359799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:42:50.359799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:42:50.359799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:42:50.359799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:42:50.361657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:42:50.361657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:42:50.361657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:42:50.361657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:42:50.361657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:42:50.361657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:42:50.361657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:42:50.361657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:42:50.361657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:42:50.361657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:42:50.361657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:42:50.361657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:42:50.361657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:42:50.361657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:42:50.361657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:42:50.361657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:42:50.361657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:42:50.362885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:42:50.362885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:42:50.362885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:42:50.366304 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 612/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:42:50.369456 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d368fb7-00e7-4217-a081-a233d7de5c80 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:50.597091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d368fb7-00e7-4217-a081-a233d7de5c80 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:50.600183 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:50.658747 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7ab45-d097-4a72-8327-40c346486193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:50.659402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7ab45-d097-4a72-8327-40c346486193 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:50.659682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7ab45-d097-4a72-8327-40c346486193 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:50.659955 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7ab45-d097-4a72-8327-40c346486193 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:50.660658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7ab45-d097-4a72-8327-40c346486193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:42:50.660952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7ab45-d097-4a72-8327-40c346486193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:50.662431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7ab45-d097-4a72-8327-40c346486193 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:50.689564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 599/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:42:50.695172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0dc426-8df6-4d63-ac23-4a2ac795edad None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:50.855301 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0dc426-8df6-4d63-ac23-4a2ac795edad None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:50.858485 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:50.947231 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b09b6-05d3-44b1-aeff-82bac28bf89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:50.948940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b09b6-05d3-44b1-aeff-82bac28bf89d None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:50.949653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b09b6-05d3-44b1-aeff-82bac28bf89d None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:50.950150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b09b6-05d3-44b1-aeff-82bac28bf89d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:50.974108 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b09b6-05d3-44b1-aeff-82bac28bf89d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:50.975520 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b09b6-05d3-44b1-aeff-82bac28bf89d None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:50.996750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-478b09b6-05d3-44b1-aeff-82bac28bf89d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:42:50.996750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:42:50.996750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:42:50.996750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:42:50.996750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:42:50.996750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:42:50.996750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:42:50.996750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:42:50.996750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:42:50.996750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:42:50.996750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:42:50.996750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:42:50.996750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:42:50.996750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:42:50.996750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:42:50.996750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:42:50.998619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:42:51.001061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:42:51.001061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:42:51.001061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:42:51.001061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:42:51.001061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:42:51.001061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:42:51.001061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:42:51.001061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:42:51.001061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:42:51.001061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:42:51.003513 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 613/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:42:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:42:51.004906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7ab45-d097-4a72-8327-40c346486193 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:51.169903 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7ab45-d097-4a72-8327-40c346486193 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:51.242310 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bba323-825c-4b9e-a35f-a6b5fc433c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:51.243658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bba323-825c-4b9e-a35f-a6b5fc433c04 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:51.244828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bba323-825c-4b9e-a35f-a6b5fc433c04 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:51.244828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bba323-825c-4b9e-a35f-a6b5fc433c04 None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:51.246373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bba323-825c-4b9e-a35f-a6b5fc433c04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:42:51.247068 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bba323-825c-4b9e-a35f-a6b5fc433c04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:51.250436 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bba323-825c-4b9e-a35f-a6b5fc433c04 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:51.298735 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 600/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 12 23:42:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:42:51.300717 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b09b6-05d3-44b1-aeff-82bac28bf89d None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:51.490100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b09b6-05d3-44b1-aeff-82bac28bf89d None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:51.541916 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd2ba9-ea29-49f7-a17c-e243cb7cbf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:51.543080 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd2ba9-ea29-49f7-a17c-e243cb7cbf49 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:51.543636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd2ba9-ea29-49f7-a17c-e243cb7cbf49 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:51.544189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd2ba9-ea29-49f7-a17c-e243cb7cbf49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:51.606770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:51.667956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd2ba9-ea29-49f7-a17c-e243cb7cbf49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:51.670698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd2ba9-ea29-49f7-a17c-e243cb7cbf49 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:51.832043 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 614/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:42:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 12 23:42:51.838819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bba323-825c-4b9e-a35f-a6b5fc433c04 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:51.867624 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:52.017364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bba323-825c-4b9e-a35f-a6b5fc433c04 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:52.075402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81411327-2541-4ca1-9c5d-83a24ce9018d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:52.076569 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81411327-2541-4ca1-9c5d-83a24ce9018d None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:52.077037 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81411327-2541-4ca1-9c5d-83a24ce9018d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:52.077559 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81411327-2541-4ca1-9c5d-83a24ce9018d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:52.096075 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81411327-2541-4ca1-9c5d-83a24ce9018d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:52.099044 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81411327-2541-4ca1-9c5d-83a24ce9018d None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:52.121751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-81411327-2541-4ca1-9c5d-83a24ce9018d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:42:52.121751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:42:52.121751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:42:52.121751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:42:52.121751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:42:52.121751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:42:52.121751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:42:52.121751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:42:52.121751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:42:52.121751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:42:52.121751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:42:52.121751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:42:52.121751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:42:52.121751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:42:52.121751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:42:52.121751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:42:52.124167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:42:52.124167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:42:52.124167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:42:52.124167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:42:52.124167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:42:52.124167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:42:52.124167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:42:52.124167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:42:52.124167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:42:52.124167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:42:52.124167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:42:52.124167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:42:52.124167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:42:52.124167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:42:52.124167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:42:52.124167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:42:52.124167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:42:52.125878 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:42:52.125878 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:42:52.125878 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:42:52.125878 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 601/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:42:52.130163 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd2ba9-ea29-49f7-a17c-e243cb7cbf49 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:52.211331 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:52.263588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd2ba9-ea29-49f7-a17c-e243cb7cbf49 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:52.305949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4faac4f-1a35-4f4e-8eef-887fcbfadd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:52.306972 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faac4f-1a35-4f4e-8eef-887fcbfadd10 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:52.306972 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faac4f-1a35-4f4e-8eef-887fcbfadd10 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:52.307385 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faac4f-1a35-4f4e-8eef-887fcbfadd10 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:52.308015 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4faac4f-1a35-4f4e-8eef-887fcbfadd10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:42:52.308381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4faac4f-1a35-4f4e-8eef-887fcbfadd10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:52.310721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4faac4f-1a35-4f4e-8eef-887fcbfadd10 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:52.326990 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 615/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:42:52.332899 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81411327-2541-4ca1-9c5d-83a24ce9018d None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:52.441253 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:52.480228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81411327-2541-4ca1-9c5d-83a24ce9018d None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:52.521126 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65f2dd-f13e-45c8-a9c2-5638246a3b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:52.521775 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65f2dd-f13e-45c8-a9c2-5638246a3b60 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:52.522033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65f2dd-f13e-45c8-a9c2-5638246a3b60 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:52.522315 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65f2dd-f13e-45c8-a9c2-5638246a3b60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:52.529966 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65f2dd-f13e-45c8-a9c2-5638246a3b60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:52.531414 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65f2dd-f13e-45c8-a9c2-5638246a3b60 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:52.543186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-ec65f2dd-f13e-45c8-a9c2-5638246a3b60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:42:52.543186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:42:52.543186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:42:52.543186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:42:52.543186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:42:52.543186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:42:52.543186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:42:52.543186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:42:52.543186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:42:52.543186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:42:52.543186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:42:52.543186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:42:52.543186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:42:52.543186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:42:52.543186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:42:52.545031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:42:52.545031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:42:52.545031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:42:52.545031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:42:52.545031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:42:52.545031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:42:52.545031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:42:52.545031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:42:52.545031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:42:52.545031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:42:52.545031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:42:52.545031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:42:52.545031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:42:52.545031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:42:52.545031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:42:52.545031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:42:52.545031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:42:52.546769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:42:52.546769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:42:52.546769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:42:52.546769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:42:52.546769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:42:52.546769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:42:52.546769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:42:52.546769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:42:52.546769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 602/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:42:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:42:52.551714 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4faac4f-1a35-4f4e-8eef-887fcbfadd10 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:52.719543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4faac4f-1a35-4f4e-8eef-887fcbfadd10 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:52.750651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:52.768358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cd164-60bc-4e32-a474-d34eadd49e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:52.769356 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cd164-60bc-4e32-a474-d34eadd49e76 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:52.769663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cd164-60bc-4e32-a474-d34eadd49e76 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:52.769937 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cd164-60bc-4e32-a474-d34eadd49e76 None admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:52.770652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cd164-60bc-4e32-a474-d34eadd49e76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:42:52.770959 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cd164-60bc-4e32-a474-d34eadd49e76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:52.772457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cd164-60bc-4e32-a474-d34eadd49e76 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:52.791778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 616/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:42:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:42:52.799691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65f2dd-f13e-45c8-a9c2-5638246a3b60 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:52.937166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65f2dd-f13e-45c8-a9c2-5638246a3b60 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:52.988508 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:52.996444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a19412-4a85-4b24-9a43-1c49206d4801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:52.997155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a19412-4a85-4b24-9a43-1c49206d4801 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:52.997471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a19412-4a85-4b24-9a43-1c49206d4801 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:52.997845 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a19412-4a85-4b24-9a43-1c49206d4801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:52.998692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a19412-4a85-4b24-9a43-1c49206d4801 None admin] RBAC: Adding query filter params (role.id=8cf7b72483b94512b497317ab1d11192, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=4395ee0a00df41adacb55b4a8684786b) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:42:52.999020 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a19412-4a85-4b24-9a43-1c49206d4801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:53.000499 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a19412-4a85-4b24-9a43-1c49206d4801 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:53.009273 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 603/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:42:52 2022] GET /identity/v3/role_assignments?user.id=4395ee0a00df41adacb55b4a8684786b&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=8cf7b72483b94512b497317ab1d11192 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:42:55.408940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca5e92-8e12-4322-8f95-60eb5ec491b7 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:55.409503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca5e92-8e12-4322-8f95-60eb5ec491b7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:55.409503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca5e92-8e12-4322-8f95-60eb5ec491b7 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:55.411014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 617/1220] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:42:55.416824 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935a093-b53b-4484-a376-fd8208284a2c None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:55.417383 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935a093-b53b-4484-a376-fd8208284a2c None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:55.417478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935a093-b53b-4484-a376-fd8208284a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:55.438191 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-4935a093-b53b-4484-a376-fd8208284a2c None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:42:55.439409 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4935a093-b53b-4484-a376-fd8208284a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:42:55.520309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 604/1221] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:42:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:42:55.814055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca5e92-8e12-4322-8f95-60eb5ec491b7 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:56.016652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca5e92-8e12-4322-8f95-60eb5ec491b7 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:56.064199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075bc37-8592-44ae-8d71-9c611ce351f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:56.065174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075bc37-8592-44ae-8d71-9c611ce351f5 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:56.065802 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075bc37-8592-44ae-8d71-9c611ce351f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:56.066250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075bc37-8592-44ae-8d71-9c611ce351f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:56.087946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075bc37-8592-44ae-8d71-9c611ce351f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:42:56.094576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-4075bc37-8592-44ae-8d71-9c611ce351f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:42:56.094576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:42:56.094576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:42:56.094576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:42:56.094576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:42:56.094576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:42:56.094576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:42:56.094576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:42:56.094576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:42:56.094576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:42:56.094576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:42:56.094576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:42:56.094576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:42:56.094576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:42:56.094576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:42:56.094576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:42:56.095663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:42:56.095663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:42:56.095663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:42:56.095663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:42:56.095663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:42:56.095663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:42:56.095663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:42:56.095663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:42:56.095663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:42:56.095663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:42:56.095663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:42:56.095663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:42:56.095663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:42:56.095663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:42:56.095663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:42:56.095663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:42:56.097154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:42:56.097154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:42:56.097154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:42:56.097154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:42:56.097154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:42:56.097154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:42:56.097154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:42:56.097154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:42:56.097154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:42:56.097154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:42:56.097154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:42:56.097154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:42:56.097154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 618/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:42:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:42:56.104947 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935a093-b53b-4484-a376-fd8208284a2c None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:56.237185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935a093-b53b-4484-a376-fd8208284a2c None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:56.265764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:56.278982 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48149ecd-71c7-4603-a3bc-ba4dd7183039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:56.279643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48149ecd-71c7-4603-a3bc-ba4dd7183039 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:56.279904 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48149ecd-71c7-4603-a3bc-ba4dd7183039 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:56.280253 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48149ecd-71c7-4603-a3bc-ba4dd7183039 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:56.280861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48149ecd-71c7-4603-a3bc-ba4dd7183039 None admin] RBAC: Adding query filter params (name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:42:56.281200 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48149ecd-71c7-4603-a3bc-ba4dd7183039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:56.282745 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48149ecd-71c7-4603-a3bc-ba4dd7183039 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:56.292033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 605/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:42:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:42:56.298260 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075bc37-8592-44ae-8d71-9c611ce351f5 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:56.347113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:56.425900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075bc37-8592-44ae-8d71-9c611ce351f5 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:56.466919 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1985552-8176-479f-aaea-4620040c4eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:56.467603 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1985552-8176-479f-aaea-4620040c4eb1 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:56.467881 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1985552-8176-479f-aaea-4620040c4eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:56.468177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1985552-8176-479f-aaea-4620040c4eb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:56.482964 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1985552-8176-479f-aaea-4620040c4eb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:56.485723 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1985552-8176-479f-aaea-4620040c4eb1 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:56.505182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-c1985552-8176-479f-aaea-4620040c4eb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:42:56.505182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:42:56.505182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:42:56.505182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:42:56.505182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:42:56.505182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:42:56.505182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:42:56.505182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:42:56.505182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:42:56.505182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:42:56.505182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:42:56.505182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:42:56.505182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:42:56.505182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:42:56.505182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:42:56.505182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:42:56.506747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:42:56.506747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:42:56.506747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:42:56.506747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:42:56.506747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:42:56.506747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:42:56.506747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:42:56.506747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:42:56.506747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:42:56.506747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:42:56.506747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:42:56.506747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:42:56.506747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:42:56.506747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:42:56.506747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:42:56.506747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:42:56.506747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:42:56.507962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:42:56.507962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:42:56.507962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:42:56.507962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 619/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:42:56.515086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48149ecd-71c7-4603-a3bc-ba4dd7183039 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:56.658291 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48149ecd-71c7-4603-a3bc-ba4dd7183039 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:56.699973 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2c46a-d05f-445b-a8a5-ac74f7870404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:56.700570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2c46a-d05f-445b-a8a5-ac74f7870404 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:56.700847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2c46a-d05f-445b-a8a5-ac74f7870404 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:56.701156 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2c46a-d05f-445b-a8a5-ac74f7870404 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:56.701857 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2c46a-d05f-445b-a8a5-ac74f7870404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:42:56.702148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2c46a-d05f-445b-a8a5-ac74f7870404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:56.703584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2c46a-d05f-445b-a8a5-ac74f7870404 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:56.717238 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 606/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:42:56.723382 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1985552-8176-479f-aaea-4620040c4eb1 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:56.843560 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:56.851627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1985552-8176-479f-aaea-4620040c4eb1 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:56.899930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c77e8-46ee-42bf-8f7f-ee6ea7b12292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:56.901039 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c77e8-46ee-42bf-8f7f-ee6ea7b12292 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:56.901501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c77e8-46ee-42bf-8f7f-ee6ea7b12292 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:56.901950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c77e8-46ee-42bf-8f7f-ee6ea7b12292 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:56.915828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c77e8-46ee-42bf-8f7f-ee6ea7b12292 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:56.918409 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c77e8-46ee-42bf-8f7f-ee6ea7b12292 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:56.933308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-962c77e8-46ee-42bf-8f7f-ee6ea7b12292 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:42:56.933308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:42:56.933308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:42:56.933308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:42:56.933308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:42:56.933308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:42:56.933308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:42:56.933308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:42:56.933308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:42:56.933308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:42:56.933308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:42:56.933308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:42:56.933308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:42:56.933308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:42:56.933308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:42:56.933308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:42:56.936003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:42:56.938473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:42:56.938473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:42:56.938473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:42:56.938473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:42:56.938473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:42:56.938473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:42:56.938473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:42:56.938473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:42:56.938473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:42:56.938473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:42:56.938473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 620/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:42:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:42:56.941950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2c46a-d05f-445b-a8a5-ac74f7870404 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:57.010001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:57.097659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2c46a-d05f-445b-a8a5-ac74f7870404 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:57.144290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a26f87-72b7-4d8b-ad2c-83f0fbd1810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:57.145118 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a26f87-72b7-4d8b-ad2c-83f0fbd1810d None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:57.145513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a26f87-72b7-4d8b-ad2c-83f0fbd1810d None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:57.145906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a26f87-72b7-4d8b-ad2c-83f0fbd1810d None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:57.146899 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a26f87-72b7-4d8b-ad2c-83f0fbd1810d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:42:57.147280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a26f87-72b7-4d8b-ad2c-83f0fbd1810d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:57.149197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a26f87-72b7-4d8b-ad2c-83f0fbd1810d None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:57.172367 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 607/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 12 23:42:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:42:57.178600 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c77e8-46ee-42bf-8f7f-ee6ea7b12292 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:57.317359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c77e8-46ee-42bf-8f7f-ee6ea7b12292 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:57.355026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672b374-c424-410e-9ad4-c16dc373070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:57.355697 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672b374-c424-410e-9ad4-c16dc373070c None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:57.356004 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672b374-c424-410e-9ad4-c16dc373070c None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:57.356324 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672b374-c424-410e-9ad4-c16dc373070c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:57.370140 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672b374-c424-410e-9ad4-c16dc373070c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:57.372789 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672b374-c424-410e-9ad4-c16dc373070c None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:57.390102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-7672b374-c424-410e-9ad4-c16dc373070c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:42:57.390102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:42:57.390102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:42:57.390102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:42:57.390102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:42:57.390102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:42:57.390102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:42:57.390102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:42:57.390102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:42:57.390102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:42:57.390102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:42:57.390102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:42:57.390102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:42:57.390102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:42:57.390102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:42:57.390102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:42:57.391532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:42:57.391532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:42:57.391532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:42:57.391532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:42:57.391532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:42:57.391532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:42:57.391532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:42:57.391532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:42:57.391532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:42:57.391532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:42:57.391532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:42:57.391532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:42:57.391532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:42:57.391532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:42:57.391532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:42:57.391532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:42:57.391532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:42:57.393011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:42:57.393011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:42:57.393011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:42:57.393011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 621/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:42:57.400303 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a26f87-72b7-4d8b-ad2c-83f0fbd1810d None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:57.536523 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a26f87-72b7-4d8b-ad2c-83f0fbd1810d None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:57.539728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:57.584906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f85be-9940-4dff-a5a9-aa971bf037d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:57.585559 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f85be-9940-4dff-a5a9-aa971bf037d8 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:57.585839 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f85be-9940-4dff-a5a9-aa971bf037d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:57.586109 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f85be-9940-4dff-a5a9-aa971bf037d8 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:57.586760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f85be-9940-4dff-a5a9-aa971bf037d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:42:57.587065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f85be-9940-4dff-a5a9-aa971bf037d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:57.588439 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f85be-9940-4dff-a5a9-aa971bf037d8 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:57.601913 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 608/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:42:57.611604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672b374-c424-410e-9ad4-c16dc373070c None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:57.627243 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:57.745413 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672b374-c424-410e-9ad4-c16dc373070c None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:57.800506 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6cb40-90ce-467e-8d86-dfde26f94c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:57.800989 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6cb40-90ce-467e-8d86-dfde26f94c4c None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:57.801284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6cb40-90ce-467e-8d86-dfde26f94c4c None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:57.801587 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6cb40-90ce-467e-8d86-dfde26f94c4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:57.812221 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6cb40-90ce-467e-8d86-dfde26f94c4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:57.814481 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6cb40-90ce-467e-8d86-dfde26f94c4c None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:57.829918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-55a6cb40-90ce-467e-8d86-dfde26f94c4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:42:57.829918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:42:57.829918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:42:57.829918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:42:57.829918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:42:57.829918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:42:57.829918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:42:57.829918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:42:57.829918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:42:57.829918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:42:57.829918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:42:57.829918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:42:57.829918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:42:57.829918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:42:57.829918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:42:57.838117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:42:57.838117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:42:57.838117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:42:57.838117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:42:57.838117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:42:57.838117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:42:57.838117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:42:57.838117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:42:57.838117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:42:57.838117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:42:57.838117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:42:57.838117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:42:57.838117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:42:57.838117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:42:57.838117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:42:57.838117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:42:57.838117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:42:57.840424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:42:57.840424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:42:57.840424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:42:57.840424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:42:57.840424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:42:57.840424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:42:57.840424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:42:57.840424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:42:57.840424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 622/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:42:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:42:57.841378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f85be-9940-4dff-a5a9-aa971bf037d8 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:57.980378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f85be-9940-4dff-a5a9-aa971bf037d8 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:58.027460 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7fb84-3f38-45e2-bfb9-29f346eba298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:58.028467 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7fb84-3f38-45e2-bfb9-29f346eba298 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:58.028941 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7fb84-3f38-45e2-bfb9-29f346eba298 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:58.029578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7fb84-3f38-45e2-bfb9-29f346eba298 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:58.030838 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7fb84-3f38-45e2-bfb9-29f346eba298 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:42:58.031365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7fb84-3f38-45e2-bfb9-29f346eba298 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:58.034061 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7fb84-3f38-45e2-bfb9-29f346eba298 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:58.052250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 609/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:42:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:42:58.058352 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6cb40-90ce-467e-8d86-dfde26f94c4c None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:42:58.142764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:42:58.182486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6cb40-90ce-467e-8d86-dfde26f94c4c None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:42:58.234044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796359a2-feb9-4abe-81ed-1a6235dd357f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:42:58.235059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796359a2-feb9-4abe-81ed-1a6235dd357f None admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:42:58.235510 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796359a2-feb9-4abe-81ed-1a6235dd357f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:42:58.235856 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796359a2-feb9-4abe-81ed-1a6235dd357f None admin] PATH_INFO: `/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/4395ee0a00df41adacb55b4a8684786b/roles/8cf7b72483b94512b497317ab1d11192` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:42:58.256652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796359a2-feb9-4abe-81ed-1a6235dd357f None admin] RBAC: Authorizing `identity:create_grant(project_id=21118e9e4fa94603b2c0880dd0d5f5ba, user_id=4395ee0a00df41adacb55b4a8684786b, role_id=8cf7b72483b94512b497317ab1d11192)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:42:58.258244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796359a2-feb9-4abe-81ed-1a6235dd357f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:42:58.273293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 623/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:42:58 2022] PUT /identity/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/4395ee0a00df41adacb55b4a8684786b/roles/8cf7b72483b94512b497317ab1d11192 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:43:00.743228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f28a0-b009-44d0-8d3d-2d32f0bbac41 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:00.743803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f28a0-b009-44d0-8d3d-2d32f0bbac41 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:00.743803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f28a0-b009-44d0-8d3d-2d32f0bbac41 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:00.745438 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 610/1233] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:43:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:43:00.752457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f7f7-4f82-4e51-befa-ba0dec91fccc None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:00.753046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f7f7-4f82-4e51-befa-ba0dec91fccc None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:00.753046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f7f7-4f82-4e51-befa-ba0dec91fccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:00.776917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-2612f7f7-4f82-4e51-befa-ba0dec91fccc None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:43:00.778423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2612f7f7-4f82-4e51-befa-ba0dec91fccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:43:00.873307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 624/1234] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:43:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:43:01.187533 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f28a0-b009-44d0-8d3d-2d32f0bbac41 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:01.224526 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:01.326455 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f28a0-b009-44d0-8d3d-2d32f0bbac41 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:01.373272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598685da-082c-48a5-bf48-d546cf354c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:01.374020 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598685da-082c-48a5-bf48-d546cf354c5e None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:01.374306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598685da-082c-48a5-bf48-d546cf354c5e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:01.374603 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598685da-082c-48a5-bf48-d546cf354c5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:01.390579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598685da-082c-48a5-bf48-d546cf354c5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:43:01.398433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-598685da-082c-48a5-bf48-d546cf354c5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:43:01.398433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:01.398433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:01.398433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:01.398433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:01.398433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:01.398433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:01.398433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:01.398433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:01.398433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:01.398433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:01.398433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:01.398433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:43:01.398433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:43:01.398433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:43:01.398433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:43:01.400281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:43:01.400281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:43:01.400281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:43:01.400281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:43:01.400281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:01.400281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:01.400281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:01.400281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:01.400281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:01.400281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:01.400281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:01.400281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:01.400281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:01.400281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:01.400281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:01.400281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:01.401235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:01.401235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:01.401235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:01.401235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:01.401235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:43:01.401235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:43:01.401235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:43:01.401235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:43:01.401235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:43:01.401235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:43:01.401235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 12 23:43:01.401235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:43:01.401235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 611/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 12 23:43:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:01.407450 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612f7f7-4f82-4e51-befa-ba0dec91fccc None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:01.465796 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:01.532323 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612f7f7-4f82-4e51-befa-ba0dec91fccc None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:01.571096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15497b0c-6dc9-451f-b65f-0e1d303c7644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:01.571947 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15497b0c-6dc9-451f-b65f-0e1d303c7644 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:01.572620 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15497b0c-6dc9-451f-b65f-0e1d303c7644 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:01.573024 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15497b0c-6dc9-451f-b65f-0e1d303c7644 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:01.573845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15497b0c-6dc9-451f-b65f-0e1d303c7644 None admin] RBAC: Adding query filter params (name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:01.574341 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15497b0c-6dc9-451f-b65f-0e1d303c7644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:01.576412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15497b0c-6dc9-451f-b65f-0e1d303c7644 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:01.587751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 625/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 12 23:43:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:01.596742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598685da-082c-48a5-bf48-d546cf354c5e None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:01.723308 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:01.753238 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598685da-082c-48a5-bf48-d546cf354c5e None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:01.812465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc6f34-9d8a-4043-b7b0-965d727e2767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:01.813558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc6f34-9d8a-4043-b7b0-965d727e2767 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:01.814039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc6f34-9d8a-4043-b7b0-965d727e2767 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:01.814492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc6f34-9d8a-4043-b7b0-965d727e2767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:01.832722 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc6f34-9d8a-4043-b7b0-965d727e2767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:01.835432 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc6f34-9d8a-4043-b7b0-965d727e2767 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:01.856617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-cacc6f34-9d8a-4043-b7b0-965d727e2767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:43:01.856617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:01.856617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:01.856617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:01.856617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:01.856617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:01.856617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:01.856617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:01.856617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:01.856617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:01.856617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:01.856617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:01.856617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:43:01.856617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:43:01.856617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:43:01.856617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:43:01.857741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:01.857741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:01.857741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:01.857741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:01.857741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:01.857741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:01.857741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:01.857741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:01.857741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:01.857741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:01.857741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:01.857741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:01.857741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:01.857741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:01.857741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:01.857741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:01.857741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:43:01.858974 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:43:01.858974 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:43:01.858974 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:43:01.858974 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 612/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:01.865646 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15497b0c-6dc9-451f-b65f-0e1d303c7644 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:02.023402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15497b0c-6dc9-451f-b65f-0e1d303c7644 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:02.040901 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:02.082149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71910d7-6741-4b6c-a806-29792141512f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:02.082874 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71910d7-6741-4b6c-a806-29792141512f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:02.083151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71910d7-6741-4b6c-a806-29792141512f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:02.083415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71910d7-6741-4b6c-a806-29792141512f None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:02.084171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71910d7-6741-4b6c-a806-29792141512f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:02.084507 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71910d7-6741-4b6c-a806-29792141512f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:02.086092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71910d7-6741-4b6c-a806-29792141512f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:02.101196 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 626/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:02.110712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc6f34-9d8a-4043-b7b0-965d727e2767 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:02.236227 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc6f34-9d8a-4043-b7b0-965d727e2767 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:02.277372 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf6a3c-2b1e-4321-95d7-12ba0bb90b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:02.278066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf6a3c-2b1e-4321-95d7-12ba0bb90b1a None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:02.278422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf6a3c-2b1e-4321-95d7-12ba0bb90b1a None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:02.278778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf6a3c-2b1e-4321-95d7-12ba0bb90b1a None admin] PATH_INFO: `/v3/users/placement` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:02.286716 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:02.293771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf6a3c-2b1e-4321-95d7-12ba0bb90b1a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:02.295542 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf6a3c-2b1e-4321-95d7-12ba0bb90b1a None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:02.311420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-5aaf6a3c-2b1e-4321-95d7-12ba0bb90b1a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:43:02.311420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:02.311420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:02.311420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:02.311420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:02.311420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:02.311420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:02.311420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:02.311420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:02.311420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:02.311420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:02.311420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:02.311420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:43:02.311420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:43:02.311420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:43:02.311420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:02.312676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:02.313890 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:02.313890 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:02.313890 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:43:02.313890 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:43:02.313890 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:43:02.313890 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:43:02.313890 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:43:02.313890 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:43:02.313890 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:43:02.313890 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:43:02.313890 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 613/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:43:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:02.319794 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71910d7-6741-4b6c-a806-29792141512f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:02.459825 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71910d7-6741-4b6c-a806-29792141512f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:02.497130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e97498-be33-4f36-8a8e-0fd3625a0110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:02.497789 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e97498-be33-4f36-8a8e-0fd3625a0110 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:02.498125 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e97498-be33-4f36-8a8e-0fd3625a0110 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:02.498402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e97498-be33-4f36-8a8e-0fd3625a0110 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:02.499158 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e97498-be33-4f36-8a8e-0fd3625a0110 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:02.499464 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e97498-be33-4f36-8a8e-0fd3625a0110 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:02.500938 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e97498-be33-4f36-8a8e-0fd3625a0110 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:02.520244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 627/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 12 23:43:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:43:02.526488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf6a3c-2b1e-4321-95d7-12ba0bb90b1a None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:02.665696 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf6a3c-2b1e-4321-95d7-12ba0bb90b1a None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:02.711263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba9075-ee6e-4884-a907-37c882ae90af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:02.712385 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba9075-ee6e-4884-a907-37c882ae90af None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:02.712867 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba9075-ee6e-4884-a907-37c882ae90af None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:02.713440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba9075-ee6e-4884-a907-37c882ae90af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:02.803048 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:02.811970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba9075-ee6e-4884-a907-37c882ae90af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:02.813703 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba9075-ee6e-4884-a907-37c882ae90af None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:02.944492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 614/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:43:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 12 23:43:02.951324 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e97498-be33-4f36-8a8e-0fd3625a0110 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:02.981909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:03.070693 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e97498-be33-4f36-8a8e-0fd3625a0110 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:03.118347 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927168c3-52a5-4ec1-bb9b-9654ae40184a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:03.119037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927168c3-52a5-4ec1-bb9b-9654ae40184a None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:03.119285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927168c3-52a5-4ec1-bb9b-9654ae40184a None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:03.119553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927168c3-52a5-4ec1-bb9b-9654ae40184a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:03.131696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927168c3-52a5-4ec1-bb9b-9654ae40184a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:03.133359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927168c3-52a5-4ec1-bb9b-9654ae40184a None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:03.156700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-927168c3-52a5-4ec1-bb9b-9654ae40184a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:43:03.156700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:03.156700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:03.156700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:03.156700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:03.156700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:03.156700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:03.156700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:03.156700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:03.156700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:03.156700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:03.156700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:03.156700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:43:03.156700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:43:03.156700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:43:03.156700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:43:03.158328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:03.158328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:03.158328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:03.158328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:03.158328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:03.158328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:03.158328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:03.158328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:03.158328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:03.158328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:03.158328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:03.158328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:03.158328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:03.158328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:03.158328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:03.158328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:03.158328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:43:03.159292 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:43:03.159292 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:43:03.159292 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:43:03.159292 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 628/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:03.168191 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba9075-ee6e-4884-a907-37c882ae90af None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:03.303717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:03.312887 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba9075-ee6e-4884-a907-37c882ae90af None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:03.360776 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12dde0-3e9f-4ed0-8d73-e05260700135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:03.361529 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12dde0-3e9f-4ed0-8d73-e05260700135 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:03.361840 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12dde0-3e9f-4ed0-8d73-e05260700135 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:03.362129 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12dde0-3e9f-4ed0-8d73-e05260700135 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:03.362839 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12dde0-3e9f-4ed0-8d73-e05260700135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:03.363168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12dde0-3e9f-4ed0-8d73-e05260700135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:03.364718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12dde0-3e9f-4ed0-8d73-e05260700135 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:03.381928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 615/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:03.391793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927168c3-52a5-4ec1-bb9b-9654ae40184a None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:03.500216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:03.531887 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927168c3-52a5-4ec1-bb9b-9654ae40184a None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:03.584717 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211d30f-6d7b-48d0-8865-2ab6074d3cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:03.585407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211d30f-6d7b-48d0-8865-2ab6074d3cf1 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:03.585686 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211d30f-6d7b-48d0-8865-2ab6074d3cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:03.585994 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211d30f-6d7b-48d0-8865-2ab6074d3cf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:03.596133 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211d30f-6d7b-48d0-8865-2ab6074d3cf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:03.598094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211d30f-6d7b-48d0-8865-2ab6074d3cf1 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:03.612381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-6211d30f-6d7b-48d0-8865-2ab6074d3cf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:43:03.612381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:03.612381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:03.612381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:03.612381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:03.612381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:03.612381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:03.612381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:03.612381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:03.612381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:03.612381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:03.612381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:03.612381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:43:03.612381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:43:03.612381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:43:03.614222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:43:03.614222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:03.614222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:03.614222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:03.614222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:03.614222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:03.614222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:03.614222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:03.614222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:03.614222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:03.614222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:03.614222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:03.614222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:03.614222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:03.614222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:03.614222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:03.614222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:03.617132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:43:03.617132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:43:03.617132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:43:03.617132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:43:03.617132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:43:03.617132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:43:03.617132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:43:03.617132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:43:03.617132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 629/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:43:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:03.623240 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12dde0-3e9f-4ed0-8d73-e05260700135 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:03.769869 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12dde0-3e9f-4ed0-8d73-e05260700135 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:03.822535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3f04e-532e-43f9-af06-a8a497b27b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:03.823344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3f04e-532e-43f9-af06-a8a497b27b00 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:03.823588 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3f04e-532e-43f9-af06-a8a497b27b00 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:03.823856 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3f04e-532e-43f9-af06-a8a497b27b00 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:03.824571 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3f04e-532e-43f9-af06-a8a497b27b00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:03.824897 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3f04e-532e-43f9-af06-a8a497b27b00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:03.826375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3f04e-532e-43f9-af06-a8a497b27b00 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:03.842862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 616/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:43:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:43:03.849181 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211d30f-6d7b-48d0-8865-2ab6074d3cf1 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:03.974487 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211d30f-6d7b-48d0-8865-2ab6074d3cf1 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:04.022002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daeed3-f316-4090-93d8-35bafa0e9df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:04.022627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daeed3-f316-4090-93d8-35bafa0e9df4 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:04.022895 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daeed3-f316-4090-93d8-35bafa0e9df4 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:04.023220 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daeed3-f316-4090-93d8-35bafa0e9df4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:04.024079 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daeed3-f316-4090-93d8-35bafa0e9df4 None admin] RBAC: Adding query filter params (role.id=8cf7b72483b94512b497317ab1d11192, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=4395ee0a00df41adacb55b4a8684786b) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:04.024391 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daeed3-f316-4090-93d8-35bafa0e9df4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:04.026532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daeed3-f316-4090-93d8-35bafa0e9df4 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:04.034764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 630/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:43:03 2022] GET /identity/v3/role_assignments?user.id=4395ee0a00df41adacb55b4a8684786b&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=8cf7b72483b94512b497317ab1d11192 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:06.581672 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c24c38-4c3d-4bd8-99b4-c0bd57b04227 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:06.582251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c24c38-4c3d-4bd8-99b4-c0bd57b04227 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:06.582251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c24c38-4c3d-4bd8-99b4-c0bd57b04227 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:06.584422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 617/1247] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:43:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:43:06.591914 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd6d50-2c97-4476-b25d-d7da6896b6bd None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:06.592513 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd6d50-2c97-4476-b25d-d7da6896b6bd None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:06.592513 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd6d50-2c97-4476-b25d-d7da6896b6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:06.599375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:06.613197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-1ddd6d50-2c97-4476-b25d-d7da6896b6bd None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:43:06.615449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1ddd6d50-2c97-4476-b25d-d7da6896b6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:43:06.702813 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 631/1248] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:43:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:43:06.974124 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c24c38-4c3d-4bd8-99b4-c0bd57b04227 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:07.001087 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:07.114484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c24c38-4c3d-4bd8-99b4-c0bd57b04227 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:07.160316 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef6e38-9880-4eb9-8fd8-da6f71a42f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:07.160980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef6e38-9880-4eb9-8fd8-da6f71a42f97 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:07.161261 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef6e38-9880-4eb9-8fd8-da6f71a42f97 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:07.161571 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef6e38-9880-4eb9-8fd8-da6f71a42f97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:07.176223 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef6e38-9880-4eb9-8fd8-da6f71a42f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:43:07.182963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-cbef6e38-9880-4eb9-8fd8-da6f71a42f97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:43:07.182963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:07.182963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:07.182963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:07.182963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:07.182963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:07.182963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:07.182963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:07.182963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:07.182963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:07.182963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:07.182963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:07.182963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:43:07.182963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:43:07.182963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:43:07.182963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:43:07.185528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:43:07.185528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:43:07.185528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:43:07.185528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:43:07.185528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:07.185528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:07.185528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:07.185528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:07.185528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:07.185528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:07.185528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:07.185528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:07.185528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:07.185528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:07.185528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:07.185528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:07.187342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:07.187342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:07.187342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:07.187342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:07.187342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:43:07.187342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:43:07.187342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:43:07.187342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:43:07.187342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:43:07.187342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:43:07.187342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:43:07.187342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:43:07.187342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 618/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:43:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:07.192133 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd6d50-2c97-4476-b25d-d7da6896b6bd None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:07.322970 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd6d50-2c97-4476-b25d-d7da6896b6bd None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:07.363101 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:07.369273 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1b1ac-53c6-415b-8b6c-6040524e0ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:07.370113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1b1ac-53c6-415b-8b6c-6040524e0ec7 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:07.370445 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1b1ac-53c6-415b-8b6c-6040524e0ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:07.370768 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1b1ac-53c6-415b-8b6c-6040524e0ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:07.371508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1b1ac-53c6-415b-8b6c-6040524e0ec7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:07.371869 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1b1ac-53c6-415b-8b6c-6040524e0ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:07.373301 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1b1ac-53c6-415b-8b6c-6040524e0ec7 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:07.382653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 632/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:43:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:07.389843 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef6e38-9880-4eb9-8fd8-da6f71a42f97 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:07.505290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:07.552487 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef6e38-9880-4eb9-8fd8-da6f71a42f97 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:07.596580 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4b68c-033f-4739-950a-904ee0afa4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:07.597417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4b68c-033f-4739-950a-904ee0afa4f7 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:07.597561 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4b68c-033f-4739-950a-904ee0afa4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:07.597811 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4b68c-033f-4739-950a-904ee0afa4f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:07.609939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4b68c-033f-4739-950a-904ee0afa4f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:07.611855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4b68c-033f-4739-950a-904ee0afa4f7 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:07.629403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-bde4b68c-033f-4739-950a-904ee0afa4f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:43:07.629403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:07.629403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:07.629403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:07.629403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:07.629403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:07.629403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:07.629403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:07.629403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:07.629403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:07.629403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:07.629403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:07.629403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:43:07.629403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:43:07.629403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:43:07.629403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:43:07.630630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:07.630630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:07.630630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:07.630630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:07.630630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:07.630630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:07.630630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:07.630630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:07.630630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:07.630630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:07.630630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:07.630630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:07.630630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:07.630630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:07.630630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:07.630630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:07.630630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:43:07.631691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:43:07.631691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:43:07.631691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:43:07.632834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 619/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:07.639378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1b1ac-53c6-415b-8b6c-6040524e0ec7 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:07.792250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1b1ac-53c6-415b-8b6c-6040524e0ec7 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:07.843339 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4183d97-f21c-4883-9f90-b506bd065d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:07.843973 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4183d97-f21c-4883-9f90-b506bd065d1d None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:07.844315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4183d97-f21c-4883-9f90-b506bd065d1d None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:07.844608 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4183d97-f21c-4883-9f90-b506bd065d1d None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:07.845313 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4183d97-f21c-4883-9f90-b506bd065d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:07.845736 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4183d97-f21c-4883-9f90-b506bd065d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:07.847434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4183d97-f21c-4883-9f90-b506bd065d1d None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:07.864892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 633/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:43:07.874871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4b68c-033f-4739-950a-904ee0afa4f7 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:08.028812 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4b68c-033f-4739-950a-904ee0afa4f7 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:08.063920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:08.072746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf845ac3-6a6b-48df-b1ba-10288fc0115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:08.073430 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf845ac3-6a6b-48df-b1ba-10288fc0115f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:08.073710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf845ac3-6a6b-48df-b1ba-10288fc0115f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:08.073978 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf845ac3-6a6b-48df-b1ba-10288fc0115f None admin] PATH_INFO: `/v3/users/placement` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:08.083171 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf845ac3-6a6b-48df-b1ba-10288fc0115f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:08.084735 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf845ac3-6a6b-48df-b1ba-10288fc0115f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:08.098380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-cf845ac3-6a6b-48df-b1ba-10288fc0115f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:43:08.098380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:08.098380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:08.098380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:08.098380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:08.098380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:08.098380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:08.098380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:08.098380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:08.098380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:08.098380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:08.098380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:08.098380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:43:08.098380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:43:08.098380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:43:08.098380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:08.099962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:08.101364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:08.101364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:08.101364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:43:08.101364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:43:08.101364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:43:08.101364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:43:08.101364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:43:08.101364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:43:08.101364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:43:08.101364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:43:08.101364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 620/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:43:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:08.105589 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4183d97-f21c-4883-9f90-b506bd065d1d None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:08.175018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:08.236927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4183d97-f21c-4883-9f90-b506bd065d1d None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:08.282568 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58bdba-c05a-4610-993e-72efa923e0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:08.283314 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58bdba-c05a-4610-993e-72efa923e0b7 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:08.283715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58bdba-c05a-4610-993e-72efa923e0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:08.284088 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58bdba-c05a-4610-993e-72efa923e0b7 None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:08.284925 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58bdba-c05a-4610-993e-72efa923e0b7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:08.285315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58bdba-c05a-4610-993e-72efa923e0b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:08.286883 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58bdba-c05a-4610-993e-72efa923e0b7 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:08.307113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 634/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 12 23:43:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:08.316269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf845ac3-6a6b-48df-b1ba-10288fc0115f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:08.447027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf845ac3-6a6b-48df-b1ba-10288fc0115f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:08.490642 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879b147-6cbd-40f5-b7a8-314c2ac9a825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:08.491424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879b147-6cbd-40f5-b7a8-314c2ac9a825 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:08.491673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879b147-6cbd-40f5-b7a8-314c2ac9a825 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:08.491935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879b147-6cbd-40f5-b7a8-314c2ac9a825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:08.576207 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:08.601510 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879b147-6cbd-40f5-b7a8-314c2ac9a825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:08.603395 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879b147-6cbd-40f5-b7a8-314c2ac9a825 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:08.744135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 621/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:43:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:43:08.745837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58bdba-c05a-4610-993e-72efa923e0b7 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:08.897859 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58bdba-c05a-4610-993e-72efa923e0b7 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:08.923415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:08.960351 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2fb08-b245-44c7-833f-58665192aeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:08.961582 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2fb08-b245-44c7-833f-58665192aeb1 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:08.962272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2fb08-b245-44c7-833f-58665192aeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:08.962753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2fb08-b245-44c7-833f-58665192aeb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:08.981852 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2fb08-b245-44c7-833f-58665192aeb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:08.983567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2fb08-b245-44c7-833f-58665192aeb1 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:09.004244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-70a2fb08-b245-44c7-833f-58665192aeb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:43:09.004244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:09.004244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:09.004244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:09.004244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:09.004244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:09.004244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:09.004244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:09.004244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:09.004244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:09.004244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:09.004244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:09.004244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:43:09.004244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:43:09.004244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:43:09.004244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:43:09.005544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:09.005544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:09.005544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:09.005544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:09.005544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:09.005544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:09.005544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:09.005544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:09.005544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:09.005544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:09.005544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:09.005544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:09.005544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:09.005544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:09.005544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:09.005544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:09.005544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:43:09.006588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:43:09.006588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:43:09.006588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:43:09.006588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 635/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:09.011886 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879b147-6cbd-40f5-b7a8-314c2ac9a825 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:09.115881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:09.130588 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879b147-6cbd-40f5-b7a8-314c2ac9a825 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:09.170665 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161728db-f9af-465a-b9b3-d67133e40a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:09.171320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161728db-f9af-465a-b9b3-d67133e40a3c None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:09.171600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161728db-f9af-465a-b9b3-d67133e40a3c None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:09.171868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161728db-f9af-465a-b9b3-d67133e40a3c None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:09.172533 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161728db-f9af-465a-b9b3-d67133e40a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:09.172834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161728db-f9af-465a-b9b3-d67133e40a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:09.174907 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161728db-f9af-465a-b9b3-d67133e40a3c None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:09.195197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 622/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:43:09.202448 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2fb08-b245-44c7-833f-58665192aeb1 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:09.343959 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2fb08-b245-44c7-833f-58665192aeb1 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:09.380320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db015d01-0e5b-46b2-bb81-f7832c987dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:09.380950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db015d01-0e5b-46b2-bb81-f7832c987dfd None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:09.381228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db015d01-0e5b-46b2-bb81-f7832c987dfd None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:09.381534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db015d01-0e5b-46b2-bb81-f7832c987dfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:09.389639 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db015d01-0e5b-46b2-bb81-f7832c987dfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:09.391213 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db015d01-0e5b-46b2-bb81-f7832c987dfd None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:09.404703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-db015d01-0e5b-46b2-bb81-f7832c987dfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:43:09.404703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:09.404703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:09.404703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:09.404703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:09.404703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:09.404703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:09.404703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:09.404703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:09.404703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:09.404703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:09.404703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:09.404703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:43:09.404703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:43:09.404703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:43:09.405804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:43:09.405804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:09.405804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:09.405804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:09.405804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:09.405804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:09.405804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:09.405804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:09.405804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:09.405804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:09.405804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:09.405804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:09.405804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:09.405804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:09.405804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:09.405804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:09.405804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:09.406907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:43:09.406907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:43:09.406907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:43:09.406907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:43:09.406907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:43:09.406907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:43:09.406907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:43:09.406907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:43:09.406907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 636/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:43:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:09.412436 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161728db-f9af-465a-b9b3-d67133e40a3c None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:09.548540 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161728db-f9af-465a-b9b3-d67133e40a3c None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:09.601087 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7bb96-84ae-474b-87ed-7347956cd2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:09.601775 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7bb96-84ae-474b-87ed-7347956cd2f5 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:09.602366 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7bb96-84ae-474b-87ed-7347956cd2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:09.602366 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7bb96-84ae-474b-87ed-7347956cd2f5 None admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:09.603186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7bb96-84ae-474b-87ed-7347956cd2f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:09.603540 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7bb96-84ae-474b-87ed-7347956cd2f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:09.605321 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7bb96-84ae-474b-87ed-7347956cd2f5 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:09.620157 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 623/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:43:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:09.627130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db015d01-0e5b-46b2-bb81-f7832c987dfd None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:09.655728 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:09.752743 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db015d01-0e5b-46b2-bb81-f7832c987dfd None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:09.788766 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113f02a-67b8-43a6-a034-e9f046c39705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:09.789416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113f02a-67b8-43a6-a034-e9f046c39705 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:09.789700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113f02a-67b8-43a6-a034-e9f046c39705 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:09.789974 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113f02a-67b8-43a6-a034-e9f046c39705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:09.790711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113f02a-67b8-43a6-a034-e9f046c39705 None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=4395ee0a00df41adacb55b4a8684786b) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:09.791019 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113f02a-67b8-43a6-a034-e9f046c39705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:09.792471 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113f02a-67b8-43a6-a034-e9f046c39705 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:09.798305 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 637/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:43:09 2022] GET /identity/v3/role_assignments?user.id=4395ee0a00df41adacb55b4a8684786b&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=440092230f024959a90e846ab29c6367 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:11.983145 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf37995-bc18-4dda-9f6b-698e261e352c None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:11.983927 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf37995-bc18-4dda-9f6b-698e261e352c None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:11.983927 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf37995-bc18-4dda-9f6b-698e261e352c None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:11.985128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 624/1261] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:43:11.991346 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78171083-62c1-42f1-ae93-6ba0b4c65564 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:11.992378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78171083-62c1-42f1-ae93-6ba0b4c65564 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:11.992378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78171083-62c1-42f1-ae93-6ba0b4c65564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:12.017536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-78171083-62c1-42f1-ae93-6ba0b4c65564 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:43:12.019102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-78171083-62c1-42f1-ae93-6ba0b4c65564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:43:12.099317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 638/1262] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:43:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:43:12.376729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf37995-bc18-4dda-9f6b-698e261e352c None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:12.388575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:12.497575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf37995-bc18-4dda-9f6b-698e261e352c None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:12.536401 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277c686-0360-4539-96b1-3c57937d5a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:12.537053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277c686-0360-4539-96b1-3c57937d5a69 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:12.537372 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277c686-0360-4539-96b1-3c57937d5a69 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:12.537643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277c686-0360-4539-96b1-3c57937d5a69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:12.550248 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277c686-0360-4539-96b1-3c57937d5a69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:43:12.555150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-a277c686-0360-4539-96b1-3c57937d5a69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:43:12.555150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:12.555150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:12.555150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:12.555150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:12.555150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:12.555150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:12.555150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:12.555150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:12.555150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:12.555150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:12.555150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:12.555150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:43:12.555150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:43:12.555150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:43:12.555150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:43:12.556341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:43:12.556341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:43:12.556341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:43:12.556341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:43:12.556341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:12.556341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:12.556341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:12.556341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:12.556341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:12.556341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:12.556341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:12.556341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:12.556341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:12.556341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:12.556341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:12.556341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:12.557619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:12.557619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:12.557619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:12.557619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:12.557619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:43:12.557619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:43:12.557619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:43:12.557619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:43:12.557619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:43:12.557619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:43:12.557619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:43:12.557619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:43:12.557619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 625/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:43:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:12.563491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78171083-62c1-42f1-ae93-6ba0b4c65564 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:12.585408 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:12.685662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78171083-62c1-42f1-ae93-6ba0b4c65564 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:12.723599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d0e71-254e-4d56-88a6-2d04a070b1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:12.724225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d0e71-254e-4d56-88a6-2d04a070b1bd None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:12.724511 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d0e71-254e-4d56-88a6-2d04a070b1bd None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:12.724856 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d0e71-254e-4d56-88a6-2d04a070b1bd None admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:12.725604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d0e71-254e-4d56-88a6-2d04a070b1bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:12.725879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d0e71-254e-4d56-88a6-2d04a070b1bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:12.727322 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d0e71-254e-4d56-88a6-2d04a070b1bd None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:12.737066 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 639/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:43:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:12.743443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277c686-0360-4539-96b1-3c57937d5a69 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:12.816572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:12.853963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277c686-0360-4539-96b1-3c57937d5a69 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:12.898426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008bcce-458e-4ce8-9c61-65e030b6135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:12.899066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008bcce-458e-4ce8-9c61-65e030b6135f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:12.899339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008bcce-458e-4ce8-9c61-65e030b6135f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:12.899600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008bcce-458e-4ce8-9c61-65e030b6135f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:12.910682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008bcce-458e-4ce8-9c61-65e030b6135f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:12.912188 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008bcce-458e-4ce8-9c61-65e030b6135f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:12.928186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-9008bcce-458e-4ce8-9c61-65e030b6135f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:43:12.928186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:12.928186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:12.928186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:12.928186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:12.928186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:12.928186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:12.928186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:12.928186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:12.928186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:12.928186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:12.928186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:12.928186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:43:12.928186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:43:12.928186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:43:12.928186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:43:12.929464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:12.929464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:12.929464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:12.929464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:12.929464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:12.929464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:12.929464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:12.929464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:12.929464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:12.929464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:12.929464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:12.929464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:12.929464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:12.929464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:12.929464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:12.929464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:12.929464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:43:12.930677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:43:12.930677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:43:12.930677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:43:12.930677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 626/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:43:12.937452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d0e71-254e-4d56-88a6-2d04a070b1bd None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:13.027658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:13.047067 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d0e71-254e-4d56-88a6-2d04a070b1bd None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:13.085900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ad813-ec22-452d-82aa-1471b74889d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:13.086535 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ad813-ec22-452d-82aa-1471b74889d6 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:13.086809 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ad813-ec22-452d-82aa-1471b74889d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:13.087073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ad813-ec22-452d-82aa-1471b74889d6 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:13.087727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ad813-ec22-452d-82aa-1471b74889d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:13.088023 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ad813-ec22-452d-82aa-1471b74889d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:13.089446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ad813-ec22-452d-82aa-1471b74889d6 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:13.102956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 640/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:13.111259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008bcce-458e-4ce8-9c61-65e030b6135f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:13.226271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008bcce-458e-4ce8-9c61-65e030b6135f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:13.246961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:13.261169 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d7c9d-5506-4229-99a0-7ed530f32421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:13.261826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d7c9d-5506-4229-99a0-7ed530f32421 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:13.262103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d7c9d-5506-4229-99a0-7ed530f32421 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:13.262368 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d7c9d-5506-4229-99a0-7ed530f32421 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:13.270414 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d7c9d-5506-4229-99a0-7ed530f32421 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:13.271865 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d7c9d-5506-4229-99a0-7ed530f32421 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:13.283357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-db0d7c9d-5506-4229-99a0-7ed530f32421 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:43:13.283357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:13.283357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:13.283357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:13.283357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:13.283357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:13.283357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:13.283357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:13.283357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:13.283357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:13.283357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:13.283357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:13.283357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:43:13.283357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:43:13.283357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:43:13.283357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:13.284400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:13.285429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:13.285429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:13.285429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:43:13.285429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:43:13.285429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:43:13.285429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:43:13.285429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:43:13.285429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:43:13.285429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:43:13.285429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:43:13.285429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 627/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:43:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:13.290782 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ad813-ec22-452d-82aa-1471b74889d6 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:13.394234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ad813-ec22-452d-82aa-1471b74889d6 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:13.429700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2722b6-93ef-4bcd-adc0-e9d292a7afeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:13.430354 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2722b6-93ef-4bcd-adc0-e9d292a7afeb None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:13.430627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2722b6-93ef-4bcd-adc0-e9d292a7afeb None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:13.430872 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2722b6-93ef-4bcd-adc0-e9d292a7afeb None admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:13.431628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2722b6-93ef-4bcd-adc0-e9d292a7afeb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:13.431929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2722b6-93ef-4bcd-adc0-e9d292a7afeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:13.433366 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2722b6-93ef-4bcd-adc0-e9d292a7afeb None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:13.443698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:13.452412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 641/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 12 23:43:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:13.458596 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d7c9d-5506-4229-99a0-7ed530f32421 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:13.563417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d7c9d-5506-4229-99a0-7ed530f32421 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:13.597960 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dda6e-6322-48b8-8ebb-9c533b1ffaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:13.598586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dda6e-6322-48b8-8ebb-9c533b1ffaa9 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:13.598864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dda6e-6322-48b8-8ebb-9c533b1ffaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:13.599127 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dda6e-6322-48b8-8ebb-9c533b1ffaa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:13.610701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880dda6e-6322-48b8-8ebb-9c533b1ffaa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:13.612145 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880dda6e-6322-48b8-8ebb-9c533b1ffaa9 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:13.626492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-880dda6e-6322-48b8-8ebb-9c533b1ffaa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:43:13.626492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:13.626492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:13.626492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:13.626492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:13.626492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:13.626492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:13.626492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:13.626492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:13.626492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:13.626492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:13.626492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:13.626492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:43:13.626492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:43:13.626492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:43:13.626492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:43:13.627452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:13.627452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:13.627452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:13.627452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:13.627452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:13.627452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:13.627452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:13.627452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:13.627452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:13.627452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:13.627452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:13.627452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:13.627452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:13.627452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:13.627452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:13.627452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:13.627452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:43:13.628345 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:43:13.628345 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:43:13.628345 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:43:13.628345 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 628/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 12 23:43:13.633900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2722b6-93ef-4bcd-adc0-e9d292a7afeb None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:13.741294 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2722b6-93ef-4bcd-adc0-e9d292a7afeb None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:13.782006 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea43d01-8111-435e-b57b-870934fb3354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:13.782625 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea43d01-8111-435e-b57b-870934fb3354 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:13.782901 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea43d01-8111-435e-b57b-870934fb3354 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:13.783171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea43d01-8111-435e-b57b-870934fb3354 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:13.783813 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea43d01-8111-435e-b57b-870934fb3354 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:13.784117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea43d01-8111-435e-b57b-870934fb3354 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:13.785584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea43d01-8111-435e-b57b-870934fb3354 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:13.797233 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 642/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:13.803398 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dda6e-6322-48b8-8ebb-9c533b1ffaa9 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:13.839206 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:13.911576 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dda6e-6322-48b8-8ebb-9c533b1ffaa9 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:13.948126 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aed94d-b871-4b03-92a1-ac5091504923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:13.948949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aed94d-b871-4b03-92a1-ac5091504923 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:13.949421 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aed94d-b871-4b03-92a1-ac5091504923 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:13.949718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aed94d-b871-4b03-92a1-ac5091504923 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:13.958023 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aed94d-b871-4b03-92a1-ac5091504923 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:13.959843 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aed94d-b871-4b03-92a1-ac5091504923 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:13.973651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-33aed94d-b871-4b03-92a1-ac5091504923 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:43:13.973651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:13.973651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:13.973651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:13.973651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:13.973651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:13.973651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:13.973651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:13.973651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:13.973651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:13.973651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:13.973651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:13.973651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:43:13.973651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:43:13.973651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:43:13.974949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:43:13.974949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:13.974949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:13.974949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:13.974949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:13.974949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:13.974949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:13.974949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:13.974949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:13.974949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:13.974949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:13.974949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:13.974949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:13.974949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:13.974949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:13.974949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:13.974949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:13.975921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:43:13.975921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:43:13.975921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:43:13.975921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:43:13.975921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:43:13.975921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:43:13.975921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:43:13.975921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:43:13.975921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 629/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:43:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:13.981309 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea43d01-8111-435e-b57b-870934fb3354 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:14.039947 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:14.085167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea43d01-8111-435e-b57b-870934fb3354 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:14.120539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a842b8-6dfc-42c9-b9c1-c86bd20ecc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:14.121069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a842b8-6dfc-42c9-b9c1-c86bd20ecc90 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:14.121375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a842b8-6dfc-42c9-b9c1-c86bd20ecc90 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:14.121657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a842b8-6dfc-42c9-b9c1-c86bd20ecc90 None admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:14.122356 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a842b8-6dfc-42c9-b9c1-c86bd20ecc90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:14.122664 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a842b8-6dfc-42c9-b9c1-c86bd20ecc90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:14.124127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a842b8-6dfc-42c9-b9c1-c86bd20ecc90 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:14.136320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 643/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:43:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:14.142772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aed94d-b871-4b03-92a1-ac5091504923 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:14.237391 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:14.247059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aed94d-b871-4b03-92a1-ac5091504923 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:14.282597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e27676-df2c-4d3c-9be4-64e5c430db55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:14.283257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e27676-df2c-4d3c-9be4-64e5c430db55 None admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:14.283535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e27676-df2c-4d3c-9be4-64e5c430db55 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:14.283808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e27676-df2c-4d3c-9be4-64e5c430db55 None admin] PATH_INFO: `/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/4395ee0a00df41adacb55b4a8684786b/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:14.285840 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e27676-df2c-4d3c-9be4-64e5c430db55 None admin] RBAC: Authorizing `identity:create_grant(project_id=21118e9e4fa94603b2c0880dd0d5f5ba, user_id=4395ee0a00df41adacb55b4a8684786b, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:14.287284 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e27676-df2c-4d3c-9be4-64e5c430db55 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:14.301978 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 630/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 12 23:43:14 2022] PUT /identity/v3/projects/21118e9e4fa94603b2c0880dd0d5f5ba/users/4395ee0a00df41adacb55b4a8684786b/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:43:16.425355 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab212d-fb51-462c-b03c-449888093072 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:16.425908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab212d-fb51-462c-b03c-449888093072 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:16.425908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab212d-fb51-462c-b03c-449888093072 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:16.427224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 644/1274] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:43:16.432913 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a09798-a79a-42bb-8986-25a13f3b0384 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:16.433440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a09798-a79a-42bb-8986-25a13f3b0384 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:16.433532 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a09798-a79a-42bb-8986-25a13f3b0384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:16.455317 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-36a09798-a79a-42bb-8986-25a13f3b0384 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:43:16.456545 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-36a09798-a79a-42bb-8986-25a13f3b0384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:43:16.528542 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 631/1275] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:43:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:43:16.807129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab212d-fb51-462c-b03c-449888093072 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:16.913439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab212d-fb51-462c-b03c-449888093072 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:16.930488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:16.953521 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b94d71-d56c-4209-9f9b-30ee50e19765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:16.954177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b94d71-d56c-4209-9f9b-30ee50e19765 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:16.954452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b94d71-d56c-4209-9f9b-30ee50e19765 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:16.954802 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b94d71-d56c-4209-9f9b-30ee50e19765 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:16.966920 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b94d71-d56c-4209-9f9b-30ee50e19765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 12 23:43:16.971812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-f5b94d71-d56c-4209-9f9b-30ee50e19765 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:43:16.971812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:16.971812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:16.971812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:16.971812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:16.971812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:16.971812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:16.971812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:16.971812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:16.971812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:16.971812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:16.971812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:16.971812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 12 23:43:16.971812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 12 23:43:16.971812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 12 23:43:16.971812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 12 23:43:16.972826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 12 23:43:16.972826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 12 23:43:16.972826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 12 23:43:16.972826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 12 23:43:16.972826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:16.972826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:16.972826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:16.972826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:16.972826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:16.972826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:16.972826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:16.972826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:16.972826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:16.972826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:16.972826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:16.972826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:16.974046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:16.974046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:16.974046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:16.974046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:16.974046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 12 23:43:16.974046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 12 23:43:16.974046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 12 23:43:16.974046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 12 23:43:16.974046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 12 23:43:16.974046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 12 23:43:16.974046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 12 23:43:16.974046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:43:16.974046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 645/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 12 23:43:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:16.979779 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a09798-a79a-42bb-8986-25a13f3b0384 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:17.080228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:17.101000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a09798-a79a-42bb-8986-25a13f3b0384 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:17.137273 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbd645-2365-451c-81f4-5f560e071aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:17.137930 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbd645-2365-451c-81f4-5f560e071aa3 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:17.138211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbd645-2365-451c-81f4-5f560e071aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:17.138686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbd645-2365-451c-81f4-5f560e071aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:17.139359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdbd645-2365-451c-81f4-5f560e071aa3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:17.139662 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdbd645-2365-451c-81f4-5f560e071aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:17.141041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdbd645-2365-451c-81f4-5f560e071aa3 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:17.149898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 632/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 12 23:43:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:17.156205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b94d71-d56c-4209-9f9b-30ee50e19765 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:17.263937 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b94d71-d56c-4209-9f9b-30ee50e19765 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:17.302233 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483b8cd-640d-4335-af43-76f76ba9ec9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:17.302863 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483b8cd-640d-4335-af43-76f76ba9ec9f None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:17.303135 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483b8cd-640d-4335-af43-76f76ba9ec9f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:17.303400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483b8cd-640d-4335-af43-76f76ba9ec9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:17.314392 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483b8cd-640d-4335-af43-76f76ba9ec9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:17.317687 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483b8cd-640d-4335-af43-76f76ba9ec9f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:17.332853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-2483b8cd-640d-4335-af43-76f76ba9ec9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:43:17.332853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:17.332853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:17.332853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:17.332853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:17.332853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:17.332853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:17.332853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:17.332853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:17.332853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:17.332853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:17.332853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:17.332853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:43:17.332853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:43:17.332853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:43:17.332853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:43:17.334096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:17.334096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:17.334096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:17.334096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:17.334096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:17.334096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:17.334096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:17.334096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:17.334096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:17.334096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:17.334096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:17.334096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:17.334096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:17.334096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:17.334096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:17.334096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:17.334096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:43:17.335005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:43:17.335005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:43:17.335005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:43:17.335005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 646/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:17.340473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbd645-2365-451c-81f4-5f560e071aa3 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:17.443925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbd645-2365-451c-81f4-5f560e071aa3 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:17.479285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f8361-98a9-41f2-a684-dedfd94cb0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:17.479889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f8361-98a9-41f2-a684-dedfd94cb0d9 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:17.480160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f8361-98a9-41f2-a684-dedfd94cb0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:17.480426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f8361-98a9-41f2-a684-dedfd94cb0d9 None admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:17.481066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f8361-98a9-41f2-a684-dedfd94cb0d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:17.481383 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f8361-98a9-41f2-a684-dedfd94cb0d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:17.482850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f8361-98a9-41f2-a684-dedfd94cb0d9 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:17.496211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 633/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:17.502674 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483b8cd-640d-4335-af43-76f76ba9ec9f None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:17.538655 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:17.617323 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483b8cd-640d-4335-af43-76f76ba9ec9f None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:17.656889 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885d348-00e9-4029-9629-87b66ab0b003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:17.657940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d348-00e9-4029-9629-87b66ab0b003 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:17.658339 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d348-00e9-4029-9629-87b66ab0b003 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:17.658725 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885d348-00e9-4029-9629-87b66ab0b003 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:17.670899 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885d348-00e9-4029-9629-87b66ab0b003 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:17.672353 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885d348-00e9-4029-9629-87b66ab0b003 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:17.684891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-9885d348-00e9-4029-9629-87b66ab0b003 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:43:17.684891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:17.684891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:17.684891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:17.684891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:17.684891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:17.684891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:17.684891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:17.684891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:17.684891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:17.684891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:17.684891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:17.684891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 12 23:43:17.684891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 12 23:43:17.684891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 12 23:43:17.684891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:17.685991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:17.686949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:17.686949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:17.686949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 12 23:43:17.686949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 12 23:43:17.686949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 12 23:43:17.686949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 12 23:43:17.686949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 12 23:43:17.686949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 12 23:43:17.686949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 12 23:43:17.686949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:43:17.686949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 647/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:43:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:17.694747 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f8361-98a9-41f2-a684-dedfd94cb0d9 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:17.700386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:17.809110 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f8361-98a9-41f2-a684-dedfd94cb0d9 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:17.845358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058edd2a-c472-4500-bff3-6504b07e6660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:17.845975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058edd2a-c472-4500-bff3-6504b07e6660 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:17.846256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058edd2a-c472-4500-bff3-6504b07e6660 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:17.846525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058edd2a-c472-4500-bff3-6504b07e6660 None admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:17.847283 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058edd2a-c472-4500-bff3-6504b07e6660 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:17.847586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058edd2a-c472-4500-bff3-6504b07e6660 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:17.849017 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058edd2a-c472-4500-bff3-6504b07e6660 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:17.866963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 634/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 12 23:43:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:17.873094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885d348-00e9-4029-9629-87b66ab0b003 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:17.971079 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:17.981774 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885d348-00e9-4029-9629-87b66ab0b003 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:18.023522 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535589f7-0bef-4acf-912c-37d47f4affe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:18.024163 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535589f7-0bef-4acf-912c-37d47f4affe6 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:18.024503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535589f7-0bef-4acf-912c-37d47f4affe6 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:18.024814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535589f7-0bef-4acf-912c-37d47f4affe6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:18.111909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535589f7-0bef-4acf-912c-37d47f4affe6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:18.113386 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535589f7-0bef-4acf-912c-37d47f4affe6 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:18.207450 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:18.218867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 648/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 12 23:43:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 12 23:43:18.224910 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058edd2a-c472-4500-bff3-6504b07e6660 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:18.287973 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:18.328007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058edd2a-c472-4500-bff3-6504b07e6660 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:18.361061 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15afe85-ddca-4c28-bb40-e539ecc9829e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:18.361724 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15afe85-ddca-4c28-bb40-e539ecc9829e None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:18.361998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15afe85-ddca-4c28-bb40-e539ecc9829e None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:18.362264 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15afe85-ddca-4c28-bb40-e539ecc9829e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:18.374027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15afe85-ddca-4c28-bb40-e539ecc9829e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:18.375767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15afe85-ddca-4c28-bb40-e539ecc9829e None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:18.392466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-d15afe85-ddca-4c28-bb40-e539ecc9829e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:43:18.392466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:18.392466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:18.392466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:18.392466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:18.392466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:18.392466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:18.392466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:18.392466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:18.392466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:18.392466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:18.392466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:18.392466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 12 23:43:18.392466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 12 23:43:18.392466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 12 23:43:18.392466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 12 23:43:18.393692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:18.393692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:18.393692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:18.393692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:18.393692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:18.393692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:18.393692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:18.393692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:18.393692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:18.393692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:18.393692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:18.393692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:18.393692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:18.393692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:18.393692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:18.393692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:18.393692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 12 23:43:18.394597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 12 23:43:18.394597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 12 23:43:18.394597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:43:18.394597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 635/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:18.399783 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535589f7-0bef-4acf-912c-37d47f4affe6 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:18.512901 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535589f7-0bef-4acf-912c-37d47f4affe6 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:18.547784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06389255-7a76-4032-9e18-af3bba804ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:18.548385 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06389255-7a76-4032-9e18-af3bba804ea2 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:18.548661 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06389255-7a76-4032-9e18-af3bba804ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:18.548936 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06389255-7a76-4032-9e18-af3bba804ea2 None admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:18.549623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06389255-7a76-4032-9e18-af3bba804ea2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:18.549925 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06389255-7a76-4032-9e18-af3bba804ea2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:18.551286 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06389255-7a76-4032-9e18-af3bba804ea2 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:18.563031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 649/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 12 23:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:18.569057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15afe85-ddca-4c28-bb40-e539ecc9829e None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:18.672566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15afe85-ddca-4c28-bb40-e539ecc9829e None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:18.686761 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:18.709085 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e5185-1caa-442e-935a-1132dd016a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:18.709810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e5185-1caa-442e-935a-1132dd016a5f None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:18.710047 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e5185-1caa-442e-935a-1132dd016a5f None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:18.710484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e5185-1caa-442e-935a-1132dd016a5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:18.718173 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e5185-1caa-442e-935a-1132dd016a5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:18.719677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e5185-1caa-442e-935a-1132dd016a5f None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:18.731493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application [None req-888e5185-1caa-442e-935a-1132dd016a5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:43:18.731493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:18.731493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:18.731493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:18.731493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:18.731493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:18.731493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:18.731493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:18.731493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:18.731493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:18.731493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:18.731493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:18.731493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 12 23:43:18.731493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 12 23:43:18.731493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 12 23:43:18.732655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 12 23:43:18.732655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:18.732655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:18.732655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:18.732655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:18.732655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:18.732655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:18.732655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:18.732655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:18.732655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:18.732655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:18.732655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:18.732655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:18.732655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:18.732655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:18.732655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:18.732655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:18.733789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 12 23:43:18.733789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 12 23:43:18.733789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 12 23:43:18.733789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 12 23:43:18.733789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 12 23:43:18.733789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 12 23:43:18.733789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 12 23:43:18.733789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: ERROR keystone.server.flask.application Sep 12 23:43:18.733789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 636/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 12 23:43:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:18.740043 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06389255-7a76-4032-9e18-af3bba804ea2 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:18.793026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:18.848797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06389255-7a76-4032-9e18-af3bba804ea2 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:18.883503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe89eb-70b6-40e6-bc4e-29daeb1d31b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:18.884112 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe89eb-70b6-40e6-bc4e-29daeb1d31b0 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:18.884394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe89eb-70b6-40e6-bc4e-29daeb1d31b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:18.884666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe89eb-70b6-40e6-bc4e-29daeb1d31b0 None admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:18.885389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe89eb-70b6-40e6-bc4e-29daeb1d31b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:18.885701 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe89eb-70b6-40e6-bc4e-29daeb1d31b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:18.887139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe89eb-70b6-40e6-bc4e-29daeb1d31b0 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:18.899215 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 650/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 12 23:43:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:18.905754 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e5185-1caa-442e-935a-1132dd016a5f None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:19.009326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e5185-1caa-442e-935a-1132dd016a5f None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:19.044240 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd498423-5199-4d12-8230-2977033e0950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:19.044790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd498423-5199-4d12-8230-2977033e0950 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:19.045067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd498423-5199-4d12-8230-2977033e0950 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:19.045375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd498423-5199-4d12-8230-2977033e0950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:19.046088 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd498423-5199-4d12-8230-2977033e0950 None admin] RBAC: Adding query filter params (role.id=440092230f024959a90e846ab29c6367, scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba, user.id=4395ee0a00df41adacb55b4a8684786b) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:19.046394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd498423-5199-4d12-8230-2977033e0950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:19.047829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd498423-5199-4d12-8230-2977033e0950 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:19.054072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 637/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 12 23:43:18 2022] GET /identity/v3/role_assignments?user.id=4395ee0a00df41adacb55b4a8684786b&scope.project.id=21118e9e4fa94603b2c0880dd0d5f5ba&role.id=440092230f024959a90e846ab29c6367 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:21.200990 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85016ac-0d3e-4965-acb5-ea4023653ae9 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:21.201750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85016ac-0d3e-4965-acb5-ea4023653ae9 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:21.201750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85016ac-0d3e-4965-acb5-ea4023653ae9 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:21.202854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 651/1288] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:43:21.208503 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eaa98-af81-4360-b36c-7320fe9adeee None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:21.208999 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eaa98-af81-4360-b36c-7320fe9adeee None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:21.208999 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62eaa98-af81-4360-b36c-7320fe9adeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:21.228660 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-e62eaa98-af81-4360-b36c-7320fe9adeee None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:43:21.229889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e62eaa98-af81-4360-b36c-7320fe9adeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:43:21.260439 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:21.300731 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 638/1289] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:43:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:43:21.561172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85016ac-0d3e-4965-acb5-ea4023653ae9 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:21.675971 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85016ac-0d3e-4965-acb5-ea4023653ae9 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:21.687584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:21.712356 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72ee57-63cc-4b48-91e3-a9254b2cb7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:21.713033 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72ee57-63cc-4b48-91e3-a9254b2cb7ad None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:21.713314 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72ee57-63cc-4b48-91e3-a9254b2cb7ad None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:21.713622 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72ee57-63cc-4b48-91e3-a9254b2cb7ad None admin] PATH_INFO: `/v3/services/placement` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:21.714245 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72ee57-63cc-4b48-91e3-a9254b2cb7ad None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:21.715745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72ee57-63cc-4b48-91e3-a9254b2cb7ad None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:21.724946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-ab72ee57-63cc-4b48-91e3-a9254b2cb7ad None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:43:21.724946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:21.724946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:43:21.724946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:43:21.724946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:43:21.724946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:43:21.724946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:43:21.724946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:43:21.724946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:43:21.724946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:43:21.724946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:43:21.724946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:43:21.724946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:21.724946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:21.724946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:21.724946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:21.724946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:21.726259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:21.726259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:21.726259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:21.726259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:21.726259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:21.726259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:21.726259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:43:21.726259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:43:21.726259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:43:21.726259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:43:21.726259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:21.726259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:21.726259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:21.726259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:21.726259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:21.726259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:21.727164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:21.727164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:21.727164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:21.727164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:21.727164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:21.727164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:21.727164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:21.727164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:21.727164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:21.727164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:21.727164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:43:21.727164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:43:21.727164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:43:21.727164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:43:21.727164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 652/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 23:43:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:21.734122 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eaa98-af81-4360-b36c-7320fe9adeee None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:21.839042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62eaa98-af81-4360-b36c-7320fe9adeee None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:21.874749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ede0c-8208-4382-bf72-b901106d3fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:21.875360 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ede0c-8208-4382-bf72-b901106d3fcf None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:21.875637 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ede0c-8208-4382-bf72-b901106d3fcf None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:21.875901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ede0c-8208-4382-bf72-b901106d3fcf None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:21.876535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ede0c-8208-4382-bf72-b901106d3fcf None admin] RBAC: Adding query filter params (name=placement) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:21.876831 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ede0c-8208-4382-bf72-b901106d3fcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:21.878236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ede0c-8208-4382-bf72-b901106d3fcf None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:21.883563 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 639/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Sep 12 23:43:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:21.889553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72ee57-63cc-4b48-91e3-a9254b2cb7ad None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:22.017508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72ee57-63cc-4b48-91e3-a9254b2cb7ad None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:22.052195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59aa308-f416-4a4a-bc06-2789929df444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:22.052804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aa308-f416-4a4a-bc06-2789929df444 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:22.053077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aa308-f416-4a4a-bc06-2789929df444 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:22.053371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59aa308-f416-4a4a-bc06-2789929df444 None admin] PATH_INFO: `/v3/services` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:22.053991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59aa308-f416-4a4a-bc06-2789929df444 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:22.054286 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59aa308-f416-4a4a-bc06-2789929df444 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:22.055640 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59aa308-f416-4a4a-bc06-2789929df444 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:22.061174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 653/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Sep 12 23:43:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:24.175221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cfeec-c656-4338-8e7d-053d7b9e2cb9 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:24.175812 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cfeec-c656-4338-8e7d-053d7b9e2cb9 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:24.175812 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cfeec-c656-4338-8e7d-053d7b9e2cb9 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:24.177083 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 640/1293] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:43:24.182643 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd09141-7efd-4023-b1c8-364536610105 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:24.183109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd09141-7efd-4023-b1c8-364536610105 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:24.183209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd09141-7efd-4023-b1c8-364536610105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:24.202526 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-3dd09141-7efd-4023-b1c8-364536610105 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:43:24.203724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3dd09141-7efd-4023-b1c8-364536610105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:43:24.234061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:24.273112 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 654/1294] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:43:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 12 23:43:24.534546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cfeec-c656-4338-8e7d-053d7b9e2cb9 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:24.567143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:24.643903 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cfeec-c656-4338-8e7d-053d7b9e2cb9 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:24.683229 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f8ba3-4013-49fa-845b-68080345a0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:24.683839 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f8ba3-4013-49fa-845b-68080345a0e5 None admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:24.684112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f8ba3-4013-49fa-845b-68080345a0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:24.684375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f8ba3-4013-49fa-845b-68080345a0e5 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:24.685434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f8ba3-4013-49fa-845b-68080345a0e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:24.686800 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f8ba3-4013-49fa-845b-68080345a0e5 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:24.703496 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 641/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 12 23:43:24 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:43:26.853067 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870a381-cd29-4e59-bdeb-cf6af0d5d139 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:26.853660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870a381-cd29-4e59-bdeb-cf6af0d5d139 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:26.853660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870a381-cd29-4e59-bdeb-cf6af0d5d139 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:26.855012 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 655/1296] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:43:26.860657 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae693aa-0172-46f4-b361-da4195a7eb85 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:26.861115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae693aa-0172-46f4-b361-da4195a7eb85 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:26.861209 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae693aa-0172-46f4-b361-da4195a7eb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:26.880422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-0ae693aa-0172-46f4-b361-da4195a7eb85 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:43:26.881651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0ae693aa-0172-46f4-b361-da4195a7eb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:43:26.962647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 642/1297] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:43:26 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:43:27.232820 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870a381-cd29-4e59-bdeb-cf6af0d5d139 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:27.340291 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870a381-cd29-4e59-bdeb-cf6af0d5d139 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:27.379533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c88e4c-209d-4d1b-853f-79e4d7448da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:27.380169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c88e4c-209d-4d1b-853f-79e4d7448da7 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:27.380449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c88e4c-209d-4d1b-853f-79e4d7448da7 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:27.380727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c88e4c-209d-4d1b-853f-79e4d7448da7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:27.381315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c88e4c-209d-4d1b-853f-79e4d7448da7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:27.382860 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c88e4c-209d-4d1b-853f-79e4d7448da7 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:27.391997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-30c88e4c-209d-4d1b-853f-79e4d7448da7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:43:27.391997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:27.391997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:43:27.391997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:43:27.391997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:43:27.391997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:43:27.391997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:43:27.391997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:43:27.391997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:43:27.391997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:43:27.391997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:43:27.391997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:43:27.391997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:27.391997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:27.391997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:27.391997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:27.391997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:27.393109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:27.393109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:27.393109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:27.393109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:27.393109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:27.393109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:27.393109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:43:27.393109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:43:27.393109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:43:27.393109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:43:27.393109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:27.393109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:27.393109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:27.393109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:27.393109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:27.393109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:27.394170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:27.394170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:27.394170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:27.394170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:27.394170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:27.394170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:27.394170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:27.394170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:27.394170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:27.394170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:27.394170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:43:27.394170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:43:27.394170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:43:27.394170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:43:27.394170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 656/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 23:43:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:27.399411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae693aa-0172-46f4-b361-da4195a7eb85 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:27.420457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:27.509326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae693aa-0172-46f4-b361-da4195a7eb85 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:27.545646 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5322b5-9f5e-4fc8-a9fa-13d6883997f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:27.546280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5322b5-9f5e-4fc8-a9fa-13d6883997f7 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:27.546555 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5322b5-9f5e-4fc8-a9fa-13d6883997f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:27.546555 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5322b5-9f5e-4fc8-a9fa-13d6883997f7 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:27.546555 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5322b5-9f5e-4fc8-a9fa-13d6883997f7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:27.546555 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5322b5-9f5e-4fc8-a9fa-13d6883997f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:27.549045 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5322b5-9f5e-4fc8-a9fa-13d6883997f7 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:27.554593 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 643/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Sep 12 23:43:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:27.561168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c88e4c-209d-4d1b-853f-79e4d7448da7 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:27.594207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:27.664704 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c88e4c-209d-4d1b-853f-79e4d7448da7 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:27.700619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267de0ef-795f-4c4d-b802-8ade406f28a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:27.701857 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267de0ef-795f-4c4d-b802-8ade406f28a5 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:27.702004 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267de0ef-795f-4c4d-b802-8ade406f28a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:27.702288 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267de0ef-795f-4c4d-b802-8ade406f28a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:27.703004 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267de0ef-795f-4c4d-b802-8ade406f28a5 None admin] RBAC: Adding query filter params (interface=public, service_id=96f826a946df4cccaeaf291c427c4888, region_id=RegionOne) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:27.703288 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267de0ef-795f-4c4d-b802-8ade406f28a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:27.705075 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267de0ef-795f-4c4d-b802-8ade406f28a5 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:27.711188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 657/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 12 23:43:27 2022] GET /identity/v3/endpoints?service_id=96f826a946df4cccaeaf291c427c4888&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:27.718125 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5322b5-9f5e-4fc8-a9fa-13d6883997f7 None admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:27.813276 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:27.833930 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5322b5-9f5e-4fc8-a9fa-13d6883997f7 None admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:27.872228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb983c4-741b-4e59-88a7-4195a05f861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:27.872984 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb983c4-741b-4e59-88a7-4195a05f861b None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:27.873144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb983c4-741b-4e59-88a7-4195a05f861b None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:27.873447 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb983c4-741b-4e59-88a7-4195a05f861b None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:27.874084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb983c4-741b-4e59-88a7-4195a05f861b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:27.875451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb983c4-741b-4e59-88a7-4195a05f861b None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:27.882661 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 644/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 12 23:43:27 2022] GET /identity/v3/services => generated 2191 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:43:30.033710 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114137-e330-4204-bae1-f4c3e61b659a None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:30.034337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114137-e330-4204-bae1-f4c3e61b659a None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:30.034337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114137-e330-4204-bae1-f4c3e61b659a None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:30.035641 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 658/1302] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:43:30.041973 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395335a-d83f-4934-b275-e238b66770b6 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:30.042551 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395335a-d83f-4934-b275-e238b66770b6 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:30.042551 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395335a-d83f-4934-b275-e238b66770b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:30.063691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-6395335a-d83f-4934-b275-e238b66770b6 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:43:30.064913 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6395335a-d83f-4934-b275-e238b66770b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:43:30.135918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 645/1303] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:43:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 12 23:43:30.400627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1114137-e330-4204-bae1-f4c3e61b659a None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:30.497517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:30.504979 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1114137-e330-4204-bae1-f4c3e61b659a None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:30.543711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b837c7-aa90-4953-b423-d5c7708ac629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:30.544356 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b837c7-aa90-4953-b423-d5c7708ac629 None admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:30.544725 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b837c7-aa90-4953-b423-d5c7708ac629 None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:30.544966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b837c7-aa90-4953-b423-d5c7708ac629 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:30.545564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b837c7-aa90-4953-b423-d5c7708ac629 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:30.546924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b837c7-aa90-4953-b423-d5c7708ac629 None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:30.555862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application [None req-26b837c7-aa90-4953-b423-d5c7708ac629 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:43:30.555862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:30.555862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 12 23:43:30.555862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 12 23:43:30.555862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 12 23:43:30.555862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 12 23:43:30.555862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 12 23:43:30.555862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:43:30.555862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:43:30.555862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:43:30.555862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 12 23:43:30.555862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:43:30.555862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 12 23:43:30.555862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 12 23:43:30.555862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 12 23:43:30.555862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 12 23:43:30.555862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 12 23:43:30.557553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 12 23:43:30.557553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 12 23:43:30.557553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 12 23:43:30.557553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 12 23:43:30.557553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 12 23:43:30.557553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 12 23:43:30.557553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 12 23:43:30.557553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 12 23:43:30.557553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 12 23:43:30.557553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 12 23:43:30.557553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 12 23:43:30.557553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 12 23:43:30.557553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 12 23:43:30.557553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 12 23:43:30.557553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 12 23:43:30.557553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 12 23:43:30.558680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 12 23:43:30.558680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application with Lock( Sep 12 23:43:30.558680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 12 23:43:30.558680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self._enter() Sep 12 23:43:30.558680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 12 23:43:30.558680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 12 23:43:30.558680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 12 23:43:30.558680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application return self.creator() Sep 12 23:43:30.558680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 12 23:43:30.558680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application created_value = creator( Sep 12 23:43:30.558680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 12 23:43:30.558680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 12 23:43:30.558680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 12 23:43:30.558680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: ERROR keystone.server.flask.application Sep 12 23:43:30.558680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 659/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 12 23:43:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 12 23:43:30.563697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395335a-d83f-4934-b275-e238b66770b6 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:30.644199 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:30.668916 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395335a-d83f-4934-b275-e238b66770b6 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:30.705035 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf58de-e7ea-4344-8f77-f4313cc05db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:30.706110 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf58de-e7ea-4344-8f77-f4313cc05db8 None admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:30.706482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf58de-e7ea-4344-8f77-f4313cc05db8 None admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:30.706990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf58de-e7ea-4344-8f77-f4313cc05db8 None admin] PATH_INFO: `/v3/services` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:30.708052 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf58de-e7ea-4344-8f77-f4313cc05db8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:43:30.708494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf58de-e7ea-4344-8f77-f4313cc05db8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:30.710849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf58de-e7ea-4344-8f77-f4313cc05db8 None admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:30.720147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 646/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Sep 12 23:43:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:43:30.729658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b837c7-aa90-4953-b423-d5c7708ac629 None admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:43:30.840547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b837c7-aa90-4953-b423-d5c7708ac629 None admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:43:30.878329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ae78b-4240-4a54-a5b3-7c370d76039f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:43:30.878935 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ae78b-4240-4a54-a5b3-7c370d76039f None admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:43:30.879209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ae78b-4240-4a54-a5b3-7c370d76039f None admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:43:30.879471 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ae78b-4240-4a54-a5b3-7c370d76039f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:43:30.880142 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ae78b-4240-4a54-a5b3-7c370d76039f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:43:30.881529 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ae78b-4240-4a54-a5b3-7c370d76039f None admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:43:30.903198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 660/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:43:30 2022] POST /identity/v3/endpoints => generated 331 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:43:40.714407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=30 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:43:40.898364 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:44:39.393590 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd8377-f769-414c-9678-4498364d22f4 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:39.394053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd8377-f769-414c-9678-4498364d22f4 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:39.394224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd8377-f769-414c-9678-4498364d22f4 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:39.401379 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372e440-4d91-4800-a9a3-3aa5845299c7 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:39.401912 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372e440-4d91-4800-a9a3-3aa5845299c7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:39.401912 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372e440-4d91-4800-a9a3-3aa5845299c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:39.407019 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 647/1307] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:44:39 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:44:39.532935 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-c372e440-4d91-4800-a9a3-3aa5845299c7 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:44:39.534263 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c372e440-4d91-4800-a9a3-3aa5845299c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:39.667051 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 661/1308] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:44:39.970447 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45f75b-f763-4661-81ea-61c08ec9612e None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:39.970721 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45f75b-f763-4661-81ea-61c08ec9612e None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:39.971083 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45f75b-f763-4661-81ea-61c08ec9612e None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:39.972795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 648/1309] 10.222.0.23 () {54 vars in 965 bytes} [Mon Sep 12 23:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:44:39.980403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ed6ae-f66e-4fbc-9054-cd455f5dafef None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:39.980711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ed6ae-f66e-4fbc-9054-cd455f5dafef None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:39.981121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ed6ae-f66e-4fbc-9054-cd455f5dafef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:40.128341 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-309ed6ae-f66e-4fbc-9054-cd455f5dafef None None] MFA Rules not processed for user `a5814ac53752455697e050944b6d32b7`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:44:40.130994 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-309ed6ae-f66e-4fbc-9054-cd455f5dafef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:40.168821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:44:40.242102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 662/1310] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Sep 12 23:44:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:44:40.252901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45f75b-f763-4661-81ea-61c08ec9612e None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:44:40.255942 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ac45f75b-f763-4661-81ea-61c08ec9612e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:40.434904 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45f75b-f763-4661-81ea-61c08ec9612e None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:44:40.552250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68045d95-1384-4abb-b843-eeaff603ed5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:44:40.552892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68045d95-1384-4abb-b843-eeaff603ed5b service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:40.553265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68045d95-1384-4abb-b843-eeaff603ed5b service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:40.553442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68045d95-1384-4abb-b843-eeaff603ed5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:40.555428 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-68045d95-1384-4abb-b843-eeaff603ed5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:40.651619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:44:40.767586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68045d95-1384-4abb-b843-eeaff603ed5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:44:40.770250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68045d95-1384-4abb-b843-eeaff603ed5b service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:44:40.813824 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 649/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:44:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:44:44.387301 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9e10b-7380-4707-bd20-41cb44b9b8bb None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:44.387931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9e10b-7380-4707-bd20-41cb44b9b8bb None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:44.387931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9e10b-7380-4707-bd20-41cb44b9b8bb None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:44.389220 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 663/1312] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:44:44.395534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a0388-a69c-43bd-bb15-f37d638a925f None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:44.396188 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a0388-a69c-43bd-bb15-f37d638a925f None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:44.396188 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a0388-a69c-43bd-bb15-f37d638a925f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:44.473573 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-579a0388-a69c-43bd-bb15-f37d638a925f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:44:44.474762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-579a0388-a69c-43bd-bb15-f37d638a925f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:44.584195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 650/1313] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:44:44.865468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9e10b-7380-4707-bd20-41cb44b9b8bb None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:44:44.867402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-87d9e10b-7380-4707-bd20-41cb44b9b8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:44.979685 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9e10b-7380-4707-bd20-41cb44b9b8bb None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:44:45.056269 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:44:45.059492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2aaf2e-a8cc-435a-9363-26da6e3411c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:44:45.060381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2aaf2e-a8cc-435a-9363-26da6e3411c0 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:45.060645 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2aaf2e-a8cc-435a-9363-26da6e3411c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:45.060916 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2aaf2e-a8cc-435a-9363-26da6e3411c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:45.063108 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2d2aaf2e-a8cc-435a-9363-26da6e3411c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:45.178454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2aaf2e-a8cc-435a-9363-26da6e3411c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:44:45.179901 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2aaf2e-a8cc-435a-9363-26da6e3411c0 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:44:45.200760 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 664/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:44:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:44:47.715204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d4181-238b-4e46-a546-69a85801c2d6 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:47.715742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d4181-238b-4e46-a546-69a85801c2d6 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:47.715742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d4181-238b-4e46-a546-69a85801c2d6 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:47.717038 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 651/1315] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:44:47.722611 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821090bc-2dce-422d-8440-3a01f43ab3af None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:47.723070 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821090bc-2dce-422d-8440-3a01f43ab3af None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:47.723182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821090bc-2dce-422d-8440-3a01f43ab3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:47.793762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-821090bc-2dce-422d-8440-3a01f43ab3af None None] MFA Rules not processed for user `9b84663de808427898fa66e8b8174931`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:44:47.795059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-821090bc-2dce-422d-8440-3a01f43ab3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:47.851265 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:44:47.897604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 665/1316] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:44:47 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:44:48.179298 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d4181-238b-4e46-a546-69a85801c2d6 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:44:48.181275 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-8d6d4181-238b-4e46-a546-69a85801c2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:48.196153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:44:48.302736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d4181-238b-4e46-a546-69a85801c2d6 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:44:48.387991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945203f2-b894-4c6b-b23a-20f19fae6503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:44:48.388611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945203f2-b894-4c6b-b23a-20f19fae6503 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:48.388885 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945203f2-b894-4c6b-b23a-20f19fae6503 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:48.389146 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945203f2-b894-4c6b-b23a-20f19fae6503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:48.390803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-945203f2-b894-4c6b-b23a-20f19fae6503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:48.456136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:44:48.505573 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945203f2-b894-4c6b-b23a-20f19fae6503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:44:48.507010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945203f2-b894-4c6b-b23a-20f19fae6503 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:44:48.527400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 652/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:44:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:44:51.314693 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c2416-0f68-44c3-81ce-9f2dc5575662 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:51.315239 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c2416-0f68-44c3-81ce-9f2dc5575662 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:51.315239 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c2416-0f68-44c3-81ce-9f2dc5575662 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:51.316601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 666/1318] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:44:51.322782 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fab47-0477-4fa9-bb89-436746af3e40 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:51.323285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fab47-0477-4fa9-bb89-436746af3e40 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:51.323285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fab47-0477-4fa9-bb89-436746af3e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:51.396745 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-9e2fab47-0477-4fa9-bb89-436746af3e40 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:44:51.397910 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9e2fab47-0477-4fa9-bb89-436746af3e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:51.501100 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 653/1319] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:44:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:44:51.806475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40c545-db62-4dc2-97c2-e971925d94fd None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:51.806907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40c545-db62-4dc2-97c2-e971925d94fd None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:51.807359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40c545-db62-4dc2-97c2-e971925d94fd None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:51.809714 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 667/1320] 10.222.0.23 () {54 vars in 965 bytes} [Mon Sep 12 23:44:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:44:51.816153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62b6a4-3789-4f51-b5aa-1550bc5e2838 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:51.816431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62b6a4-3789-4f51-b5aa-1550bc5e2838 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:51.816701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62b6a4-3789-4f51-b5aa-1550bc5e2838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:51.841730 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:44:51.920500 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-9c62b6a4-3789-4f51-b5aa-1550bc5e2838 None None] MFA Rules not processed for user `a5814ac53752455697e050944b6d32b7`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:44:51.921765 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9c62b6a4-3789-4f51-b5aa-1550bc5e2838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:52.009237 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 654/1321] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Sep 12 23:44:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:44:52.018741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40c545-db62-4dc2-97c2-e971925d94fd None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:44:52.020332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-8d40c545-db62-4dc2-97c2-e971925d94fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:52.140884 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40c545-db62-4dc2-97c2-e971925d94fd None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:44:52.221121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247bc5e-1fa4-44c2-a4f7-1f9a113f8985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:44:52.221805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247bc5e-1fa4-44c2-a4f7-1f9a113f8985 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:52.222084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247bc5e-1fa4-44c2-a4f7-1f9a113f8985 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:52.222354 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247bc5e-1fa4-44c2-a4f7-1f9a113f8985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:52.224195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1247bc5e-1fa4-44c2-a4f7-1f9a113f8985 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:52.232938 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:44:52.354734 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247bc5e-1fa4-44c2-a4f7-1f9a113f8985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:44:52.356192 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247bc5e-1fa4-44c2-a4f7-1f9a113f8985 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:44:52.377198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 668/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:44:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:44:55.641972 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e810446-9029-4cbe-82a2-6463f4420914 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:55.642643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e810446-9029-4cbe-82a2-6463f4420914 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:55.642643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e810446-9029-4cbe-82a2-6463f4420914 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:55.643893 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 655/1323] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:44:55.649700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3e99a-d152-44de-aea6-e36c70b373d4 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:55.650218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3e99a-d152-44de-aea6-e36c70b373d4 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:55.650346 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3e99a-d152-44de-aea6-e36c70b373d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:55.739766 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-83d3e99a-d152-44de-aea6-e36c70b373d4 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:44:55.741077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-83d3e99a-d152-44de-aea6-e36c70b373d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:55.813209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:44:55.864011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 669/1324] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:44:56.144617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e810446-9029-4cbe-82a2-6463f4420914 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:44:56.146229 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5e810446-9029-4cbe-82a2-6463f4420914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:56.270395 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e810446-9029-4cbe-82a2-6463f4420914 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:44:56.286655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:44:56.357846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb2729-2f58-4089-bfab-711f30e2b17a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:44:56.358462 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb2729-2f58-4089-bfab-711f30e2b17a service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:56.358745 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb2729-2f58-4089-bfab-711f30e2b17a service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:56.359011 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb2729-2f58-4089-bfab-711f30e2b17a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:56.360680 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-20cb2729-2f58-4089-bfab-711f30e2b17a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:56.490088 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb2729-2f58-4089-bfab-711f30e2b17a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:44:56.491562 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb2729-2f58-4089-bfab-711f30e2b17a service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:44:56.513904 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 656/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:44:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:44:58.755917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b719b9-486c-41c2-aa66-e7df936f4c8b None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:58.756497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b719b9-486c-41c2-aa66-e7df936f4c8b None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:58.756497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b719b9-486c-41c2-aa66-e7df936f4c8b None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:58.758152 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 670/1326] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:44:58.763813 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370f638-b3af-4d3d-9ae6-a00412c172b7 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:58.764576 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370f638-b3af-4d3d-9ae6-a00412c172b7 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:58.764576 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370f638-b3af-4d3d-9ae6-a00412c172b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:58.821332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:44:58.843486 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-a370f638-b3af-4d3d-9ae6-a00412c172b7 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:44:58.844708 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a370f638-b3af-4d3d-9ae6-a00412c172b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:58.968220 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 657/1327] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:44:59.244950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b719b9-486c-41c2-aa66-e7df936f4c8b None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:44:59.246618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-45b719b9-486c-41c2-aa66-e7df936f4c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:59.362977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b719b9-486c-41c2-aa66-e7df936f4c8b None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:44:59.456576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c372f02-0c1e-420d-be7d-6d0be099a09a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:44:59.457255 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c372f02-0c1e-420d-be7d-6d0be099a09a service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:44:59.457572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c372f02-0c1e-420d-be7d-6d0be099a09a service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:44:59.457846 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c372f02-0c1e-420d-be7d-6d0be099a09a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:44:59.459600 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3c372f02-0c1e-420d-be7d-6d0be099a09a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:44:59.480430 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:44:59.589514 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c372f02-0c1e-420d-be7d-6d0be099a09a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:44:59.591443 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c372f02-0c1e-420d-be7d-6d0be099a09a service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:44:59.616470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 671/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:45:01.842488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfe6c1-e4aa-4c90-85af-206f345ae544 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:01.843045 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfe6c1-e4aa-4c90-85af-206f345ae544 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:01.843045 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfe6c1-e4aa-4c90-85af-206f345ae544 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:01.844291 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 658/1329] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:01.850174 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86edb38-c874-4b58-87bb-01898d18e3f2 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:01.850752 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86edb38-c874-4b58-87bb-01898d18e3f2 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:01.850752 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86edb38-c874-4b58-87bb-01898d18e3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:01.934278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-e86edb38-c874-4b58-87bb-01898d18e3f2 None None] MFA Rules not processed for user `9b84663de808427898fa66e8b8174931`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:01.935600 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-e86edb38-c874-4b58-87bb-01898d18e3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:02.006126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:02.039574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 672/1330] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:45:01 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:45:02.338236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfe6c1-e4aa-4c90-85af-206f345ae544 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:45:02.339892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-3edfe6c1-e4aa-4c90-85af-206f345ae544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:02.462958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfe6c1-e4aa-4c90-85af-206f345ae544 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:45:02.488165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:02.573032 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346e860-a342-4e62-9de0-d7ccd6b4ff88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:45:02.573723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346e860-a342-4e62-9de0-d7ccd6b4ff88 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:02.574002 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346e860-a342-4e62-9de0-d7ccd6b4ff88 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:02.574272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346e860-a342-4e62-9de0-d7ccd6b4ff88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:02.576177 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-1346e860-a342-4e62-9de0-d7ccd6b4ff88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:02.718644 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346e860-a342-4e62-9de0-d7ccd6b4ff88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:45:02.720036 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346e860-a342-4e62-9de0-d7ccd6b4ff88 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:45:02.741031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 659/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:45:02 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:45:05.164768 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e19d7b-730a-464b-a365-debd75329ff6 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:05.165376 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e19d7b-730a-464b-a365-debd75329ff6 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:05.165376 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e19d7b-730a-464b-a365-debd75329ff6 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:05.166685 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 673/1332] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:05.172491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56f4ab-7599-4b35-8796-97ca7bddec9b None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:05.173026 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56f4ab-7599-4b35-8796-97ca7bddec9b None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:05.173026 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56f4ab-7599-4b35-8796-97ca7bddec9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:05.246457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:05.250351 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-ca56f4ab-7599-4b35-8796-97ca7bddec9b None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:05.252348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ca56f4ab-7599-4b35-8796-97ca7bddec9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:05.375861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 660/1333] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:45:05.656344 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e19d7b-730a-464b-a365-debd75329ff6 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:45:05.658094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-27e19d7b-730a-464b-a365-debd75329ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:05.778747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e19d7b-730a-464b-a365-debd75329ff6 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:45:05.857942 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d96826-f606-4f85-a183-42406e207711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:45:05.858559 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d96826-f606-4f85-a183-42406e207711 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:05.858845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d96826-f606-4f85-a183-42406e207711 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:05.859101 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d96826-f606-4f85-a183-42406e207711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:05.860727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d5d96826-f606-4f85-a183-42406e207711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:05.894716 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:06.002891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d96826-f606-4f85-a183-42406e207711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:45:06.005994 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d96826-f606-4f85-a183-42406e207711 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:45:06.029384 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 674/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:45:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:45:08.215782 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7953df-8e8c-42e3-b752-1659b0f1bf64 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:08.216369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7953df-8e8c-42e3-b752-1659b0f1bf64 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:08.216369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7953df-8e8c-42e3-b752-1659b0f1bf64 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:08.217697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 661/1335] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:08.223771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2debb2-9c85-4f10-a382-2fe7376957e6 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:08.224262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2debb2-9c85-4f10-a382-2fe7376957e6 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:08.224262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2debb2-9c85-4f10-a382-2fe7376957e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:08.299322 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-8e2debb2-9c85-4f10-a382-2fe7376957e6 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:08.300573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-8e2debb2-9c85-4f10-a382-2fe7376957e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:08.384897 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:08.411553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 675/1336] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:45:08.687282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7953df-8e8c-42e3-b752-1659b0f1bf64 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:45:08.688831 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9d7953df-8e8c-42e3-b752-1659b0f1bf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:08.804108 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7953df-8e8c-42e3-b752-1659b0f1bf64 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:45:08.837160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:08.891499 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e33ff-7b14-4784-8d17-e36c42127c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:45:08.892111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e33ff-7b14-4784-8d17-e36c42127c6c service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:08.892391 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e33ff-7b14-4784-8d17-e36c42127c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:08.892658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e33ff-7b14-4784-8d17-e36c42127c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:08.894319 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c56e33ff-7b14-4784-8d17-e36c42127c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:09.015418 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e33ff-7b14-4784-8d17-e36c42127c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:45:09.016906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e33ff-7b14-4784-8d17-e36c42127c6c service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:45:09.035508 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 662/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:45:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:45:11.572627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e901d3c-2843-439f-987e-8ce0c555ff34 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:11.573236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e901d3c-2843-439f-987e-8ce0c555ff34 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:11.573236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e901d3c-2843-439f-987e-8ce0c555ff34 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:11.574551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 676/1338] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:11.579977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec3a72-e69e-4979-8c87-fc3d820c3e26 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:11.580431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec3a72-e69e-4979-8c87-fc3d820c3e26 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:11.580545 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec3a72-e69e-4979-8c87-fc3d820c3e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:11.647334 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-deec3a72-e69e-4979-8c87-fc3d820c3e26 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:11.648536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-deec3a72-e69e-4979-8c87-fc3d820c3e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:11.657182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:11.755339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 663/1339] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:45:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:45:12.029596 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e901d3c-2843-439f-987e-8ce0c555ff34 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:45:12.031196 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5e901d3c-2843-439f-987e-8ce0c555ff34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:12.153128 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e901d3c-2843-439f-987e-8ce0c555ff34 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:45:12.234430 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e14d74-a52a-481d-b637-0a13d67adc7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:45:12.235049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e14d74-a52a-481d-b637-0a13d67adc7e service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:12.235320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e14d74-a52a-481d-b637-0a13d67adc7e service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:12.235582 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e14d74-a52a-481d-b637-0a13d67adc7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:12.238465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-77e14d74-a52a-481d-b637-0a13d67adc7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:12.278081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:12.360638 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e14d74-a52a-481d-b637-0a13d67adc7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:45:12.362102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e14d74-a52a-481d-b637-0a13d67adc7e service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:45:12.382089 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 677/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:45:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:45:16.660719 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514a1fa-5000-46c6-bd55-233c0d016f67 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:16.661287 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514a1fa-5000-46c6-bd55-233c0d016f67 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:16.661287 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514a1fa-5000-46c6-bd55-233c0d016f67 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:16.663411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 664/1341] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:16.670172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fc2de-e938-4cac-94d6-25843186af28 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:16.671029 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fc2de-e938-4cac-94d6-25843186af28 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:16.671029 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fc2de-e938-4cac-94d6-25843186af28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:16.750561 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-a85fc2de-e938-4cac-94d6-25843186af28 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:16.751823 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a85fc2de-e938-4cac-94d6-25843186af28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:16.854357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:16.870675 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 678/1342] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:45:17.159750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514a1fa-5000-46c6-bd55-233c0d016f67 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:45:17.161302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6514a1fa-5000-46c6-bd55-233c0d016f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:17.276862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514a1fa-5000-46c6-bd55-233c0d016f67 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:45:17.323003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:17.367853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6986a-cec1-4b37-a997-1d46684ad474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:45:17.368455 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6986a-cec1-4b37-a997-1d46684ad474 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:17.368725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6986a-cec1-4b37-a997-1d46684ad474 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:17.368991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6986a-cec1-4b37-a997-1d46684ad474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:17.370697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-70b6986a-cec1-4b37-a997-1d46684ad474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:17.519622 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6986a-cec1-4b37-a997-1d46684ad474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:45:17.521257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6986a-cec1-4b37-a997-1d46684ad474 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:45:17.540728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 665/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:45:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:45:20.460563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66539773-6e06-4a5f-8b6b-32fff3b9dbdc None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:20.461183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66539773-6e06-4a5f-8b6b-32fff3b9dbdc None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:20.461183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66539773-6e06-4a5f-8b6b-32fff3b9dbdc None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:20.462493 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 679/1344] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:20.469125 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376855fd-2c6a-4929-803e-b333f13fd9eb None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:20.469656 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376855fd-2c6a-4929-803e-b333f13fd9eb None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:20.470124 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376855fd-2c6a-4929-803e-b333f13fd9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:20.570504 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-376855fd-2c6a-4929-803e-b333f13fd9eb None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:20.571909 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-376855fd-2c6a-4929-803e-b333f13fd9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:20.596210 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:20.700116 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 666/1345] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:45:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:45:20.995428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66539773-6e06-4a5f-8b6b-32fff3b9dbdc None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:45:20.997118 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-66539773-6e06-4a5f-8b6b-32fff3b9dbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:21.117659 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66539773-6e06-4a5f-8b6b-32fff3b9dbdc None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:45:21.208995 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed02722-7ae1-4400-b35e-b186b4ab7a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:45:21.209634 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed02722-7ae1-4400-b35e-b186b4ab7a0c service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:21.209926 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed02722-7ae1-4400-b35e-b186b4ab7a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:21.210194 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed02722-7ae1-4400-b35e-b186b4ab7a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:21.211827 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1ed02722-7ae1-4400-b35e-b186b4ab7a0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:21.256773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:21.330615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed02722-7ae1-4400-b35e-b186b4ab7a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:45:21.332060 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed02722-7ae1-4400-b35e-b186b4ab7a0c service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:45:21.362188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 680/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:45:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:45:25.911134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52070353-3a44-40b3-9e62-2a259d28f86f None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:25.912258 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52070353-3a44-40b3-9e62-2a259d28f86f None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:25.912258 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52070353-3a44-40b3-9e62-2a259d28f86f None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:25.917397 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 667/1347] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:25.920195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eb54a-d410-4941-91fa-2ee17a3a06ed None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:25.921032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eb54a-d410-4941-91fa-2ee17a3a06ed None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:25.921202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eb54a-d410-4941-91fa-2ee17a3a06ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:26.018020 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-ff3eb54a-d410-4941-91fa-2ee17a3a06ed None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:26.019673 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ff3eb54a-d410-4941-91fa-2ee17a3a06ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:26.151357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:26.155640 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 681/1348] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:45:26.443317 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52070353-3a44-40b3-9e62-2a259d28f86f None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:45:26.444927 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-52070353-3a44-40b3-9e62-2a259d28f86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:26.567965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52070353-3a44-40b3-9e62-2a259d28f86f None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:45:26.625113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:26.654585 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24332f-5292-4916-a83b-e1e12e97c2e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:45:26.654585 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24332f-5292-4916-a83b-e1e12e97c2e4 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:26.654585 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24332f-5292-4916-a83b-e1e12e97c2e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:26.654992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24332f-5292-4916-a83b-e1e12e97c2e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:26.656342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9e24332f-5292-4916-a83b-e1e12e97c2e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:26.776362 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24332f-5292-4916-a83b-e1e12e97c2e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:45:26.777862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24332f-5292-4916-a83b-e1e12e97c2e4 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:45:26.797015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 668/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:45:31.853965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5d29c-9a58-4274-8223-139edb01eaf7 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:31.854539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5d29c-9a58-4274-8223-139edb01eaf7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:31.854539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5d29c-9a58-4274-8223-139edb01eaf7 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:31.857996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 682/1350] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 23:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:31.863903 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d70a7-71a5-460a-8ab8-16240b7bd9c7 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:31.863903 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d70a7-71a5-460a-8ab8-16240b7bd9c7 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:31.867840 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d70a7-71a5-460a-8ab8-16240b7bd9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:31.983085 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-970d70a7-71a5-460a-8ab8-16240b7bd9c7 None None] MFA Rules not processed for user `4395ee0a00df41adacb55b4a8684786b`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:31.984314 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-970d70a7-71a5-460a-8ab8-16240b7bd9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:32.010169 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:32.111735 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 669/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 23:45:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:45:36.793462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5cd40-955b-4070-ac7d-ee1111dc7405 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:36.795069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5cd40-955b-4070-ac7d-ee1111dc7405 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:36.795604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5cd40-955b-4070-ac7d-ee1111dc7405 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:36.798310 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 683/1352] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 23:45:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:36.803954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea240e2c-2f74-40f6-925a-a6a2eca714e5 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:36.804690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea240e2c-2f74-40f6-925a-a6a2eca714e5 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:36.804690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea240e2c-2f74-40f6-925a-a6a2eca714e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:36.913158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-ea240e2c-2f74-40f6-925a-a6a2eca714e5 None None] MFA Rules not processed for user `4395ee0a00df41adacb55b4a8684786b`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:36.915424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ea240e2c-2f74-40f6-925a-a6a2eca714e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:37.041281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:37.089645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 670/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 23:45:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:45:39.247129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188fb5d-a374-4228-b4d1-3913543d4459 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:39.247938 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188fb5d-a374-4228-b4d1-3913543d4459 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:39.247938 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188fb5d-a374-4228-b4d1-3913543d4459 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:39.249973 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 684/1354] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 23:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:39.258354 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d55ecc-3cd9-4d3c-82c4-0fd474c131bf None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:39.259148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d55ecc-3cd9-4d3c-82c4-0fd474c131bf None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:39.259355 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d55ecc-3cd9-4d3c-82c4-0fd474c131bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:39.403054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-e2d55ecc-3cd9-4d3c-82c4-0fd474c131bf None None] MFA Rules not processed for user `4395ee0a00df41adacb55b4a8684786b`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:39.404822 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e2d55ecc-3cd9-4d3c-82c4-0fd474c131bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:39.556255 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 671/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 23:45:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:45:42.895277 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79099840-1c85-4bc9-aec8-f7a63316b888 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:42.895943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79099840-1c85-4bc9-aec8-f7a63316b888 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:42.895943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79099840-1c85-4bc9-aec8-f7a63316b888 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:42.897094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 685/1356] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:42.902810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4ddd8-4c5d-441e-a57a-e525f4281fe1 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:42.903304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4ddd8-4c5d-441e-a57a-e525f4281fe1 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:42.903437 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4ddd8-4c5d-441e-a57a-e525f4281fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:42.951322 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:42.986143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-6cb4ddd8-4c5d-441e-a57a-e525f4281fe1 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:42.987360 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6cb4ddd8-4c5d-441e-a57a-e525f4281fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:43.137983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 672/1357] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:45:43.440898 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718da71-23a1-4713-a118-e80399a4616a None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:43.441184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718da71-23a1-4713-a118-e80399a4616a None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:43.441469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718da71-23a1-4713-a118-e80399a4616a None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:43.443270 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 686/1358] 10.222.0.23 () {54 vars in 962 bytes} [Mon Sep 12 23:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:43.454315 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d7e0a-02e8-4987-8866-9bf2268a2053 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:43.454977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d7e0a-02e8-4987-8866-9bf2268a2053 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:43.455417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d7e0a-02e8-4987-8866-9bf2268a2053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:43.607558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-829d7e0a-02e8-4987-8866-9bf2268a2053 None None] MFA Rules not processed for user `4a87e18c89ff419f8e428e376d33462c`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:43.609454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-829d7e0a-02e8-4987-8866-9bf2268a2053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:43.698643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:43.818818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 673/1359] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Sep 12 23:45:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:45:43.830037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718da71-23a1-4713-a118-e80399a4616a None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:45:43.832852 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1718da71-23a1-4713-a118-e80399a4616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:44.013632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718da71-23a1-4713-a118-e80399a4616a None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:45:44.104885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:44.151757 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e5bfa-0c3d-4c78-b207-4dd994c60622 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:45:44.152427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e5bfa-0c3d-4c78-b207-4dd994c60622 service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:44.152709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e5bfa-0c3d-4c78-b207-4dd994c60622 service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:44.152978 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e5bfa-0c3d-4c78-b207-4dd994c60622 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:44.154666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-637e5bfa-0c3d-4c78-b207-4dd994c60622 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:44.255338 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e5bfa-0c3d-4c78-b207-4dd994c60622 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:45:44.256977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e5bfa-0c3d-4c78-b207-4dd994c60622 service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:45:44.278851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 687/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:45:46.699373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11e758-d2c6-4a8b-a243-8ec2e66e98ff None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:46.700018 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11e758-d2c6-4a8b-a243-8ec2e66e98ff None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:46.700018 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11e758-d2c6-4a8b-a243-8ec2e66e98ff None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:46.701293 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 674/1361] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:46.707289 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a38777-42aa-4756-9af5-1830ba3b1a36 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:46.707748 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a38777-42aa-4756-9af5-1830ba3b1a36 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:46.708115 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a38777-42aa-4756-9af5-1830ba3b1a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:46.826319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-13a38777-42aa-4756-9af5-1830ba3b1a36 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:46.834447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-13a38777-42aa-4756-9af5-1830ba3b1a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:46.896540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:46.976275 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 688/1362] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:45:47.262062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11e758-d2c6-4a8b-a243-8ec2e66e98ff None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:45:47.262784 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0a11e758-d2c6-4a8b-a243-8ec2e66e98ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:47.491611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11e758-d2c6-4a8b-a243-8ec2e66e98ff None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:45:47.512187 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:47.738470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39036d92-bf3d-4ae0-86bf-fd00ed926a51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:45:47.739326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39036d92-bf3d-4ae0-86bf-fd00ed926a51 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:47.739478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39036d92-bf3d-4ae0-86bf-fd00ed926a51 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:47.739829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39036d92-bf3d-4ae0-86bf-fd00ed926a51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:47.741405 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-39036d92-bf3d-4ae0-86bf-fd00ed926a51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:47.871184 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39036d92-bf3d-4ae0-86bf-fd00ed926a51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:45:47.873127 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39036d92-bf3d-4ae0-86bf-fd00ed926a51 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:45:47.895730 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 675/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:45:50.501831 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedc343-d34c-445a-8962-987c049d0c02 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:50.502460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedc343-d34c-445a-8962-987c049d0c02 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:50.502460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedc343-d34c-445a-8962-987c049d0c02 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:50.503903 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 689/1364] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:50.509565 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb81a11-6643-41e9-ae93-658be595b0a1 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:50.510175 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb81a11-6643-41e9-ae93-658be595b0a1 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:50.510175 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb81a11-6643-41e9-ae93-658be595b0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:50.526664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:50.595112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-bcb81a11-6643-41e9-ae93-658be595b0a1 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:50.596439 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-bcb81a11-6643-41e9-ae93-658be595b0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:50.773801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 676/1365] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:45:51.175123 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a08da-7960-47b2-84ec-5ab030e70756 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:51.175603 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a08da-7960-47b2-84ec-5ab030e70756 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:51.176083 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a08da-7960-47b2-84ec-5ab030e70756 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:51.178920 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 690/1366] 10.222.0.23 () {54 vars in 962 bytes} [Mon Sep 12 23:45:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:51.188877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01a81b-a452-43e9-9e54-30fc7a365728 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:51.189305 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01a81b-a452-43e9-9e54-30fc7a365728 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:51.189723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01a81b-a452-43e9-9e54-30fc7a365728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:51.328997 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-ba01a81b-a452-43e9-9e54-30fc7a365728 None None] MFA Rules not processed for user `4a87e18c89ff419f8e428e376d33462c`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:51.331584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ba01a81b-a452-43e9-9e54-30fc7a365728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:51.387605 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:51.513185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 677/1367] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Sep 12 23:45:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:45:51.528013 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a08da-7960-47b2-84ec-5ab030e70756 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:45:51.531379 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a32a08da-7960-47b2-84ec-5ab030e70756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:51.807090 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a08da-7960-47b2-84ec-5ab030e70756 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:45:51.844150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:51.902231 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923640c-68dc-4804-aad8-c529427f0898 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:51.902572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923640c-68dc-4804-aad8-c529427f0898 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:51.902786 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923640c-68dc-4804-aad8-c529427f0898 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:51.904365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 678/1368] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:45:51.909899 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf77ea7-2ffc-4a8d-9407-51e0f85f4a42 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:51.910187 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf77ea7-2ffc-4a8d-9407-51e0f85f4a42 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:51.910473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf77ea7-2ffc-4a8d-9407-51e0f85f4a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:51.981973 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c487e-64e6-44c7-9d44-a0037aec09fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:45:51.982608 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c487e-64e6-44c7-9d44-a0037aec09fd service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:51.982892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c487e-64e6-44c7-9d44-a0037aec09fd service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:51.983150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c487e-64e6-44c7-9d44-a0037aec09fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:51.984868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c70c487e-64e6-44c7-9d44-a0037aec09fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:51.996235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-9bf77ea7-2ffc-4a8d-9407-51e0f85f4a42 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:51.997590 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9bf77ea7-2ffc-4a8d-9407-51e0f85f4a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:52.126141 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:52.136702 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c487e-64e6-44c7-9d44-a0037aec09fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:45:52.139592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c487e-64e6-44c7-9d44-a0037aec09fd service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:45:52.141846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 679/1369] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:45:52.165663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 691/1370] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:45:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:45:52.436171 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ba5d9-5878-4009-bb1e-5eca27e74bcf None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:52.436426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ba5d9-5878-4009-bb1e-5eca27e74bcf None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:52.436703 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ba5d9-5878-4009-bb1e-5eca27e74bcf None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:52.438484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 680/1371] 10.222.0.23 () {54 vars in 964 bytes} [Mon Sep 12 23:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:52.443935 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55525f13-34c5-49aa-988b-53df80959a4e None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:52.444199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55525f13-34c5-49aa-988b-53df80959a4e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:52.444501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55525f13-34c5-49aa-988b-53df80959a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:52.607441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:52.672714 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-55525f13-34c5-49aa-988b-53df80959a4e None None] MFA Rules not processed for user `51d2d1c76c3040dd9e57f83c3860e8fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:52.673913 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-55525f13-34c5-49aa-988b-53df80959a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:52.770571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 692/1372] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Sep 12 23:45:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:45:52.778237 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ba5d9-5878-4009-bb1e-5eca27e74bcf None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:45:52.779756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-8b8ba5d9-5878-4009-bb1e-5eca27e74bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:52.900208 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ba5d9-5878-4009-bb1e-5eca27e74bcf None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:45:52.989289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b1b93-61a2-4535-afc3-e01a917705ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:45:52.990222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b1b93-61a2-4535-afc3-e01a917705ee service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:52.990709 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b1b93-61a2-4535-afc3-e01a917705ee service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:52.991165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b1b93-61a2-4535-afc3-e01a917705ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:52.993004 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-353b1b93-61a2-4535-afc3-e01a917705ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:53.057542 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:53.173910 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b1b93-61a2-4535-afc3-e01a917705ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:45:53.175377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b1b93-61a2-4535-afc3-e01a917705ee service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:45:53.217991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 681/1373] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:45:54.500698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688081d8-6fdc-4cf1-a0fd-61ee8fa6927b None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:54.501410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688081d8-6fdc-4cf1-a0fd-61ee8fa6927b None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:54.501410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688081d8-6fdc-4cf1-a0fd-61ee8fa6927b None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:54.502591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 693/1374] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:54.508649 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475fe8c-53cf-44b8-82a2-323e191b19c9 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:54.509260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475fe8c-53cf-44b8-82a2-323e191b19c9 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:54.509260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475fe8c-53cf-44b8-82a2-323e191b19c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:54.585929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-5475fe8c-53cf-44b8-82a2-323e191b19c9 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:54.587198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5475fe8c-53cf-44b8-82a2-323e191b19c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:54.704023 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 682/1375] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:45:55.030083 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688081d8-6fdc-4cf1-a0fd-61ee8fa6927b None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:45:55.032365 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-688081d8-6fdc-4cf1-a0fd-61ee8fa6927b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:55.185473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:55.238307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688081d8-6fdc-4cf1-a0fd-61ee8fa6927b None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:45:55.377834 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d698dc-1141-446b-9433-22a8e4f9d4f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:45:55.378712 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d698dc-1141-446b-9433-22a8e4f9d4f5 service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:55.379086 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d698dc-1141-446b-9433-22a8e4f9d4f5 service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:55.379636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d698dc-1141-446b-9433-22a8e4f9d4f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:55.381427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-59d698dc-1141-446b-9433-22a8e4f9d4f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:55.494333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:55.508702 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d698dc-1141-446b-9433-22a8e4f9d4f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:45:55.510359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d698dc-1141-446b-9433-22a8e4f9d4f5 service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:45:55.532427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 694/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:45:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:45:57.841923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e3690-83ce-4a0f-a420-210f96d84a9a None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:57.842507 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e3690-83ce-4a0f-a420-210f96d84a9a None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:57.842507 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e3690-83ce-4a0f-a420-210f96d84a9a None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:57.843802 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 683/1377] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:45:57.849973 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aaf0e-dc87-48db-8386-eaf8547a316f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:57.850415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aaf0e-dc87-48db-8386-eaf8547a316f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:57.850497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aaf0e-dc87-48db-8386-eaf8547a316f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:57.926406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-cd3aaf0e-dc87-48db-8386-eaf8547a316f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:45:57.927711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-cd3aaf0e-dc87-48db-8386-eaf8547a316f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:58.073784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 695/1378] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:45:58.523234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e3690-83ce-4a0f-a420-210f96d84a9a None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:45:58.524927 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-710e3690-83ce-4a0f-a420-210f96d84a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:58.528752 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:58.750042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e3690-83ce-4a0f-a420-210f96d84a9a None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:45:58.863624 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:58.915060 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242006f1-e1d4-4683-85bd-a4fa6faf76e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:45:58.915688 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242006f1-e1d4-4683-85bd-a4fa6faf76e6 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:45:58.915967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242006f1-e1d4-4683-85bd-a4fa6faf76e6 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:45:58.916260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242006f1-e1d4-4683-85bd-a4fa6faf76e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:45:58.918161 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-242006f1-e1d4-4683-85bd-a4fa6faf76e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:45:59.034793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242006f1-e1d4-4683-85bd-a4fa6faf76e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:45:59.036727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242006f1-e1d4-4683-85bd-a4fa6faf76e6 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:45:59.060301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 684/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:45:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:01.411120 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047eb002-aa88-49f7-b2c1-f125fd6e9cbc None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:01.411863 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047eb002-aa88-49f7-b2c1-f125fd6e9cbc None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:01.412038 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047eb002-aa88-49f7-b2c1-f125fd6e9cbc None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:01.413770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 696/1380] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:46:01.421030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54350c82-4202-407c-a785-9127c5ebde77 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:01.421790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54350c82-4202-407c-a785-9127c5ebde77 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:01.421790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54350c82-4202-407c-a785-9127c5ebde77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:01.528291 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-54350c82-4202-407c-a785-9127c5ebde77 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:01.530960 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-54350c82-4202-407c-a785-9127c5ebde77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:01.604717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:01.709559 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 685/1381] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:02.060582 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047eb002-aa88-49f7-b2c1-f125fd6e9cbc None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:02.062571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-047eb002-aa88-49f7-b2c1-f125fd6e9cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:02.175101 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:02.315022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047eb002-aa88-49f7-b2c1-f125fd6e9cbc None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:02.475337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1b163-eb6b-438d-912e-1b162e9d7ebd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:02.476498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1b163-eb6b-438d-912e-1b162e9d7ebd service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:02.476882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1b163-eb6b-438d-912e-1b162e9d7ebd service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:02.477375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1b163-eb6b-438d-912e-1b162e9d7ebd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:02.479590 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d4d1b163-eb6b-438d-912e-1b162e9d7ebd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:02.510764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:02.623907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1b163-eb6b-438d-912e-1b162e9d7ebd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:02.627057 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1b163-eb6b-438d-912e-1b162e9d7ebd service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:02.658230 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 697/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:05.584348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903e32a-9742-46a1-ae0c-2172e1f09521 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:05.585335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903e32a-9742-46a1-ae0c-2172e1f09521 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:05.585335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903e32a-9742-46a1-ae0c-2172e1f09521 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:05.587003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 686/1383] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:46:05.597871 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81cafd-37fb-4af7-83ec-42cb6518cb70 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:05.598501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81cafd-37fb-4af7-83ec-42cb6518cb70 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:05.598939 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81cafd-37fb-4af7-83ec-42cb6518cb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:05.728281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-3a81cafd-37fb-4af7-83ec-42cb6518cb70 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:05.729660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3a81cafd-37fb-4af7-83ec-42cb6518cb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:05.871354 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:05.882004 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 698/1384] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:06.240968 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903e32a-9742-46a1-ae0c-2172e1f09521 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:06.242684 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0903e32a-9742-46a1-ae0c-2172e1f09521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:06.426322 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903e32a-9742-46a1-ae0c-2172e1f09521 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:06.452783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:06.589555 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f00326-778d-4a5e-975d-1408ae381581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:06.590609 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f00326-778d-4a5e-975d-1408ae381581 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:06.591139 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f00326-778d-4a5e-975d-1408ae381581 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:06.591444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f00326-778d-4a5e-975d-1408ae381581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:06.594904 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-24f00326-778d-4a5e-975d-1408ae381581 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:06.725881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f00326-778d-4a5e-975d-1408ae381581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:06.727908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f00326-778d-4a5e-975d-1408ae381581 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:06.754121 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 687/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:09.196207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055f79-c34e-4b66-b927-fc76499ecba2 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:09.196855 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055f79-c34e-4b66-b927-fc76499ecba2 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:09.197579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23055f79-c34e-4b66-b927-fc76499ecba2 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:09.201163 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 699/1386] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:46:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:09.207727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d45f8-aa6a-44aa-b941-03e5b0cdca1b None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:09.208319 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d45f8-aa6a-44aa-b941-03e5b0cdca1b None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:09.208319 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d45f8-aa6a-44aa-b941-03e5b0cdca1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:09.248975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:09.287767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-ce2d45f8-aa6a-44aa-b941-03e5b0cdca1b None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:09.289053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ce2d45f8-aa6a-44aa-b941-03e5b0cdca1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:09.410021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 688/1387] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:09.525207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccda69-1a12-4113-b440-3bccc799da98 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:09.525581 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccda69-1a12-4113-b440-3bccc799da98 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:09.525911 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccda69-1a12-4113-b440-3bccc799da98 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:09.527623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 700/1388] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:09.534124 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506992e-14aa-4f16-9949-c1fe09378844 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:09.534380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506992e-14aa-4f16-9949-c1fe09378844 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:09.534810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506992e-14aa-4f16-9949-c1fe09378844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:09.636028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-a506992e-14aa-4f16-9949-c1fe09378844 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:09.638063 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a506992e-14aa-4f16-9949-c1fe09378844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:09.714812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccda69-1a12-4113-b440-3bccc799da98 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:09.716434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-cdccda69-1a12-4113-b440-3bccc799da98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:09.731336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:09.786350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 689/1389] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:09.884387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccda69-1a12-4113-b440-3bccc799da98 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:09.960218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:10.012957 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72346f28-7839-4816-9d3f-e23f9c8d47c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:10.013619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346f28-7839-4816-9d3f-e23f9c8d47c3 service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:10.013890 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346f28-7839-4816-9d3f-e23f9c8d47c3 service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:10.014154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72346f28-7839-4816-9d3f-e23f9c8d47c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:10.015797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-72346f28-7839-4816-9d3f-e23f9c8d47c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:10.096317 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7920f4-50ad-426b-bb94-d0147b9b70e5 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:10.096604 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7920f4-50ad-426b-bb94-d0147b9b70e5 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:10.096875 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7920f4-50ad-426b-bb94-d0147b9b70e5 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:10.098356 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 690/1390] 10.222.0.23 () {54 vars in 966 bytes} [Mon Sep 12 23:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:10.104411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b143ec2-f19d-42c2-ad3f-e9aa8a7ed29d None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:10.104979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b143ec2-f19d-42c2-ad3f-e9aa8a7ed29d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:10.105325 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b143ec2-f19d-42c2-ad3f-e9aa8a7ed29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:10.126485 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72346f28-7839-4816-9d3f-e23f9c8d47c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:10.128164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72346f28-7839-4816-9d3f-e23f9c8d47c3 service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:10.152472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 701/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:10.197517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-4b143ec2-f19d-42c2-ad3f-e9aa8a7ed29d None None] MFA Rules not processed for user `9d21a0c72223417d92e3d8b30ef6bc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:10.197517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4b143ec2-f19d-42c2-ad3f-e9aa8a7ed29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:10.301363 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 691/1392] 10.222.0.23 () {58 vars in 1063 bytes} [Mon Sep 12 23:46:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:10.312447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72346f28-7839-4816-9d3f-e23f9c8d47c3 service nova] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:10.314099 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-72346f28-7839-4816-9d3f-e23f9c8d47c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:10.415202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72346f28-7839-4816-9d3f-e23f9c8d47c3 service nova] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:10.433833 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:10.514483 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4a4cd-536f-476e-8074-dfaa4b4c6679 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21a0c72223417d92e3d8b30ef6bc3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:10.515188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4a4cd-536f-476e-8074-dfaa4b4c6679 service glance] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:10.515495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4a4cd-536f-476e-8074-dfaa4b4c6679 service glance] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:10.515762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4a4cd-536f-476e-8074-dfaa4b4c6679 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:10.517767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c2e4a4cd-536f-476e-8074-dfaa4b4c6679 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:10.682147 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4a4cd-536f-476e-8074-dfaa4b4c6679 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:10.684925 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4a4cd-536f-476e-8074-dfaa4b4c6679 service glance] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:10.710901 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 702/1393] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:11.552424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869ecd7-8c6c-49e1-9512-cd76dd89c983 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:11.553015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869ecd7-8c6c-49e1-9512-cd76dd89c983 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:11.553111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869ecd7-8c6c-49e1-9512-cd76dd89c983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:11.655318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-2869ecd7-8c6c-49e1-9512-cd76dd89c983 None None] MFA Rules not processed for user `e1f49820de264982aeec97fa0be3c290`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:11.656591 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-2869ecd7-8c6c-49e1-9512-cd76dd89c983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:11.658948 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:11.751091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 692/1394] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 23:46:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:11.805422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dda2cb-53df-4c74-bc90-337ccd71bfc6 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:11.805985 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dda2cb-53df-4c74-bc90-337ccd71bfc6 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:11.805985 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dda2cb-53df-4c74-bc90-337ccd71bfc6 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:11.807742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 703/1395] 10.222.0.23 () {54 vars in 943 bytes} [Mon Sep 12 23:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:11.814952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f16df-dd99-404b-a7a6-2ae45d6f8902 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:11.815247 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f16df-dd99-404b-a7a6-2ae45d6f8902 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:11.815574 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f16df-dd99-404b-a7a6-2ae45d6f8902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:11.903689 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-465f16df-dd99-404b-a7a6-2ae45d6f8902 None None] MFA Rules not processed for user `43c45ae3144b4fe8ab4e921fda30164a`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:11.905049 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-465f16df-dd99-404b-a7a6-2ae45d6f8902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:12.044490 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:12.100014 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 693/1396] 10.222.0.23 () {58 vars in 1040 bytes} [Mon Sep 12 23:46:11 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:12.110667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dda2cb-53df-4c74-bc90-337ccd71bfc6 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:12.113552 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b7dda2cb-53df-4c74-bc90-337ccd71bfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:12.173517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:12.281623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dda2cb-53df-4c74-bc90-337ccd71bfc6 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:12.397504 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146fb0e-acf9-47f4-8091-14b54693b43c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c45ae3144b4fe8ab4e921fda30164a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:12.398020 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146fb0e-acf9-47f4-8091-14b54693b43c service swift] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:12.398284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146fb0e-acf9-47f4-8091-14b54693b43c service swift] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:12.398543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146fb0e-acf9-47f4-8091-14b54693b43c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:12.400377 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b146fb0e-acf9-47f4-8091-14b54693b43c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:12.433203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:12.506830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146fb0e-acf9-47f4-8091-14b54693b43c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:12.508431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146fb0e-acf9-47f4-8091-14b54693b43c service swift] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:12.517836 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 704/1397] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 23:46:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:46:12.658935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5a388-04ac-4722-9c86-983a79a6d5fa None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:12.659502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5a388-04ac-4722-9c86-983a79a6d5fa None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:12.659502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5a388-04ac-4722-9c86-983a79a6d5fa None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:12.660859 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 694/1398] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:12.667851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1866a-785f-477e-b30b-cad34c841dd7 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:12.667851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1866a-785f-477e-b30b-cad34c841dd7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:12.667851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1866a-785f-477e-b30b-cad34c841dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:12.752409 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-07d1866a-785f-477e-b30b-cad34c841dd7 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:12.753801 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-07d1866a-785f-477e-b30b-cad34c841dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:12.877425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 705/1399] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:13.168737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5a388-04ac-4722-9c86-983a79a6d5fa None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:13.170273 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-eba5a388-04ac-4722-9c86-983a79a6d5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:13.357877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5a388-04ac-4722-9c86-983a79a6d5fa None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:13.446884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:13.526655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c2801-0cf7-4a94-8373-5499b6f0e95a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:13.527315 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c2801-0cf7-4a94-8373-5499b6f0e95a service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:13.527558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c2801-0cf7-4a94-8373-5499b6f0e95a service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:13.527827 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c2801-0cf7-4a94-8373-5499b6f0e95a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:13.529548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ac2c2801-0cf7-4a94-8373-5499b6f0e95a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:13.646608 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c2801-0cf7-4a94-8373-5499b6f0e95a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:13.648758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c2801-0cf7-4a94-8373-5499b6f0e95a service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:13.674881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 695/1400] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:15.990716 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cac67-22ed-480c-b892-6878404efcc4 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:15.991382 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cac67-22ed-480c-b892-6878404efcc4 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:15.991382 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cac67-22ed-480c-b892-6878404efcc4 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:15.992770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 706/1401] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:15.998928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceaa42-d8bb-418d-843a-75edb1bf0bfc None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:15.999866 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceaa42-d8bb-418d-843a-75edb1bf0bfc None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:16.000396 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceaa42-d8bb-418d-843a-75edb1bf0bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:16.093226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-61ceaa42-d8bb-418d-843a-75edb1bf0bfc None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:16.094558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-61ceaa42-d8bb-418d-843a-75edb1bf0bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:16.111497 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:16.228365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 696/1402] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:16.517728 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57cac67-22ed-480c-b892-6878404efcc4 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:16.519294 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d57cac67-22ed-480c-b892-6878404efcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:16.554772 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:16.736897 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57cac67-22ed-480c-b892-6878404efcc4 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:16.847680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:16.878853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac624f-1a7a-4e4d-b3d6-70a134ae0b04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:16.879488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac624f-1a7a-4e4d-b3d6-70a134ae0b04 service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:16.879767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac624f-1a7a-4e4d-b3d6-70a134ae0b04 service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:16.880047 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac624f-1a7a-4e4d-b3d6-70a134ae0b04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:16.881767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-98ac624f-1a7a-4e4d-b3d6-70a134ae0b04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:17.030625 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac624f-1a7a-4e4d-b3d6-70a134ae0b04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:17.030625 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac624f-1a7a-4e4d-b3d6-70a134ae0b04 service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:17.048542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 707/1403] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:19.339244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a04da7-4b90-4430-abec-08fff65bca14 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:19.340035 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a04da7-4b90-4430-abec-08fff65bca14 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:19.340035 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a04da7-4b90-4430-abec-08fff65bca14 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:19.341370 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 697/1404] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:46:19.347756 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff7827-5492-4369-82d9-2200bbd86e61 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:19.348520 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff7827-5492-4369-82d9-2200bbd86e61 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:19.348876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff7827-5492-4369-82d9-2200bbd86e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:19.443866 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-b8ff7827-5492-4369-82d9-2200bbd86e61 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:19.446305 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b8ff7827-5492-4369-82d9-2200bbd86e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:19.512809 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:19.583011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 708/1405] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:46:19.870550 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a04da7-4b90-4430-abec-08fff65bca14 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:19.872080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c4a04da7-4b90-4430-abec-08fff65bca14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:20.148261 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:20.151491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a04da7-4b90-4430-abec-08fff65bca14 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:20.300369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ababf0-15b0-4b69-aa1b-fa973ba56532 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:20.300987 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ababf0-15b0-4b69-aa1b-fa973ba56532 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:20.301296 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ababf0-15b0-4b69-aa1b-fa973ba56532 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:20.301596 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ababf0-15b0-4b69-aa1b-fa973ba56532 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:20.303258 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c2ababf0-15b0-4b69-aa1b-fa973ba56532 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:20.583357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ababf0-15b0-4b69-aa1b-fa973ba56532 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:20.585050 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ababf0-15b0-4b69-aa1b-fa973ba56532 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:20.604947 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:20.610329 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 698/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:46:22.996199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9a5b8-9930-484e-935f-6754ac45cc98 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:22.996762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9a5b8-9930-484e-935f-6754ac45cc98 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:22.996762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9a5b8-9930-484e-935f-6754ac45cc98 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:23.000186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 709/1407] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:46:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:23.006287 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6682e5f-662d-44ec-b3a5-82aacb3fc7cc None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:23.007399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6682e5f-662d-44ec-b3a5-82aacb3fc7cc None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:23.007842 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6682e5f-662d-44ec-b3a5-82aacb3fc7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:23.154494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-d6682e5f-662d-44ec-b3a5-82aacb3fc7cc None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:23.155878 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-d6682e5f-662d-44ec-b3a5-82aacb3fc7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:23.394140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 699/1408] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:23.696757 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9a5b8-9930-484e-935f-6754ac45cc98 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:23.700208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-cca9a5b8-9930-484e-935f-6754ac45cc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:23.972904 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9a5b8-9930-484e-935f-6754ac45cc98 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:24.023591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:24.164922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52066e4-81dd-4c25-b57b-c09dc16938fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:24.166015 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52066e4-81dd-4c25-b57b-c09dc16938fb service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:24.166692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52066e4-81dd-4c25-b57b-c09dc16938fb service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:24.167240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52066e4-81dd-4c25-b57b-c09dc16938fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:24.170574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b52066e4-81dd-4c25-b57b-c09dc16938fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:24.368058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52066e4-81dd-4c25-b57b-c09dc16938fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:24.370994 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52066e4-81dd-4c25-b57b-c09dc16938fb service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:24.396293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 710/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:33.391933 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=65 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:34.393541 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=81 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:36.078417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c18efd-394e-4bf7-9f2c-a47541a8c7af None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:36.079036 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c18efd-394e-4bf7-9f2c-a47541a8c7af None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:36.079036 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c18efd-394e-4bf7-9f2c-a47541a8c7af None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:36.080319 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 700/1410] 10.222.0.23 () {54 vars in 918 bytes} [Mon Sep 12 23:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:36.086208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8b404-b610-4668-aa22-49479c59917a None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:36.086784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8b404-b610-4668-aa22-49479c59917a None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:36.086784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8b404-b610-4668-aa22-49479c59917a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:36.172279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-d6c8b404-b610-4668-aa22-49479c59917a None None] MFA Rules not processed for user `4395ee0a00df41adacb55b4a8684786b`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:36.173558 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d6c8b404-b610-4668-aa22-49479c59917a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:36.297297 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 711/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Sep 12 23:46:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:36.316975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be561d1-aeaf-47c0-acfd-87d8c924fbb8 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:36.317286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be561d1-aeaf-47c0-acfd-87d8c924fbb8 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:36.317596 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be561d1-aeaf-47c0-acfd-87d8c924fbb8 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:36.318987 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 701/1412] 10.222.0.23 () {54 vars in 918 bytes} [Mon Sep 12 23:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:36.325081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bd037-c198-40fa-9169-5cf42d5d3b24 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:36.325398 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bd037-c198-40fa-9169-5cf42d5d3b24 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:36.325688 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bd037-c198-40fa-9169-5cf42d5d3b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:36.408948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:36.411914 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-531bd037-c198-40fa-9169-5cf42d5d3b24 None None] MFA Rules not processed for user `4a87e18c89ff419f8e428e376d33462c`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:36.413126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-531bd037-c198-40fa-9169-5cf42d5d3b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:36.539994 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 712/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Sep 12 23:46:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:39.128872 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf1138-77fc-40c9-8e16-2f4fbbbe62c0 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:39.129523 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf1138-77fc-40c9-8e16-2f4fbbbe62c0 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:39.129523 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf1138-77fc-40c9-8e16-2f4fbbbe62c0 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:39.130844 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:39.136538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4cdd0-aeb8-451b-8e37-acdb758e8c56 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:39.137027 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4cdd0-aeb8-451b-8e37-acdb758e8c56 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:39.137122 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4cdd0-aeb8-451b-8e37-acdb758e8c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:39.210697 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-6ed4cdd0-aeb8-451b-8e37-acdb758e8c56 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:39.211915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6ed4cdd0-aeb8-451b-8e37-acdb758e8c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:39.270309 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:39.313755 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:39.598047 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf1138-77fc-40c9-8e16-2f4fbbbe62c0 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:39.599569 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-83cf1138-77fc-40c9-8e16-2f4fbbbe62c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:39.755991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf1138-77fc-40c9-8e16-2f4fbbbe62c0 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:39.837646 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:39.880601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b610c-8a53-4eae-b348-31b2bc2a53c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:39.881214 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b610c-8a53-4eae-b348-31b2bc2a53c7 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:39.881543 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b610c-8a53-4eae-b348-31b2bc2a53c7 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:39.881810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b610c-8a53-4eae-b348-31b2bc2a53c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:39.883389 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-085b610c-8a53-4eae-b348-31b2bc2a53c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:39.977782 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b610c-8a53-4eae-b348-31b2bc2a53c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:39.979381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b610c-8a53-4eae-b348-31b2bc2a53c7 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:39.998720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 703/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:41.155882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb8623-caf4-435d-a6db-432a1629d91f None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:41.156463 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb8623-caf4-435d-a6db-432a1629d91f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:41.156463 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb8623-caf4-435d-a6db-432a1629d91f None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:41.157835 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:41.165378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b0888-64fe-421c-b95c-ffa8d733ff3d None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:41.166039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b0888-64fe-421c-b95c-ffa8d733ff3d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:41.166039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b0888-64fe-421c-b95c-ffa8d733ff3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:41.262217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-588b0888-64fe-421c-b95c-ffa8d733ff3d None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:41.263631 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-588b0888-64fe-421c-b95c-ffa8d733ff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:41.294256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:41.379989 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:41.531917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb8623-caf4-435d-a6db-432a1629d91f None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:41.533538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3ccb8623-caf4-435d-a6db-432a1629d91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:41.685765 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb8623-caf4-435d-a6db-432a1629d91f None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:41.727827 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:41.804566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60237b8f-dcef-4e32-8227-7bea5a450ede service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:41.805078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60237b8f-dcef-4e32-8227-7bea5a450ede service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:41.805369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60237b8f-dcef-4e32-8227-7bea5a450ede service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:41.805649 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60237b8f-dcef-4e32-8227-7bea5a450ede service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:41.807705 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-60237b8f-dcef-4e32-8227-7bea5a450ede service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:41.900931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60237b8f-dcef-4e32-8227-7bea5a450ede service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:41.902639 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60237b8f-dcef-4e32-8227-7bea5a450ede service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:41.923065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 715/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:43.061951 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746b489-8c3c-4360-8110-209913abcc0f None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:43.062681 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746b489-8c3c-4360-8110-209913abcc0f None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:43.062681 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746b489-8c3c-4360-8110-209913abcc0f None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:43.063819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:43.070883 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307733b-8edd-42e0-a1b9-59640dfcafc9 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:43.071436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307733b-8edd-42e0-a1b9-59640dfcafc9 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:43.071538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307733b-8edd-42e0-a1b9-59640dfcafc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:43.132800 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:43.156262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-8307733b-8edd-42e0-a1b9-59640dfcafc9 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:43.157525 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-8307733b-8edd-42e0-a1b9-59640dfcafc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:43.260328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:43.417025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746b489-8c3c-4360-8110-209913abcc0f None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:43.418723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6746b489-8c3c-4360-8110-209913abcc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:43.575531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746b489-8c3c-4360-8110-209913abcc0f None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:43.588517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:43.708057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6d8ee-90db-43c1-b91e-22269a95c0a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:43.708577 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6d8ee-90db-43c1-b91e-22269a95c0a5 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:43.708846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6d8ee-90db-43c1-b91e-22269a95c0a5 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:43.709109 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6d8ee-90db-43c1-b91e-22269a95c0a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:43.710781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-81f6d8ee-90db-43c1-b91e-22269a95c0a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:43.804892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6d8ee-90db-43c1-b91e-22269a95c0a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:43.806863 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6d8ee-90db-43c1-b91e-22269a95c0a5 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:43.825669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 706/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:44.943023 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e80d1-b357-4ebc-a474-01ff4bc0313e None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:44.943658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e80d1-b357-4ebc-a474-01ff4bc0313e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:44.943658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e80d1-b357-4ebc-a474-01ff4bc0313e None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:44.945011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:44.951764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be2c58-47c2-4b48-a008-7820fc3a6527 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:44.952266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be2c58-47c2-4b48-a008-7820fc3a6527 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:44.952266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be2c58-47c2-4b48-a008-7820fc3a6527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:44.973737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:45.036257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-06be2c58-47c2-4b48-a008-7820fc3a6527 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:45.037508 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-06be2c58-47c2-4b48-a008-7820fc3a6527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:45.138894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:45.287476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e80d1-b357-4ebc-a474-01ff4bc0313e None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:45.289039 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-463e80d1-b357-4ebc-a474-01ff4bc0313e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:45.402869 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:45.468502 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e80d1-b357-4ebc-a474-01ff4bc0313e None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:45.595320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e655ecd-225c-48d2-8f00-721f4ef5d1d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:45.595942 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e655ecd-225c-48d2-8f00-721f4ef5d1d5 service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:45.596217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e655ecd-225c-48d2-8f00-721f4ef5d1d5 service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:45.596475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e655ecd-225c-48d2-8f00-721f4ef5d1d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:45.598152 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9e655ecd-225c-48d2-8f00-721f4ef5d1d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:45.684090 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:45.698188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e655ecd-225c-48d2-8f00-721f4ef5d1d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:45.699776 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e655ecd-225c-48d2-8f00-721f4ef5d1d5 service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:45.718133 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 718/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:46.867974 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87054dd-8855-4de3-96f0-0ed4eaaa73dd None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:46.868558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87054dd-8855-4de3-96f0-0ed4eaaa73dd None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:46.868558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87054dd-8855-4de3-96f0-0ed4eaaa73dd None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:46.869916 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:46.876497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe1e91-8578-4053-8871-6a6f9b467b8b None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:46.877018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe1e91-8578-4053-8871-6a6f9b467b8b None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:46.877018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe1e91-8578-4053-8871-6a6f9b467b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:46.959201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-05fe1e91-8578-4053-8871-6a6f9b467b8b None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:46.960428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-05fe1e91-8578-4053-8871-6a6f9b467b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:47.064361 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:47.213716 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87054dd-8855-4de3-96f0-0ed4eaaa73dd None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:47.215278 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a87054dd-8855-4de3-96f0-0ed4eaaa73dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:47.306172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:47.371558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87054dd-8855-4de3-96f0-0ed4eaaa73dd None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:47.495647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c74bb-0e3b-4bc4-8a10-374cfa654a4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:47.496254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c74bb-0e3b-4bc4-8a10-374cfa654a4d service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:47.496539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c74bb-0e3b-4bc4-8a10-374cfa654a4d service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:47.496814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c74bb-0e3b-4bc4-8a10-374cfa654a4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:47.498717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-850c74bb-0e3b-4bc4-8a10-374cfa654a4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:47.553696 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:47.600884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c74bb-0e3b-4bc4-8a10-374cfa654a4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:47.602546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c74bb-0e3b-4bc4-8a10-374cfa654a4d service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:47.621721 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 709/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:48.689273 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f3357-0c61-4e39-a2be-55b4c0750eb4 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:48.689862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f3357-0c61-4e39-a2be-55b4c0750eb4 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:48.689862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f3357-0c61-4e39-a2be-55b4c0750eb4 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:48.691344 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:48.698428 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a838e7f-3d69-4dc6-89de-4cbe521f036a None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:48.698928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a838e7f-3d69-4dc6-89de-4cbe521f036a None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:48.699020 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a838e7f-3d69-4dc6-89de-4cbe521f036a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:48.785503 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-1a838e7f-3d69-4dc6-89de-4cbe521f036a None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:48.786739 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-1a838e7f-3d69-4dc6-89de-4cbe521f036a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:48.889520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:49.037985 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f3357-0c61-4e39-a2be-55b4c0750eb4 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:49.039537 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a35f3357-0c61-4e39-a2be-55b4c0750eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:49.095974 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:49.201380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f3357-0c61-4e39-a2be-55b4c0750eb4 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:49.322965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175695b-f47b-47d6-870b-704dd5eed858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:49.323468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175695b-f47b-47d6-870b-704dd5eed858 service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:49.323742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175695b-f47b-47d6-870b-704dd5eed858 service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:49.324009 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175695b-f47b-47d6-870b-704dd5eed858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:49.325666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-7175695b-f47b-47d6-870b-704dd5eed858 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:49.332977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:49.428590 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175695b-f47b-47d6-870b-704dd5eed858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:49.430369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175695b-f47b-47d6-870b-704dd5eed858 service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:49.452355 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 721/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:50.525426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f3aae-9bdd-4312-b627-2ad24970672b None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:50.526034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f3aae-9bdd-4312-b627-2ad24970672b None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:50.526034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f3aae-9bdd-4312-b627-2ad24970672b None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:50.527323 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:50.534169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee32b-1c7d-490b-8df6-9e704afcee1c None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:50.534686 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee32b-1c7d-490b-8df6-9e704afcee1c None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:50.534686 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ee32b-1c7d-490b-8df6-9e704afcee1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:50.610570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-6e6ee32b-1c7d-490b-8df6-9e704afcee1c None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:50.611777 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6e6ee32b-1c7d-490b-8df6-9e704afcee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:50.684293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:50.716232 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:50.865557 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f3aae-9bdd-4312-b627-2ad24970672b None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:50.867112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0f2f3aae-9bdd-4312-b627-2ad24970672b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:50.895993 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:51.039427 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f3aae-9bdd-4312-b627-2ad24970672b None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:51.135382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:51.163963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084df200-3426-4396-9900-31b714199da8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:51.164318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df200-3426-4396-9900-31b714199da8 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:51.164592 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df200-3426-4396-9900-31b714199da8 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:51.164856 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084df200-3426-4396-9900-31b714199da8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:51.166547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-084df200-3426-4396-9900-31b714199da8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:51.262429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084df200-3426-4396-9900-31b714199da8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:51.263931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084df200-3426-4396-9900-31b714199da8 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:51.282557 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 712/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:52.357255 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68a608-35c3-4e09-9b71-a3b3e90739c2 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:52.357933 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68a608-35c3-4e09-9b71-a3b3e90739c2 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:52.357933 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68a608-35c3-4e09-9b71-a3b3e90739c2 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:52.359160 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:52.366051 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824b745-31bb-44c3-82dd-176b109006fe None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:52.366533 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824b745-31bb-44c3-82dd-176b109006fe None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:52.366533 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824b745-31bb-44c3-82dd-176b109006fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:52.448133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-3824b745-31bb-44c3-82dd-176b109006fe None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:52.449383 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-3824b745-31bb-44c3-82dd-176b109006fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:52.494939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:52.551933 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:52.699518 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68a608-35c3-4e09-9b71-a3b3e90739c2 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:52.700953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4c68a608-35c3-4e09-9b71-a3b3e90739c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:52.856890 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68a608-35c3-4e09-9b71-a3b3e90739c2 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:52.916704 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:52.981560 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2702335-eced-437e-b5a2-a93ddaf08e61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:52.982184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2702335-eced-437e-b5a2-a93ddaf08e61 service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:52.982494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2702335-eced-437e-b5a2-a93ddaf08e61 service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:52.982774 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2702335-eced-437e-b5a2-a93ddaf08e61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:52.984393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c2702335-eced-437e-b5a2-a93ddaf08e61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:53.081011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2702335-eced-437e-b5a2-a93ddaf08e61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:53.082832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2702335-eced-437e-b5a2-a93ddaf08e61 service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:53.102257 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 724/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:54.168172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabee61c-3031-42f7-8781-04e4f9aaa317 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:54.168787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabee61c-3031-42f7-8781-04e4f9aaa317 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:54.168787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabee61c-3031-42f7-8781-04e4f9aaa317 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:54.170134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:54.177187 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8376e3c-abd6-416a-b1ab-762bce15e1a1 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:54.177723 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8376e3c-abd6-416a-b1ab-762bce15e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:54.177830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8376e3c-abd6-416a-b1ab-762bce15e1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:54.258715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-a8376e3c-abd6-416a-b1ab-762bce15e1a1 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:54.259970 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a8376e3c-abd6-416a-b1ab-762bce15e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:54.262129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:54.364337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:54.513022 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabee61c-3031-42f7-8781-04e4f9aaa317 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:54.514680 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-fabee61c-3031-42f7-8781-04e4f9aaa317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:54.668498 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabee61c-3031-42f7-8781-04e4f9aaa317 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:54.696912 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:54.789036 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0822ed4-72c5-48e9-8aa8-b32d315720c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:54.789598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0822ed4-72c5-48e9-8aa8-b32d315720c1 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:54.789875 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0822ed4-72c5-48e9-8aa8-b32d315720c1 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:54.790168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0822ed4-72c5-48e9-8aa8-b32d315720c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:54.791964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c0822ed4-72c5-48e9-8aa8-b32d315720c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:54.884743 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0822ed4-72c5-48e9-8aa8-b32d315720c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:54.886569 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0822ed4-72c5-48e9-8aa8-b32d315720c1 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:54.905996 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 715/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:56.986859 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042b73c-af76-4e70-b8a0-709b0e91560e None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:56.987583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042b73c-af76-4e70-b8a0-709b0e91560e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:56.987583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042b73c-af76-4e70-b8a0-709b0e91560e None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:56.989056 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:46:56.996131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960e396-f369-421b-8ff2-d5073a08b002 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:56.996663 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960e396-f369-421b-8ff2-d5073a08b002 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:56.996775 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960e396-f369-421b-8ff2-d5073a08b002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:57.045525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:57.074241 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-0960e396-f369-421b-8ff2-d5073a08b002 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:46:57.075519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0960e396-f369-421b-8ff2-d5073a08b002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:57.177684 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:46:57.460218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042b73c-af76-4e70-b8a0-709b0e91560e None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:46:57.461804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2042b73c-af76-4e70-b8a0-709b0e91560e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:57.578228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042b73c-af76-4e70-b8a0-709b0e91560e None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:46:57.617017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:57.665800 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd6255-f543-4ddd-a6d2-dbeaeff7cb90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:46:57.666380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd6255-f543-4ddd-a6d2-dbeaeff7cb90 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:46:57.666669 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd6255-f543-4ddd-a6d2-dbeaeff7cb90 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:46:57.666937 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd6255-f543-4ddd-a6d2-dbeaeff7cb90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:46:57.668749 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b4bd6255-f543-4ddd-a6d2-dbeaeff7cb90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:46:57.794762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd6255-f543-4ddd-a6d2-dbeaeff7cb90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:46:57.796204 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd6255-f543-4ddd-a6d2-dbeaeff7cb90 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:46:57.815778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 727/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:47:00.117064 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779d8e7-cd8b-4fb0-a8c0-9688760f6211 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:00.117714 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779d8e7-cd8b-4fb0-a8c0-9688760f6211 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:00.117714 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779d8e7-cd8b-4fb0-a8c0-9688760f6211 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:00.118996 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:47:00.124566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571f425-abff-4a1e-8257-a6fcdc4e94ee None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:00.125053 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571f425-abff-4a1e-8257-a6fcdc4e94ee None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:00.125053 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571f425-abff-4a1e-8257-a6fcdc4e94ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:00.198066 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-5571f425-abff-4a1e-8257-a6fcdc4e94ee None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:47:00.199328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5571f425-abff-4a1e-8257-a6fcdc4e94ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:00.212272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:00.301827 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:47:00.579977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779d8e7-cd8b-4fb0-a8c0-9688760f6211 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:47:00.581577 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4779d8e7-cd8b-4fb0-a8c0-9688760f6211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:00.693812 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779d8e7-cd8b-4fb0-a8c0-9688760f6211 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:47:00.707184 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:00.772357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5bf50-9d9f-4e95-b741-ee8e0e089798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:47:00.772967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5bf50-9d9f-4e95-b741-ee8e0e089798 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:00.773240 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5bf50-9d9f-4e95-b741-ee8e0e089798 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:00.773537 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5bf50-9d9f-4e95-b741-ee8e0e089798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:00.775136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-60c5bf50-9d9f-4e95-b741-ee8e0e089798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:00.883983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5bf50-9d9f-4e95-b741-ee8e0e089798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:47:00.885550 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5bf50-9d9f-4e95-b741-ee8e0e089798 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:47:00.904709 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 718/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:47:03.416975 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb3553-ea74-4ec4-ac5b-8d6714d38849 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:03.417495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb3553-ea74-4ec4-ac5b-8d6714d38849 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:03.417619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb3553-ea74-4ec4-ac5b-8d6714d38849 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:03.419013 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:47:03.424684 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b8d33-ec46-491a-810f-24d27c980f8b None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:03.425121 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b8d33-ec46-491a-810f-24d27c980f8b None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:03.425359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b8d33-ec46-491a-810f-24d27c980f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:03.477325 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:03.498956 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-ad9b8d33-ec46-491a-810f-24d27c980f8b None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:47:03.500176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ad9b8d33-ec46-491a-810f-24d27c980f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:03.601498 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:47:03.882586 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb3553-ea74-4ec4-ac5b-8d6714d38849 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:47:03.884262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-60cb3553-ea74-4ec4-ac5b-8d6714d38849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:03.993000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb3553-ea74-4ec4-ac5b-8d6714d38849 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:47:04.036303 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:04.073037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19edc13-22e8-4a68-bb80-f588c2944c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:47:04.073683 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19edc13-22e8-4a68-bb80-f588c2944c9d service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:04.073968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19edc13-22e8-4a68-bb80-f588c2944c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:04.074237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19edc13-22e8-4a68-bb80-f588c2944c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:04.076022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-e19edc13-22e8-4a68-bb80-f588c2944c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:04.195565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19edc13-22e8-4a68-bb80-f588c2944c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:47:04.196908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19edc13-22e8-4a68-bb80-f588c2944c9d service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:47:04.215720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 730/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:47:06.589325 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab5435-e385-46f0-ae4c-dac016dfda07 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:06.589949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab5435-e385-46f0-ae4c-dac016dfda07 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:06.589949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab5435-e385-46f0-ae4c-dac016dfda07 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:06.591278 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:47:06.596835 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dca7a-00bc-4d16-9601-60f626e3fb6a None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:06.597313 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dca7a-00bc-4d16-9601-60f626e3fb6a None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:06.597440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dca7a-00bc-4d16-9601-60f626e3fb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:06.667216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-f60dca7a-00bc-4d16-9601-60f626e3fb6a None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:47:06.668302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-f60dca7a-00bc-4d16-9601-60f626e3fb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:06.690071 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:06.773041 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:47:07.056520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab5435-e385-46f0-ae4c-dac016dfda07 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:47:07.058240 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7bab5435-e385-46f0-ae4c-dac016dfda07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:07.173800 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab5435-e385-46f0-ae4c-dac016dfda07 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:47:07.196292 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:07.252350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f928669-d204-4943-be07-08ef3670d35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:47:07.252964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f928669-d204-4943-be07-08ef3670d35c service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:07.253245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f928669-d204-4943-be07-08ef3670d35c service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:07.253543 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f928669-d204-4943-be07-08ef3670d35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:07.255155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7f928669-d204-4943-be07-08ef3670d35c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:07.369444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f928669-d204-4943-be07-08ef3670d35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:47:07.370781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f928669-d204-4943-be07-08ef3670d35c service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:47:07.389208 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 721/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:47:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:47:09.619842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f0221-dad4-46f5-892d-4b318d4c0c5a None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:09.620454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f0221-dad4-46f5-892d-4b318d4c0c5a None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:09.620571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f0221-dad4-46f5-892d-4b318d4c0c5a None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:09.621904 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:47:09.627952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9501f-414e-4e0f-af99-2c1fa5185d3a None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:09.628401 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9501f-414e-4e0f-af99-2c1fa5185d3a None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:09.628502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9501f-414e-4e0f-af99-2c1fa5185d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:09.697257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:09.700688 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-76c9501f-414e-4e0f-af99-2c1fa5185d3a None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:47:09.702656 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-76c9501f-414e-4e0f-af99-2c1fa5185d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:09.804461 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:47:10.093014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f0221-dad4-46f5-892d-4b318d4c0c5a None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:47:10.094593 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c10f0221-dad4-46f5-892d-4b318d4c0c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:10.204903 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f0221-dad4-46f5-892d-4b318d4c0c5a None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:47:10.257268 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:10.284597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a00a57-0ee7-4d14-89d3-dadc1082ee43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:47:10.285223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a00a57-0ee7-4d14-89d3-dadc1082ee43 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:10.285538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a00a57-0ee7-4d14-89d3-dadc1082ee43 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:10.285832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a00a57-0ee7-4d14-89d3-dadc1082ee43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:10.287450 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d3a00a57-0ee7-4d14-89d3-dadc1082ee43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:10.406208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a00a57-0ee7-4d14-89d3-dadc1082ee43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:47:10.407669 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a00a57-0ee7-4d14-89d3-dadc1082ee43 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:47:10.426009 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 733/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:47:12.649879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b1518-07dc-4787-8cbc-b426f3f84c0d None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:12.650510 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b1518-07dc-4787-8cbc-b426f3f84c0d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:12.650510 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b1518-07dc-4787-8cbc-b426f3f84c0d None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:12.651794 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:47:12.657698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185b08e-89ef-419b-b088-2379bc630713 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:12.658155 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185b08e-89ef-419b-b088-2379bc630713 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:12.658155 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185b08e-89ef-419b-b088-2379bc630713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:12.727737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-e185b08e-89ef-419b-b088-2379bc630713 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:47:12.729117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-e185b08e-89ef-419b-b088-2379bc630713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:12.762351 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:12.833930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:47:13.121232 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b1518-07dc-4787-8cbc-b426f3f84c0d None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:47:13.122799 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-058b1518-07dc-4787-8cbc-b426f3f84c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:13.234911 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b1518-07dc-4787-8cbc-b426f3f84c0d None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:47:13.263667 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:13.312602 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527612f-2bda-4622-b13d-ba6ef6a321b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:47:13.313480 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527612f-2bda-4622-b13d-ba6ef6a321b8 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:13.313767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527612f-2bda-4622-b13d-ba6ef6a321b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:13.314033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527612f-2bda-4622-b13d-ba6ef6a321b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:13.315662 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c527612f-2bda-4622-b13d-ba6ef6a321b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:13.434323 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527612f-2bda-4622-b13d-ba6ef6a321b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:47:13.435771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527612f-2bda-4622-b13d-ba6ef6a321b8 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:47:13.454459 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 724/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:47:15.680650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec6ceb-9fd7-4ac4-b630-eb7a8cb0dcac None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:15.681593 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec6ceb-9fd7-4ac4-b630-eb7a8cb0dcac None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:15.681593 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec6ceb-9fd7-4ac4-b630-eb7a8cb0dcac None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:15.682882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:47:15.688733 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941919f0-dea2-420b-8e6a-5d7652ba493e None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:15.689245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941919f0-dea2-420b-8e6a-5d7652ba493e None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:15.689245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941919f0-dea2-420b-8e6a-5d7652ba493e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:15.758956 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-941919f0-dea2-420b-8e6a-5d7652ba493e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:47:15.760218 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-941919f0-dea2-420b-8e6a-5d7652ba493e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:15.768976 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:15.865416 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:47:16.151038 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec6ceb-9fd7-4ac4-b630-eb7a8cb0dcac None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:47:16.152603 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-19ec6ceb-9fd7-4ac4-b630-eb7a8cb0dcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:16.262007 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec6ceb-9fd7-4ac4-b630-eb7a8cb0dcac None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:47:16.320758 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:16.340880 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063330c-a081-4445-a1ec-b18d2728facb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:47:16.341547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063330c-a081-4445-a1ec-b18d2728facb service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:16.341824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063330c-a081-4445-a1ec-b18d2728facb service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:16.342095 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063330c-a081-4445-a1ec-b18d2728facb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:16.343736 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c063330c-a081-4445-a1ec-b18d2728facb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:16.463914 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063330c-a081-4445-a1ec-b18d2728facb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:47:16.465363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063330c-a081-4445-a1ec-b18d2728facb service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:47:16.484830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 736/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:47:18.695470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43484149-9a27-4e7d-b905-d2924d7d5ddd None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:18.695470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43484149-9a27-4e7d-b905-d2924d7d5ddd None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:18.696272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43484149-9a27-4e7d-b905-d2924d7d5ddd None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:18.697166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:47:18.702999 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f93a3-e087-42f4-9362-80ac5e204a2b None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:18.703461 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f93a3-e087-42f4-9362-80ac5e204a2b None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:18.703564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f93a3-e087-42f4-9362-80ac5e204a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:18.779741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-313f93a3-e087-42f4-9362-80ac5e204a2b None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:47:18.780999 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-313f93a3-e087-42f4-9362-80ac5e204a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:18.820803 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:18.880884 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:47:19.163691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43484149-9a27-4e7d-b905-d2924d7d5ddd None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:47:19.165232 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-43484149-9a27-4e7d-b905-d2924d7d5ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:19.273306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43484149-9a27-4e7d-b905-d2924d7d5ddd None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:47:19.314257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:19.352305 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94960ccc-88cc-4b80-bd81-e33f766f6517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:47:19.352891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94960ccc-88cc-4b80-bd81-e33f766f6517 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:19.353177 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94960ccc-88cc-4b80-bd81-e33f766f6517 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:19.353501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94960ccc-88cc-4b80-bd81-e33f766f6517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:19.355089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-94960ccc-88cc-4b80-bd81-e33f766f6517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:19.472925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94960ccc-88cc-4b80-bd81-e33f766f6517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:47:19.474304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94960ccc-88cc-4b80-bd81-e33f766f6517 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:47:19.492621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 727/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:47:21.690192 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9a9f5-3d0d-43ea-9c3d-a8509309f18a None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:21.690787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9a9f5-3d0d-43ea-9c3d-a8509309f18a None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:21.690787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9a9f5-3d0d-43ea-9c3d-a8509309f18a None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:21.692003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:47:21.697704 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1be8bc-7a4c-4939-a260-76e929c500c3 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:21.698193 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1be8bc-7a4c-4939-a260-76e929c500c3 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:21.698193 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1be8bc-7a4c-4939-a260-76e929c500c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:21.770611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-1f1be8bc-7a4c-4939-a260-76e929c500c3 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:47:21.771813 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-1f1be8bc-7a4c-4939-a260-76e929c500c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:21.790864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:21.873837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:47:22.151132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9a9f5-3d0d-43ea-9c3d-a8509309f18a None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:47:22.152695 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-aaa9a9f5-3d0d-43ea-9c3d-a8509309f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:22.259671 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9a9f5-3d0d-43ea-9c3d-a8509309f18a None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:47:22.330036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:22.337607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd4348-0943-4566-9df0-b57614062b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:47:22.338294 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd4348-0943-4566-9df0-b57614062b8d service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:22.338574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd4348-0943-4566-9df0-b57614062b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:22.338845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd4348-0943-4566-9df0-b57614062b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:22.340488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9afd4348-0943-4566-9df0-b57614062b8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:22.458248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd4348-0943-4566-9df0-b57614062b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:47:22.459693 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd4348-0943-4566-9df0-b57614062b8d service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:47:22.478472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 739/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:47:24.649935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59a6c-9e61-4c19-afec-abbb3f0c1388 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:24.650599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59a6c-9e61-4c19-afec-abbb3f0c1388 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:24.650599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59a6c-9e61-4c19-afec-abbb3f0c1388 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:24.651995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:47:24.658001 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6197cd-51e0-40bb-bca8-7d45600c9e2c None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:24.658424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6197cd-51e0-40bb-bca8-7d45600c9e2c None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:24.658534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6197cd-51e0-40bb-bca8-7d45600c9e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:24.727738 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-8e6197cd-51e0-40bb-bca8-7d45600c9e2c None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:47:24.728996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-8e6197cd-51e0-40bb-bca8-7d45600c9e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:24.779862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:24.829712 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:47:25.110814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba59a6c-9e61-4c19-afec-abbb3f0c1388 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:47:25.112435 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-3ba59a6c-9e61-4c19-afec-abbb3f0c1388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:25.218964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba59a6c-9e61-4c19-afec-abbb3f0c1388 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:47:25.268255 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:25.295234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d53ad8-441d-4e64-b44e-98e178d531ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:47:25.295844 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d53ad8-441d-4e64-b44e-98e178d531ab service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:25.296124 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d53ad8-441d-4e64-b44e-98e178d531ab service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:25.296388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d53ad8-441d-4e64-b44e-98e178d531ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:25.298008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-96d53ad8-441d-4e64-b44e-98e178d531ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:25.424531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d53ad8-441d-4e64-b44e-98e178d531ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:47:25.426879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d53ad8-441d-4e64-b44e-98e178d531ab service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:47:25.449096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 730/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:47:34.828209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=22 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:35.446286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=66 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:46.273767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3c6e5-597b-4725-bf29-11891962cfcb None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:46.274381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3c6e5-597b-4725-bf29-11891962cfcb None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:46.274381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3c6e5-597b-4725-bf29-11891962cfcb None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:46.275707 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 741/1471] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:47:46.281428 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435d783-1d88-46d7-89b8-7138cf9f7c4f None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:46.281889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435d783-1d88-46d7-89b8-7138cf9f7c4f None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:46.281987 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435d783-1d88-46d7-89b8-7138cf9f7c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:46.350160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-c435d783-1d88-46d7-89b8-7138cf9f7c4f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:47:46.351394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c435d783-1d88-46d7-89b8-7138cf9f7c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:46.453713 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 731/1472] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:47:46.749530 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036785af-69a7-43dc-9052-6aa7391a12fd None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:46.749834 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036785af-69a7-43dc-9052-6aa7391a12fd None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:46.750101 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036785af-69a7-43dc-9052-6aa7391a12fd None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:46.751438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 742/1473] 10.222.0.23 () {54 vars in 966 bytes} [Mon Sep 12 23:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:47:46.756599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72d609-610d-4e03-9513-41fe09172019 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:46.756880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72d609-610d-4e03-9513-41fe09172019 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:46.757144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72d609-610d-4e03-9513-41fe09172019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:46.835165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-4b72d609-610d-4e03-9513-41fe09172019 None None] MFA Rules not processed for user `9d21a0c72223417d92e3d8b30ef6bc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:47:46.836372 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4b72d609-610d-4e03-9513-41fe09172019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:46.858747 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:46.919281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 732/1474] 10.222.0.23 () {58 vars in 1063 bytes} [Mon Sep 12 23:47:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:47:46.927422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036785af-69a7-43dc-9052-6aa7391a12fd None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:47:46.928968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-036785af-69a7-43dc-9052-6aa7391a12fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:47.037422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036785af-69a7-43dc-9052-6aa7391a12fd None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:47:47.119021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191090b-f95a-4c46-b32a-13cc75ba9a25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21a0c72223417d92e3d8b30ef6bc3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:47:47.119647 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191090b-f95a-4c46-b32a-13cc75ba9a25 service glance] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:47.119921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191090b-f95a-4c46-b32a-13cc75ba9a25 service glance] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:47.120186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191090b-f95a-4c46-b32a-13cc75ba9a25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:47.121909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5191090b-f95a-4c46-b32a-13cc75ba9a25 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:47.179028 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:47.237909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191090b-f95a-4c46-b32a-13cc75ba9a25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:47:47.239375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191090b-f95a-4c46-b32a-13cc75ba9a25 service glance] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:47:47.258350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 743/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:47:49.536708 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f273f-4768-43b0-a9b2-3b9f1a69e783 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:49.537266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f273f-4768-43b0-a9b2-3b9f1a69e783 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:49.537266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f273f-4768-43b0-a9b2-3b9f1a69e783 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:49.538604 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 733/1476] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:47:49.544360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485c234-b440-4e2c-bccf-c25617d6194a None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:49.544832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485c234-b440-4e2c-bccf-c25617d6194a None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:49.544934 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485c234-b440-4e2c-bccf-c25617d6194a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:49.615233 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-5485c234-b440-4e2c-bccf-c25617d6194a None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:47:49.616470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5485c234-b440-4e2c-bccf-c25617d6194a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:49.721681 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 744/1477] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:47:49.988851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f273f-4768-43b0-a9b2-3b9f1a69e783 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:47:49.991376 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c58f273f-4768-43b0-a9b2-3b9f1a69e783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:50.129143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f273f-4768-43b0-a9b2-3b9f1a69e783 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:47:50.185574 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:50.232508 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315f014-567c-4e5c-a9f8-d543d872c676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:47:50.233128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315f014-567c-4e5c-a9f8-d543d872c676 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:50.233430 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315f014-567c-4e5c-a9f8-d543d872c676 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:50.233698 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315f014-567c-4e5c-a9f8-d543d872c676 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:50.234351 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315f014-567c-4e5c-a9f8-d543d872c676 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:47:50.236151 dv-cinder-820027-26-smb devstack@keystone.service[87848]: WARNING py.warnings [None req-2315f014-567c-4e5c-a9f8-d543d872c676 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:47:50.236151 dv-cinder-820027-26-smb devstack@keystone.service[87848]: warnings.warn(msg) Sep 12 23:47:50.236151 dv-cinder-820027-26-smb devstack@keystone.service[87848]: Sep 12 23:47:50.237298 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315f014-567c-4e5c-a9f8-d543d872c676 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:47:50.257861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 734/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 12 23:47:49 2022] GET /identity/v3/projects => generated 2553 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:47:52.445220 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c274b09-3de5-4c79-9bfc-119ddb675e39 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:52.445859 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c274b09-3de5-4c79-9bfc-119ddb675e39 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:52.445859 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c274b09-3de5-4c79-9bfc-119ddb675e39 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:52.447347 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 745/1479] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:47:52.453078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941acc4b-f4e2-4238-8260-fefff3460ac3 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:52.453588 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941acc4b-f4e2-4238-8260-fefff3460ac3 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:52.453687 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941acc4b-f4e2-4238-8260-fefff3460ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:52.523045 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-941acc4b-f4e2-4238-8260-fefff3460ac3 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:47:52.524259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-941acc4b-f4e2-4238-8260-fefff3460ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:52.624200 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 735/1480] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:47:52.913020 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c274b09-3de5-4c79-9bfc-119ddb675e39 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:47:52.914715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2c274b09-3de5-4c79-9bfc-119ddb675e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:52.925372 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:53.067587 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c274b09-3de5-4c79-9bfc-119ddb675e39 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:47:53.150881 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:53.186427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b474b-94cb-4820-a85e-787af61fa325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:47:53.187046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b474b-94cb-4820-a85e-787af61fa325 service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:53.187322 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b474b-94cb-4820-a85e-787af61fa325 service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:53.187571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b474b-94cb-4820-a85e-787af61fa325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:53.189185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-e70b474b-94cb-4820-a85e-787af61fa325 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:53.286859 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b474b-94cb-4820-a85e-787af61fa325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:47:53.288491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b474b-94cb-4820-a85e-787af61fa325 service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:47:53.310791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 746/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:47:55.661043 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf67282-dc92-4615-bfb3-de1d97b9124b None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:55.661639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf67282-dc92-4615-bfb3-de1d97b9124b None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:55.661639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf67282-dc92-4615-bfb3-de1d97b9124b None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:55.662890 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 736/1482] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:47:55.668631 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9dce9-8c2c-4c58-9daa-d73b3b065efc None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:55.669082 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9dce9-8c2c-4c58-9daa-d73b3b065efc None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:55.669179 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9dce9-8c2c-4c58-9daa-d73b3b065efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:55.738941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-13a9dce9-8c2c-4c58-9daa-d73b3b065efc None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:47:55.740184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-13a9dce9-8c2c-4c58-9daa-d73b3b065efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:55.791336 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:55.844920 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 747/1483] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:47:56.129932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf67282-dc92-4615-bfb3-de1d97b9124b None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:47:56.131509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-abf67282-dc92-4615-bfb3-de1d97b9124b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:56.157877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:56.249856 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf67282-dc92-4615-bfb3-de1d97b9124b None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:47:56.331611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2343ac-ea18-493a-ab28-9193bb7f3c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:47:56.332197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2343ac-ea18-493a-ab28-9193bb7f3c89 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:56.332470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2343ac-ea18-493a-ab28-9193bb7f3c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:56.332742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2343ac-ea18-493a-ab28-9193bb7f3c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:56.334410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4e2343ac-ea18-493a-ab28-9193bb7f3c89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:56.418847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:56.460399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2343ac-ea18-493a-ab28-9193bb7f3c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:47:56.461858 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2343ac-ea18-493a-ab28-9193bb7f3c89 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:47:56.483669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 737/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:47:58.699043 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d242584-1269-424f-92ca-9b69e6e1f9a1 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:58.699590 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d242584-1269-424f-92ca-9b69e6e1f9a1 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:58.699590 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d242584-1269-424f-92ca-9b69e6e1f9a1 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:58.700877 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 748/1485] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:47:58.706540 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd328e59-6621-40b1-8a77-55ca20c0ced8 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:58.706981 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd328e59-6621-40b1-8a77-55ca20c0ced8 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:58.707089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd328e59-6621-40b1-8a77-55ca20c0ced8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:58.775998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-fd328e59-6621-40b1-8a77-55ca20c0ced8 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:47:58.777231 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-fd328e59-6621-40b1-8a77-55ca20c0ced8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:58.874960 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 738/1486] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:47:59.162014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d242584-1269-424f-92ca-9b69e6e1f9a1 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:47:59.163592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5d242584-1269-424f-92ca-9b69e6e1f9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:59.272780 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d242584-1269-424f-92ca-9b69e6e1f9a1 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:47:59.351438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:59.353616 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b5dcb-0dda-42fd-8df3-722a921d6b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:47:59.354280 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b5dcb-0dda-42fd-8df3-722a921d6b91 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:47:59.354562 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b5dcb-0dda-42fd-8df3-722a921d6b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:47:59.354834 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b5dcb-0dda-42fd-8df3-722a921d6b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:47:59.357189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2a9b5dcb-0dda-42fd-8df3-722a921d6b91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:47:59.475695 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b5dcb-0dda-42fd-8df3-722a921d6b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:47:59.477164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b5dcb-0dda-42fd-8df3-722a921d6b91 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:47:59.496896 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 749/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:48:01.829151 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c3787-a405-4e2e-9855-e04844c35bc7 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:48:01.829771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c3787-a405-4e2e-9855-e04844c35bc7 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:48:01.829771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c3787-a405-4e2e-9855-e04844c35bc7 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:48:01.831105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 739/1488] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:48:01.836623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e0b7d-8f87-428c-bd13-43ca1bb8afdd None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:48:01.837265 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e0b7d-8f87-428c-bd13-43ca1bb8afdd None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:48:01.837265 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e0b7d-8f87-428c-bd13-43ca1bb8afdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:48:01.904659 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-9d2e0b7d-8f87-428c-bd13-43ca1bb8afdd None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:48:01.905922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9d2e0b7d-8f87-428c-bd13-43ca1bb8afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:48:01.961130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:48:02.008150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 750/1489] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:48:02.294296 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c3787-a405-4e2e-9855-e04844c35bc7 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:48:02.295859 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ca3c3787-a405-4e2e-9855-e04844c35bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:48:02.335397 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:48:02.411601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c3787-a405-4e2e-9855-e04844c35bc7 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:48:02.489930 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba5367-7f70-4164-9efa-d1bf02206e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:48:02.490540 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba5367-7f70-4164-9efa-d1bf02206e35 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:48:02.490819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba5367-7f70-4164-9efa-d1bf02206e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:48:02.491070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba5367-7f70-4164-9efa-d1bf02206e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:48:02.492716 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c4ba5367-7f70-4164-9efa-d1bf02206e35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:48:02.576667 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:48:02.607697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba5367-7f70-4164-9efa-d1bf02206e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:48:02.609186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba5367-7f70-4164-9efa-d1bf02206e35 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:48:02.630912 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 740/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:48:05.102444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee925cdd-7fdf-4f2a-be14-1c7ec6029084 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:48:05.103062 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee925cdd-7fdf-4f2a-be14-1c7ec6029084 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:48:05.103062 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee925cdd-7fdf-4f2a-be14-1c7ec6029084 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:48:05.104427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 751/1491] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 12 23:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:48:05.110202 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3c822-839b-4202-9748-37d2ac88049e None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:48:05.110678 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3c822-839b-4202-9748-37d2ac88049e None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:48:05.110786 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3c822-839b-4202-9748-37d2ac88049e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:48:05.178041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-5ab3c822-839b-4202-9748-37d2ac88049e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:48:05.179255 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5ab3c822-839b-4202-9748-37d2ac88049e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:48:05.279400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 741/1492] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 12 23:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:48:05.567799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee925cdd-7fdf-4f2a-be14-1c7ec6029084 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:48:05.569453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ee925cdd-7fdf-4f2a-be14-1c7ec6029084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:48:05.676291 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee925cdd-7fdf-4f2a-be14-1c7ec6029084 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:48:05.759514 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a3922-4c3d-48ce-9131-660e82a49ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:48:05.760135 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a3922-4c3d-48ce-9131-660e82a49ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:48:05.760413 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a3922-4c3d-48ce-9131-660e82a49ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:48:05.760685 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a3922-4c3d-48ce-9131-660e82a49ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:48:05.762452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-593a3922-4c3d-48ce-9131-660e82a49ca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:48:05.773047 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:48:05.895430 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a3922-4c3d-48ce-9131-660e82a49ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:48:05.896902 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a3922-4c3d-48ce-9131-660e82a49ca7 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:48:05.916026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 752/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:48:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:48:15.277712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=82 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:48:15.913376 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=50 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:49:19.996943 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d8d7d-f22f-45c8-993a-30b8c6a52a08 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:49:19.997648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d8d7d-f22f-45c8-993a-30b8c6a52a08 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:49:19.997648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d8d7d-f22f-45c8-993a-30b8c6a52a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:49:20.080421 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-293d8d7d-f22f-45c8-993a-30b8c6a52a08 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:49:20.081702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-293d8d7d-f22f-45c8-993a-30b8c6a52a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:49:20.185562 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 742/1494] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:49:20.194096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb945a-e249-4919-ad63-76cea14fa09e None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:49:20.194638 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb945a-e249-4919-ad63-76cea14fa09e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:49:20.194638 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb945a-e249-4919-ad63-76cea14fa09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:49:20.277703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-baeb945a-e249-4919-ad63-76cea14fa09e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:49:20.278841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-baeb945a-e249-4919-ad63-76cea14fa09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:49:20.385608 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 753/1495] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:49:20.390519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d8d7d-f22f-45c8-993a-30b8c6a52a08 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:49:20.391723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-293d8d7d-f22f-45c8-993a-30b8c6a52a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:49:20.403466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d8d7d-f22f-45c8-993a-30b8c6a52a08 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:49:20.475763 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:49:20.514886 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3da59f-efe1-4298-b6e1-491ea83737a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:49:20.515506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3da59f-efe1-4298-b6e1-491ea83737a7 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:49:20.515915 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3da59f-efe1-4298-b6e1-491ea83737a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:49:20.516040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3da59f-efe1-4298-b6e1-491ea83737a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:49:20.516693 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3da59f-efe1-4298-b6e1-491ea83737a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:49:20.517108 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3da59f-efe1-4298-b6e1-491ea83737a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:49:20.518052 dv-cinder-820027-26-smb devstack@keystone.service[87848]: WARNING py.warnings [None req-bf3da59f-efe1-4298-b6e1-491ea83737a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:49:20.518052 dv-cinder-820027-26-smb devstack@keystone.service[87848]: warnings.warn(msg) Sep 12 23:49:20.518052 dv-cinder-820027-26-smb devstack@keystone.service[87848]: Sep 12 23:49:20.518937 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3da59f-efe1-4298-b6e1-491ea83737a7 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:49:20.532904 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 743/1496] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:49:20.542024 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb945a-e249-4919-ad63-76cea14fa09e None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:49:20.553074 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb945a-e249-4919-ad63-76cea14fa09e None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:49:20.619363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:49:20.653934 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedacbf-30f0-4766-a944-36cc0c024457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:49:20.654543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedacbf-30f0-4766-a944-36cc0c024457 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:49:20.654816 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedacbf-30f0-4766-a944-36cc0c024457 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:49:20.655086 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedacbf-30f0-4766-a944-36cc0c024457 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:49:20.655718 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedacbf-30f0-4766-a944-36cc0c024457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:49:20.657531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: WARNING py.warnings [None req-4bedacbf-30f0-4766-a944-36cc0c024457 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:49:20.657531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: warnings.warn(msg) Sep 12 23:49:20.657531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: Sep 12 23:49:20.658736 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedacbf-30f0-4766-a944-36cc0c024457 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:49:20.724025 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 754/1497] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:49:20 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:49:20.728651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3da59f-efe1-4298-b6e1-491ea83737a7 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:49:20.730216 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-bf3da59f-efe1-4298-b6e1-491ea83737a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:49:20.764088 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3da59f-efe1-4298-b6e1-491ea83737a7 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:49:20.864557 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff96bd8-3c56-46c7-b098-1448aa6e316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:49:20.865080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff96bd8-3c56-46c7-b098-1448aa6e316c admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:49:20.865381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff96bd8-3c56-46c7-b098-1448aa6e316c admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:49:20.865645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff96bd8-3c56-46c7-b098-1448aa6e316c admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:49:20.866271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff96bd8-3c56-46c7-b098-1448aa6e316c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:49:20.867428 dv-cinder-820027-26-smb devstack@keystone.service[87848]: WARNING py.warnings [None req-5ff96bd8-3c56-46c7-b098-1448aa6e316c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:49:20.867428 dv-cinder-820027-26-smb devstack@keystone.service[87848]: warnings.warn(msg) Sep 12 23:49:20.867428 dv-cinder-820027-26-smb devstack@keystone.service[87848]: Sep 12 23:49:20.868659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff96bd8-3c56-46c7-b098-1448aa6e316c admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:49:20.915051 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 744/1498] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:49:20 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:49:20.920259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedacbf-30f0-4766-a944-36cc0c024457 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:49:20.921845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4bedacbf-30f0-4766-a944-36cc0c024457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:49:20.986719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedacbf-30f0-4766-a944-36cc0c024457 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:49:21.079134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:49:21.091000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e5381-7bb2-41cf-b3b6-46158daaef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:49:21.091624 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e5381-7bb2-41cf-b3b6-46158daaef3c admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:49:21.091899 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e5381-7bb2-41cf-b3b6-46158daaef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:49:21.092166 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e5381-7bb2-41cf-b3b6-46158daaef3c admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:49:21.092817 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e5381-7bb2-41cf-b3b6-46158daaef3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:49:21.093862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: WARNING py.warnings [None req-e80e5381-7bb2-41cf-b3b6-46158daaef3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:49:21.093862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: warnings.warn(msg) Sep 12 23:49:21.093862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: Sep 12 23:49:21.094768 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e5381-7bb2-41cf-b3b6-46158daaef3c admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:49:21.108026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 755/1499] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:49:21.112501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff96bd8-3c56-46c7-b098-1448aa6e316c admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:49:21.114110 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5ff96bd8-3c56-46c7-b098-1448aa6e316c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:49:21.125759 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff96bd8-3c56-46c7-b098-1448aa6e316c admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:49:21.151662 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:49:21.225362 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb379a7-2dc0-49cc-ba80-af8cd51efd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:49:21.226108 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb379a7-2dc0-49cc-ba80-af8cd51efd9e admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:49:21.226391 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb379a7-2dc0-49cc-ba80-af8cd51efd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:49:21.226665 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb379a7-2dc0-49cc-ba80-af8cd51efd9e admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:49:21.227321 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb379a7-2dc0-49cc-ba80-af8cd51efd9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:49:21.228353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: WARNING py.warnings [None req-0bb379a7-2dc0-49cc-ba80-af8cd51efd9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:49:21.228353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: warnings.warn(msg) Sep 12 23:49:21.228353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: Sep 12 23:49:21.229263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb379a7-2dc0-49cc-ba80-af8cd51efd9e admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:49:21.242436 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 745/1500] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:49:21.246993 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e5381-7bb2-41cf-b3b6-46158daaef3c admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:49:21.248729 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-e80e5381-7bb2-41cf-b3b6-46158daaef3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:49:21.285123 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e5381-7bb2-41cf-b3b6-46158daaef3c admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:49:21.394042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa0c4c-5b65-4cc0-af7d-b05c3a66ff48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:49:21.394647 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa0c4c-5b65-4cc0-af7d-b05c3a66ff48 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:49:21.394923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa0c4c-5b65-4cc0-af7d-b05c3a66ff48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:49:21.395195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa0c4c-5b65-4cc0-af7d-b05c3a66ff48 admin admin] PATH_INFO: `/v3/projects/63dedb65ef474724a5a167d12cfb05ff/users/11150deed90840a7b022421cad363c7e/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:49:21.419643 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa0c4c-5b65-4cc0-af7d-b05c3a66ff48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63dedb65ef474724a5a167d12cfb05ff, user_id=11150deed90840a7b022421cad363c7e, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:49:21.420672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: WARNING py.warnings [None req-1faa0c4c-5b65-4cc0-af7d-b05c3a66ff48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:49:21.420672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: warnings.warn(msg) Sep 12 23:49:21.420672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: Sep 12 23:49:21.422664 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa0c4c-5b65-4cc0-af7d-b05c3a66ff48 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:49:21.451393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 756/1501] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:49:21 2022] PUT /identity/v3/projects/63dedb65ef474724a5a167d12cfb05ff/users/11150deed90840a7b022421cad363c7e/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:49:21.463877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0919e34-8994-4c44-b37d-18357f62cc51 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:49:21.464142 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0919e34-8994-4c44-b37d-18357f62cc51 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:49:21.464417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0919e34-8994-4c44-b37d-18357f62cc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:49:21.526025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-a0919e34-8994-4c44-b37d-18357f62cc51 None None] MFA Rules not processed for user `11150deed90840a7b022421cad363c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:49:21.527261 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a0919e34-8994-4c44-b37d-18357f62cc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:49:21.608100 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 746/1502] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:49:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:49:21.622297 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af26286-32da-4677-8f3e-be4b78cd09f7 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:49:21.622645 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af26286-32da-4677-8f3e-be4b78cd09f7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:49:21.622944 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af26286-32da-4677-8f3e-be4b78cd09f7 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:49:21.624347 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 757/1503] 10.222.0.23 () {54 vars in 964 bytes} [Mon Sep 12 23:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:49:21.629675 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79327-94ce-4c1f-bbeb-d635f60e24c4 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:49:21.629979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79327-94ce-4c1f-bbeb-d635f60e24c4 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:49:21.630246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79327-94ce-4c1f-bbeb-d635f60e24c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:49:21.666427 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:49:21.715423 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-46f79327-94ce-4c1f-bbeb-d635f60e24c4 None None] MFA Rules not processed for user `51d2d1c76c3040dd9e57f83c3860e8fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:49:21.716670 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-46f79327-94ce-4c1f-bbeb-d635f60e24c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:49:21.799945 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 747/1504] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Sep 12 23:49:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:49:21.810253 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af26286-32da-4677-8f3e-be4b78cd09f7 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:49:21.811804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3af26286-32da-4677-8f3e-be4b78cd09f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:49:21.867699 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:49:21.929383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af26286-32da-4677-8f3e-be4b78cd09f7 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:49:22.007665 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357e537-e4bb-4a5e-b83a-3a5c1bd29e38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:49:22.008284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357e537-e4bb-4a5e-b83a-3a5c1bd29e38 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:49:22.008606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357e537-e4bb-4a5e-b83a-3a5c1bd29e38 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:49:22.009570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357e537-e4bb-4a5e-b83a-3a5c1bd29e38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:49:22.011204 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6357e537-e4bb-4a5e-b83a-3a5c1bd29e38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:49:22.124208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357e537-e4bb-4a5e-b83a-3a5c1bd29e38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:49:22.125692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357e537-e4bb-4a5e-b83a-3a5c1bd29e38 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:49:22.129202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:49:22.145497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 758/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:49:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:49:22.192626 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eff63c-301c-42e1-ab0e-95f2d1482a40 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:49:22.193099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eff63c-301c-42e1-ab0e-95f2d1482a40 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:49:22.193204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eff63c-301c-42e1-ab0e-95f2d1482a40 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:49:22.194488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 748/1506] 10.222.0.23 () {52 vars in 830 bytes} [Mon Sep 12 23:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:49:22.198572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357e537-e4bb-4a5e-b83a-3a5c1bd29e38 service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:49:22.199837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6357e537-e4bb-4a5e-b83a-3a5c1bd29e38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:49:22.307282 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357e537-e4bb-4a5e-b83a-3a5c1bd29e38 service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:49:22.406847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc31a12-33e6-475c-be0d-724f34ebe483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:49:22.407501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc31a12-33e6-475c-be0d-724f34ebe483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:49:22.407769 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc31a12-33e6-475c-be0d-724f34ebe483 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:49:22.408036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc31a12-33e6-475c-be0d-724f34ebe483 admin admin] PATH_INFO: `/v3/users/11150deed90840a7b022421cad363c7e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:49:22.422968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc31a12-33e6-475c-be0d-724f34ebe483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11150deed90840a7b022421cad363c7e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:49:22.423990 dv-cinder-820027-26-smb devstack@keystone.service[87847]: WARNING py.warnings [None req-ebc31a12-33e6-475c-be0d-724f34ebe483 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:49:22.423990 dv-cinder-820027-26-smb devstack@keystone.service[87847]: warnings.warn(msg) Sep 12 23:49:22.423990 dv-cinder-820027-26-smb devstack@keystone.service[87847]: Sep 12 23:49:22.425213 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc31a12-33e6-475c-be0d-724f34ebe483 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:49:22.436428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:49:22.495622 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-ebc31a12-33e6-475c-be0d-724f34ebe483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11150deed90840a7b022421cad363c7e'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:49:22.511658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-ebc31a12-33e6-475c-be0d-724f34ebe483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11150deed90840a7b022421cad363c7e'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:49:22.536860 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-ebc31a12-33e6-475c-be0d-724f34ebe483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11150deed90840a7b022421cad363c7e'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:49:22.547351 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-ebc31a12-33e6-475c-be0d-724f34ebe483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11150deed90840a7b022421cad363c7e'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:49:22.547863 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-ebc31a12-33e6-475c-be0d-724f34ebe483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11150deed90840a7b022421cad363c7e'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:49:22.554770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 759/1507] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:49:22 2022] DELETE /identity/v3/users/11150deed90840a7b022421cad363c7e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:49:22.559317 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b33ab7-ac8f-4ebc-ba16-366757133bb2 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:49:22.559613 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b33ab7-ac8f-4ebc-ba16-366757133bb2 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:49:22.559891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b33ab7-ac8f-4ebc-ba16-366757133bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:49:22.619236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-56b33ab7-ac8f-4ebc-ba16-366757133bb2 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:49:22.620443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-56b33ab7-ac8f-4ebc-ba16-366757133bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:49:22.698417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:49:22.711970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 749/1508] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:49:22.722607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc31a12-33e6-475c-be0d-724f34ebe483 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:49:22.723857 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ebc31a12-33e6-475c-be0d-724f34ebe483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:49:22.830069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc31a12-33e6-475c-be0d-724f34ebe483 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:49:22.885603 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:49:22.906272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c1141-5683-4a76-869a-4a7fc408a96b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:49:22.906908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c1141-5683-4a76-869a-4a7fc408a96b service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:49:22.907187 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c1141-5683-4a76-869a-4a7fc408a96b service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:49:22.907458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c1141-5683-4a76-869a-4a7fc408a96b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:49:22.909096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1e9c1141-5683-4a76-869a-4a7fc408a96b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:49:23.037923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c1141-5683-4a76-869a-4a7fc408a96b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:49:23.039367 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c1141-5683-4a76-869a-4a7fc408a96b service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:49:23.061448 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 760/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:49:23.437371 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b33ab7-ac8f-4ebc-ba16-366757133bb2 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:49:23.439197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-56b33ab7-ac8f-4ebc-ba16-366757133bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:49:23.451692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b33ab7-ac8f-4ebc-ba16-366757133bb2 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:49:23.568934 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77b658-07b9-4d92-8238-1b9faa881b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:49:23.569498 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77b658-07b9-4d92-8238-1b9faa881b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:49:23.569839 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77b658-07b9-4d92-8238-1b9faa881b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:49:23.570106 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77b658-07b9-4d92-8238-1b9faa881b25 admin admin] PATH_INFO: `/v3/projects/63dedb65ef474724a5a167d12cfb05ff` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:49:23.580837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77b658-07b9-4d92-8238-1b9faa881b25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63dedb65ef474724a5a167d12cfb05ff)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:49:23.581918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: WARNING py.warnings [None req-9a77b658-07b9-4d92-8238-1b9faa881b25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:49:23.581918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: warnings.warn(msg) Sep 12 23:49:23.581918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: Sep 12 23:49:23.583139 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77b658-07b9-4d92-8238-1b9faa881b25 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:49:23.651108 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9a77b658-07b9-4d92-8238-1b9faa881b25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63dedb65ef474724a5a167d12cfb05ff', 'request_id': 'req-9a77b658-07b9-4d92-8238-1b9faa881b25'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:49:23.657506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9a77b658-07b9-4d92-8238-1b9faa881b25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63dedb65ef474724a5a167d12cfb05ff', 'request_id': 'req-9a77b658-07b9-4d92-8238-1b9faa881b25'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:49:23.673157 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9a77b658-07b9-4d92-8238-1b9faa881b25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63dedb65ef474724a5a167d12cfb05ff', 'request_id': 'req-9a77b658-07b9-4d92-8238-1b9faa881b25'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:49:23.706631 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9a77b658-07b9-4d92-8238-1b9faa881b25 admin admin] The token cache is being invalidate because project 63dedb65ef474724a5a167d12cfb05ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:49:23.706871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9a77b658-07b9-4d92-8238-1b9faa881b25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:49:23.707334 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9a77b658-07b9-4d92-8238-1b9faa881b25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:49:23.708706 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 750/1510] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:49:23 2022] DELETE /identity/v3/projects/63dedb65ef474724a5a167d12cfb05ff => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:49:33.059055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=62 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:49:33.704344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:50:58.595278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eda887-0c0f-454e-8af0-e64f292467d7 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:50:58.595944 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eda887-0c0f-454e-8af0-e64f292467d7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:50:58.595944 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eda887-0c0f-454e-8af0-e64f292467d7 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:50:58.597301 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:50:58.602784 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ed388-e5d7-45ea-b134-39900e119a32 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:50:58.603283 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ed388-e5d7-45ea-b134-39900e119a32 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:50:58.603381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ed388-e5d7-45ea-b134-39900e119a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:50:58.698029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-f07ed388-e5d7-45ea-b134-39900e119a32 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:50:58.699162 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f07ed388-e5d7-45ea-b134-39900e119a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:50:58.835755 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:50:58.990907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eda887-0c0f-454e-8af0-e64f292467d7 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:50:58.993940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-14eda887-0c0f-454e-8af0-e64f292467d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:50:59.127769 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eda887-0c0f-454e-8af0-e64f292467d7 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:50:59.134211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1c434-a7be-4e0b-8336-1f2158014961 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:50:59.134868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1c434-a7be-4e0b-8336-1f2158014961 service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:50:59.135144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1c434-a7be-4e0b-8336-1f2158014961 service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:50:59.135436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1c434-a7be-4e0b-8336-1f2158014961 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:50:59.144346 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1c434-a7be-4e0b-8336-1f2158014961 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:50:59.145964 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1c434-a7be-4e0b-8336-1f2158014961 service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:50:59.155676 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 762/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:50:59.648018 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d314a02-b72a-49d9-a630-ba2c013508be None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:50:59.648568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d314a02-b72a-49d9-a630-ba2c013508be None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:50:59.648568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d314a02-b72a-49d9-a630-ba2c013508be None None] PATH_INFO: `/v3` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:50:59.649800 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 752/1514] 10.222.0.44 () {54 vars in 925 bytes} [Mon Sep 12 23:50:59 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:50:59.656427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef4bf7-8330-40f3-b1a0-ef51a48ab4d7 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:50:59.656940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef4bf7-8330-40f3-b1a0-ef51a48ab4d7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:50:59.657036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef4bf7-8330-40f3-b1a0-ef51a48ab4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:50:59.720654 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-91ef4bf7-8330-40f3-b1a0-ef51a48ab4d7 None None] MFA Rules not processed for user `4395ee0a00df41adacb55b4a8684786b`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:50:59.721938 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-91ef4bf7-8330-40f3-b1a0-ef51a48ab4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:50:59.797546 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:50:59.804227 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 763/1515] 10.222.0.44 () {58 vars in 1015 bytes} [Mon Sep 12 23:50:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:51:00.246039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86964aa-73c6-4a0c-bc25-7c3fd0a01733 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:00.246322 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86964aa-73c6-4a0c-bc25-7c3fd0a01733 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:00.246569 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86964aa-73c6-4a0c-bc25-7c3fd0a01733 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:00.247925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 753/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:51:00.255137 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acb710-28c3-41b8-899a-301d2fba157e None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:00.255463 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acb710-28c3-41b8-899a-301d2fba157e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:00.255881 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acb710-28c3-41b8-899a-301d2fba157e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:00.279102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-12acb710-28c3-41b8-899a-301d2fba157e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:51:00.280303 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-12acb710-28c3-41b8-899a-301d2fba157e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:51:00.288772 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 764/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:51:00.438012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86964aa-73c6-4a0c-bc25-7c3fd0a01733 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:51:00.454340 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86964aa-73c6-4a0c-bc25-7c3fd0a01733 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:51:00.460485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7649a0e-748d-4644-ab30-4717722e162f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:51:00.461083 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7649a0e-748d-4644-ab30-4717722e162f service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:00.461371 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7649a0e-748d-4644-ab30-4717722e162f service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:00.461653 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7649a0e-748d-4644-ab30-4717722e162f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:00.470111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7649a0e-748d-4644-ab30-4717722e162f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:51:00.471736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7649a0e-748d-4644-ab30-4717722e162f service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:51:00.481614 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 754/1518] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:51:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:51:03.413670 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1176d-af14-4c6b-ad83-47f0afc61dad None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:03.414208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1176d-af14-4c6b-ad83-47f0afc61dad None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:03.414208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1176d-af14-4c6b-ad83-47f0afc61dad None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:03.416257 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 765/1519] 10.222.0.23 () {54 vars in 961 bytes} [Mon Sep 12 23:51:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:51:03.424063 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd770801-47b9-427b-96c3-928fd9645afa None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:03.424543 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd770801-47b9-427b-96c3-928fd9645afa None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:03.424672 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd770801-47b9-427b-96c3-928fd9645afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:03.447410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-dd770801-47b9-427b-96c3-928fd9645afa None None] MFA Rules not processed for user `4395ee0a00df41adacb55b4a8684786b`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:51:03.448707 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-dd770801-47b9-427b-96c3-928fd9645afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:51:03.458807 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 755/1520] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Sep 12 23:51:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:51:03.466666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1176d-af14-4c6b-ad83-47f0afc61dad None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:51:03.481146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1176d-af14-4c6b-ad83-47f0afc61dad None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:51:03.486518 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d45e0c-dfe7-42cf-b7ba-9db972058a6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4395ee0a00df41adacb55b4a8684786b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:51:03.487117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d45e0c-dfe7-42cf-b7ba-9db972058a6f service placement] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:03.487396 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d45e0c-dfe7-42cf-b7ba-9db972058a6f service placement] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:03.487665 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d45e0c-dfe7-42cf-b7ba-9db972058a6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:03.496089 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d45e0c-dfe7-42cf-b7ba-9db972058a6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:51:03.497744 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d45e0c-dfe7-42cf-b7ba-9db972058a6f service placement] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:51:03.507496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 766/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:51:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:51:11.986376 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92405de6-eb71-420e-8822-fe3b2db314b8 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:11.987039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92405de6-eb71-420e-8822-fe3b2db314b8 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:11.987412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92405de6-eb71-420e-8822-fe3b2db314b8 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:11.989802 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:51:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:51:11.998508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e989f8-4dac-498e-8350-63d910c7bb70 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:11.999064 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e989f8-4dac-498e-8350-63d910c7bb70 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:11.999064 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e989f8-4dac-498e-8350-63d910c7bb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:12.019614 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-b3e989f8-4dac-498e-8350-63d910c7bb70 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:51:12.020840 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b3e989f8-4dac-498e-8350-63d910c7bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:51:12.029380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:51:12.182242 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92405de6-eb71-420e-8822-fe3b2db314b8 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:51:12.197660 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92405de6-eb71-420e-8822-fe3b2db314b8 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:51:12.203569 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2642f73-2c5b-4bca-aef4-076ae2a88139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:51:12.204147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2642f73-2c5b-4bca-aef4-076ae2a88139 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:12.204450 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2642f73-2c5b-4bca-aef4-076ae2a88139 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:12.204738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2642f73-2c5b-4bca-aef4-076ae2a88139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:12.213179 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2642f73-2c5b-4bca-aef4-076ae2a88139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:51:12.214817 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2642f73-2c5b-4bca-aef4-076ae2a88139 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:51:12.224355 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 757/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:51:13.290799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87258f6b-a8ee-4ac5-98f2-7924ed90a76a None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:13.291423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87258f6b-a8ee-4ac5-98f2-7924ed90a76a None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:13.291423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87258f6b-a8ee-4ac5-98f2-7924ed90a76a None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:13.292818 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 12 23:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:51:13.300066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf62b89-9876-4253-9dbc-7a2718f5fc60 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:13.300621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf62b89-9876-4253-9dbc-7a2718f5fc60 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:13.300621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf62b89-9876-4253-9dbc-7a2718f5fc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:13.325775 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-ecf62b89-9876-4253-9dbc-7a2718f5fc60 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:51:13.327013 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ecf62b89-9876-4253-9dbc-7a2718f5fc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:51:13.336551 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 12 23:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:51:13.490717 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87258f6b-a8ee-4ac5-98f2-7924ed90a76a None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:51:13.513716 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87258f6b-a8ee-4ac5-98f2-7924ed90a76a None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:51:13.520890 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdde6ce-0a1e-4c1d-85fb-a3bb9169cae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:51:13.521532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde6ce-0a1e-4c1d-85fb-a3bb9169cae5 service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:13.521814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde6ce-0a1e-4c1d-85fb-a3bb9169cae5 service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:13.522086 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdde6ce-0a1e-4c1d-85fb-a3bb9169cae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:13.530845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdde6ce-0a1e-4c1d-85fb-a3bb9169cae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:51:13.532420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdde6ce-0a1e-4c1d-85fb-a3bb9169cae5 service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:51:13.542186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 769/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:51:17.653597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931c3d1-f66b-4d8e-8e11-20a1023f1240 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:17.654155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931c3d1-f66b-4d8e-8e11-20a1023f1240 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:17.654155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931c3d1-f66b-4d8e-8e11-20a1023f1240 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:17.655399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:51:17.661393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cd830-ffb8-4763-b4ee-dcc8a5fc66b2 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:17.662037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cd830-ffb8-4763-b4ee-dcc8a5fc66b2 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:17.662137 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cd830-ffb8-4763-b4ee-dcc8a5fc66b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:17.685069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-623cd830-ffb8-4763-b4ee-dcc8a5fc66b2 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:51:17.686864 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-623cd830-ffb8-4763-b4ee-dcc8a5fc66b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:51:17.699278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:51:17.996224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931c3d1-f66b-4d8e-8e11-20a1023f1240 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:51:17.998255 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6931c3d1-f66b-4d8e-8e11-20a1023f1240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:51:18.035295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:51:18.084146 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931c3d1-f66b-4d8e-8e11-20a1023f1240 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:51:18.088318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e965b0-d3d7-4e1b-b95a-910bcf527dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:51:18.088946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e965b0-d3d7-4e1b-b95a-910bcf527dab service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:18.089219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e965b0-d3d7-4e1b-b95a-910bcf527dab service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:18.089571 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e965b0-d3d7-4e1b-b95a-910bcf527dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:18.099652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e965b0-d3d7-4e1b-b95a-910bcf527dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:51:18.101096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e965b0-d3d7-4e1b-b95a-910bcf527dab service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:51:18.111496 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 760/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:51:20.243921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634596a6-4a99-4ec0-a4e7-817093c01a43 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:20.244500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634596a6-4a99-4ec0-a4e7-817093c01a43 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:20.244500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634596a6-4a99-4ec0-a4e7-817093c01a43 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:20.245982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:51:20.257955 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5898d3a-b969-4b58-8b51-ce1ee5f8bb5a None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:20.258524 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5898d3a-b969-4b58-8b51-ce1ee5f8bb5a None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:20.258524 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5898d3a-b969-4b58-8b51-ce1ee5f8bb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:20.280512 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-e5898d3a-b969-4b58-8b51-ce1ee5f8bb5a None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:51:20.281749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e5898d3a-b969-4b58-8b51-ce1ee5f8bb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:51:20.290072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:51:20.576812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634596a6-4a99-4ec0-a4e7-817093c01a43 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:51:20.593400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634596a6-4a99-4ec0-a4e7-817093c01a43 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:51:20.597916 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9243d6e-e922-4f92-829f-e705ad9e5ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:51:20.598529 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9243d6e-e922-4f92-829f-e705ad9e5ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:20.598808 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9243d6e-e922-4f92-829f-e705ad9e5ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:20.599081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9243d6e-e922-4f92-829f-e705ad9e5ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:20.609282 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9243d6e-e922-4f92-829f-e705ad9e5ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:51:20.610747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9243d6e-e922-4f92-829f-e705ad9e5ad7 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:51:20.620360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 772/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:51:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:51:24.476666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea500fe9-ba78-4cf3-ad79-68a44333a693 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:24.477280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea500fe9-ba78-4cf3-ad79-68a44333a693 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:24.477280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea500fe9-ba78-4cf3-ad79-68a44333a693 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:24.478596 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:51:24.484221 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba6864-2a95-4af9-b616-a70386003576 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:24.484801 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba6864-2a95-4af9-b616-a70386003576 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:24.485074 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba6864-2a95-4af9-b616-a70386003576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:24.505884 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-01ba6864-2a95-4af9-b616-a70386003576 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:51:24.507102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-01ba6864-2a95-4af9-b616-a70386003576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:51:24.515895 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:51:24.816149 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea500fe9-ba78-4cf3-ad79-68a44333a693 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:51:24.818086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ea500fe9-ba78-4cf3-ad79-68a44333a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:51:24.903398 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea500fe9-ba78-4cf3-ad79-68a44333a693 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:51:24.907130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529bedb-c3c2-4570-90d7-e637d2b94f5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:51:24.907768 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529bedb-c3c2-4570-90d7-e637d2b94f5d service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:24.908025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529bedb-c3c2-4570-90d7-e637d2b94f5d service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:24.908331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529bedb-c3c2-4570-90d7-e637d2b94f5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:24.917730 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529bedb-c3c2-4570-90d7-e637d2b94f5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:51:24.919180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9529bedb-c3c2-4570-90d7-e637d2b94f5d service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:51:24.929125 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 763/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:51:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:51:27.108874 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab2785-df96-409a-af7d-7f5961b06d8b None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:27.109505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab2785-df96-409a-af7d-7f5961b06d8b None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:27.109505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab2785-df96-409a-af7d-7f5961b06d8b None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:27.110774 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 12 23:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:51:27.116385 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35904b37-8d40-4027-8b10-a0a40d0da3aa None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:27.116824 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35904b37-8d40-4027-8b10-a0a40d0da3aa None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:27.116938 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35904b37-8d40-4027-8b10-a0a40d0da3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:27.137809 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-35904b37-8d40-4027-8b10-a0a40d0da3aa None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:51:27.139035 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-35904b37-8d40-4027-8b10-a0a40d0da3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:51:27.147864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 12 23:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:51:27.451325 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab2785-df96-409a-af7d-7f5961b06d8b None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:51:27.453403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a9ab2785-df96-409a-af7d-7f5961b06d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:51:27.467434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab2785-df96-409a-af7d-7f5961b06d8b None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:51:27.471211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a105947-7b98-4055-a2e6-ead0daa79fd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:51:27.471808 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a105947-7b98-4055-a2e6-ead0daa79fd9 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:51:27.472088 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a105947-7b98-4055-a2e6-ead0daa79fd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:51:27.472357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a105947-7b98-4055-a2e6-ead0daa79fd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:51:27.482388 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a105947-7b98-4055-a2e6-ead0daa79fd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:51:27.483797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a105947-7b98-4055-a2e6-ead0daa79fd9 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:51:27.493758 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 775/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:51:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:51:37.132162 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=63 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:51:37.489307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=37 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:56.578701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18016f0b-670b-41f3-abfa-f7cb6a6449f3 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:56.579378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18016f0b-670b-41f3-abfa-f7cb6a6449f3 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:56.579667 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18016f0b-670b-41f3-abfa-f7cb6a6449f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:56.609679 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-18016f0b-670b-41f3-abfa-f7cb6a6449f3 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:56.610949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-18016f0b-670b-41f3-abfa-f7cb6a6449f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:56.620539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163739c-f441-4dd2-b168-b32b3b124bab None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:56.621624 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163739c-f441-4dd2-b168-b32b3b124bab None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:56.622212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163739c-f441-4dd2-b168-b32b3b124bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:56.624447 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 765/1540] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:52:56.634689 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064e425-8fcd-4591-adf5-e0ebe13d1729 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:56.635065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064e425-8fcd-4591-adf5-e0ebe13d1729 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:56.635239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064e425-8fcd-4591-adf5-e0ebe13d1729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:56.664080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-0064e425-8fcd-4591-adf5-e0ebe13d1729 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:56.665469 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0064e425-8fcd-4591-adf5-e0ebe13d1729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:56.672287 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-2163739c-f441-4dd2-b168-b32b3b124bab None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:56.674298 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2163739c-f441-4dd2-b168-b32b3b124bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:56.682261 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 766/1541] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:56.683626 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ee411-dcd6-44f0-982a-954ba63d7540 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:56.683916 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ee411-dcd6-44f0-982a-954ba63d7540 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:56.684303 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ee411-dcd6-44f0-982a-954ba63d7540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:56.708333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 776/1542] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:52:56.709893 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163739c-f441-4dd2-b168-b32b3b124bab None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:56.724558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-a36ee411-dcd6-44f0-982a-954ba63d7540 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:56.726193 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a36ee411-dcd6-44f0-982a-954ba63d7540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:56.736480 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 767/1543] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:56.741598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35cd4a-5997-4547-91f0-02852facdea1 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:56.741844 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163739c-f441-4dd2-b168-b32b3b124bab None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:56.741947 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35cd4a-5997-4547-91f0-02852facdea1 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:56.742183 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35cd4a-5997-4547-91f0-02852facdea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:56.765499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bddf5e-7467-4a65-9a6f-2df8d0997cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:56.766563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddf5e-7467-4a65-9a6f-2df8d0997cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:56.767058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddf5e-7467-4a65-9a6f-2df8d0997cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:56.767541 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddf5e-7467-4a65-9a6f-2df8d0997cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:56.768720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bddf5e-7467-4a65-9a6f-2df8d0997cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:52:56.769254 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bddf5e-7467-4a65-9a6f-2df8d0997cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:56.773694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: WARNING py.warnings [None req-84bddf5e-7467-4a65-9a6f-2df8d0997cd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:52:56.773694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: warnings.warn(msg) Sep 12 23:52:56.773694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: Sep 12 23:52:56.775667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bddf5e-7467-4a65-9a6f-2df8d0997cd9 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:56.780072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-db35cd4a-5997-4547-91f0-02852facdea1 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:56.781327 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-db35cd4a-5997-4547-91f0-02852facdea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:56.790455 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 768/1544] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:56.791776 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046151a5-5873-4ad8-9c77-bdc163e768b7 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:56.792225 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046151a5-5873-4ad8-9c77-bdc163e768b7 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:56.792678 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046151a5-5873-4ad8-9c77-bdc163e768b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:56.829235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 777/1545] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:52:56.829509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-046151a5-5873-4ad8-9c77-bdc163e768b7 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:56.830721 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-046151a5-5873-4ad8-9c77-bdc163e768b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:56.831426 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d472db-9de7-406e-b376-f50bb20fc77d None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:56.831907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d472db-9de7-406e-b376-f50bb20fc77d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:56.832358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d472db-9de7-406e-b376-f50bb20fc77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:56.848799 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 769/1546] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:56.850347 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162a81e-c763-4d59-b2d7-47010be6d814 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:56.850674 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162a81e-c763-4d59-b2d7-47010be6d814 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:56.850952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162a81e-c763-4d59-b2d7-47010be6d814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:56.878633 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-2162a81e-c763-4d59-b2d7-47010be6d814 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:56.880957 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-2162a81e-c763-4d59-b2d7-47010be6d814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:56.890045 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 770/1547] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:56.890681 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162a81e-c763-4d59-b2d7-47010be6d814 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:56.909702 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-03d472db-9de7-406e-b376-f50bb20fc77d None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:56.910962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-03d472db-9de7-406e-b376-f50bb20fc77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:56.912399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162a81e-c763-4d59-b2d7-47010be6d814 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:56.920536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdaa58e-b104-418b-baa4-6519cb7e2f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:56.921099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdaa58e-b104-418b-baa4-6519cb7e2f5d admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:56.921480 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdaa58e-b104-418b-baa4-6519cb7e2f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:56.921761 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdaa58e-b104-418b-baa4-6519cb7e2f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:56.922526 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdaa58e-b104-418b-baa4-6519cb7e2f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:56.923605 dv-cinder-820027-26-smb devstack@keystone.service[87848]: WARNING py.warnings [None req-abdaa58e-b104-418b-baa4-6519cb7e2f5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:52:56.923605 dv-cinder-820027-26-smb devstack@keystone.service[87848]: warnings.warn(msg) Sep 12 23:52:56.923605 dv-cinder-820027-26-smb devstack@keystone.service[87848]: Sep 12 23:52:56.924851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdaa58e-b104-418b-baa4-6519cb7e2f5d admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:56.948302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 778/1548] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:56.949798 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d472db-9de7-406e-b376-f50bb20fc77d None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:56.967830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d472db-9de7-406e-b376-f50bb20fc77d None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:56.975709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863737f-1f7d-46de-9b2a-135dd8998d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:56.976361 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863737f-1f7d-46de-9b2a-135dd8998d42 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:56.976645 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863737f-1f7d-46de-9b2a-135dd8998d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:56.976919 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863737f-1f7d-46de-9b2a-135dd8998d42 admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:56.977958 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863737f-1f7d-46de-9b2a-135dd8998d42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:52:56.978264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863737f-1f7d-46de-9b2a-135dd8998d42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:56.980735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863737f-1f7d-46de-9b2a-135dd8998d42 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:56.984337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 771/1549] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:52:56 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:52:56.986395 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5ffa0-ad35-4eab-88a3-1d5fc5fef1f2 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:56.986970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5ffa0-ad35-4eab-88a3-1d5fc5fef1f2 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:56.987446 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5ffa0-ad35-4eab-88a3-1d5fc5fef1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.001035 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 779/1550] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:52:57.002132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863737f-1f7d-46de-9b2a-135dd8998d42 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.018899 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-20a5ffa0-ad35-4eab-88a3-1d5fc5fef1f2 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:57.020771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-20a5ffa0-ad35-4eab-88a3-1d5fc5fef1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:57.022250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863737f-1f7d-46de-9b2a-135dd8998d42 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.104290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 772/1551] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:57.105334 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5ffa0-ad35-4eab-88a3-1d5fc5fef1f2 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.115762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5ffa0-ad35-4eab-88a3-1d5fc5fef1f2 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.121381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a76f64-5fda-49a8-8d69-f90e79c23590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.122034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a76f64-5fda-49a8-8d69-f90e79c23590 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.122312 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a76f64-5fda-49a8-8d69-f90e79c23590 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.122589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a76f64-5fda-49a8-8d69-f90e79c23590 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.123249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a76f64-5fda-49a8-8d69-f90e79c23590 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:52:57.123548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a76f64-5fda-49a8-8d69-f90e79c23590 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.125484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a76f64-5fda-49a8-8d69-f90e79c23590 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.138048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6b758-c37b-42bd-8478-f2fbc3c2e80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.138672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b758-c37b-42bd-8478-f2fbc3c2e80c admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.138978 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b758-c37b-42bd-8478-f2fbc3c2e80c admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.139305 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b758-c37b-42bd-8478-f2fbc3c2e80c admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.139564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 773/1552] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:52:57.139933 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6b758-c37b-42bd-8478-f2fbc3c2e80c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:52:57.140235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6b758-c37b-42bd-8478-f2fbc3c2e80c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.141203 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2fa7d-7cb4-46d3-9f69-5bd483c604a2 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.141547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2fa7d-7cb4-46d3-9f69-5bd483c604a2 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.141817 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2fa7d-7cb4-46d3-9f69-5bd483c604a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.142060 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6b758-c37b-42bd-8478-f2fbc3c2e80c admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.161428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 780/1553] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:52:57.161428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6b758-c37b-42bd-8478-f2fbc3c2e80c admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.165573 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-e2a2fa7d-7cb4-46d3-9f69-5bd483c604a2 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:57.165573 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e2a2fa7d-7cb4-46d3-9f69-5bd483c604a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:57.174422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 774/1554] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:57.174699 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6b758-c37b-42bd-8478-f2fbc3c2e80c admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.176020 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2fa7d-7cb4-46d3-9f69-5bd483c604a2 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.180027 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cadee-d415-474d-b0bc-f8a9143f2eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.180762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cadee-d415-474d-b0bc-f8a9143f2eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.181377 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cadee-d415-474d-b0bc-f8a9143f2eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.181843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cadee-d415-474d-b0bc-f8a9143f2eb0 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.182967 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cadee-d415-474d-b0bc-f8a9143f2eb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.184027 dv-cinder-820027-26-smb devstack@keystone.service[87847]: WARNING py.warnings [None req-272cadee-d415-474d-b0bc-f8a9143f2eb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:52:57.184027 dv-cinder-820027-26-smb devstack@keystone.service[87847]: warnings.warn(msg) Sep 12 23:52:57.184027 dv-cinder-820027-26-smb devstack@keystone.service[87847]: Sep 12 23:52:57.185257 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cadee-d415-474d-b0bc-f8a9143f2eb0 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.191823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2fa7d-7cb4-46d3-9f69-5bd483c604a2 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.201883 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940676d-e251-442c-b1b2-4a798f63379a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.201883 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940676d-e251-442c-b1b2-4a798f63379a admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.201883 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940676d-e251-442c-b1b2-4a798f63379a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.201883 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940676d-e251-442c-b1b2-4a798f63379a admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.202405 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940676d-e251-442c-b1b2-4a798f63379a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.202405 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940676d-e251-442c-b1b2-4a798f63379a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.216332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 781/1555] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:52:57 2022] POST /identity/v3/users => generated 295 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:52:57.220634 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78bdc6-90e2-4541-8236-340e0b0d03c7 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.220634 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78bdc6-90e2-4541-8236-340e0b0d03c7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.220634 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78bdc6-90e2-4541-8236-340e0b0d03c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.237442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 775/1556] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:52:57 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:52:57.238763 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e713f0-39bd-45f7-81df-03cd60b2d566 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.239048 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e713f0-39bd-45f7-81df-03cd60b2d566 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.239318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e713f0-39bd-45f7-81df-03cd60b2d566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.243027 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-9f78bdc6-90e2-4541-8236-340e0b0d03c7 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:57.244712 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9f78bdc6-90e2-4541-8236-340e0b0d03c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:57.261267 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-23e713f0-39bd-45f7-81df-03cd60b2d566 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:57.262554 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-23e713f0-39bd-45f7-81df-03cd60b2d566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:57.315445 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:57.320489 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 782/1557] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:57.322210 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78bdc6-90e2-4541-8236-340e0b0d03c7 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.333855 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78bdc6-90e2-4541-8236-340e0b0d03c7 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.338698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533890b-6bcf-4dd2-ad4a-a9d42d1c8a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.339335 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533890b-6bcf-4dd2-ad4a-a9d42d1c8a2f admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.339611 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533890b-6bcf-4dd2-ad4a-a9d42d1c8a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.339880 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533890b-6bcf-4dd2-ad4a-a9d42d1c8a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.340524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533890b-6bcf-4dd2-ad4a-a9d42d1c8a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.342497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533890b-6bcf-4dd2-ad4a-a9d42d1c8a2f admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.343387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 776/1558] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:57.344842 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e713f0-39bd-45f7-81df-03cd60b2d566 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.359066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e713f0-39bd-45f7-81df-03cd60b2d566 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.364473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c775c77-7630-4434-ae78-f76a9a8b9018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.365096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c775c77-7630-4434-ae78-f76a9a8b9018 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.365410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c775c77-7630-4434-ae78-f76a9a8b9018 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.365708 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c775c77-7630-4434-ae78-f76a9a8b9018 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.366356 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c775c77-7630-4434-ae78-f76a9a8b9018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.368374 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c775c77-7630-4434-ae78-f76a9a8b9018 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.378551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 783/1559] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:52:57 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:52:57.378551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a0dff-4535-4655-bec3-4c6e1d02fbe8 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.378551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a0dff-4535-4655-bec3-4c6e1d02fbe8 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.378551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a0dff-4535-4655-bec3-4c6e1d02fbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.402682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 777/1560] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:52:57 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:52:57.403692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c775c77-7630-4434-ae78-f76a9a8b9018 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.407348 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-e13a0dff-4535-4655-bec3-4c6e1d02fbe8 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:57.409527 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-e13a0dff-4535-4655-bec3-4c6e1d02fbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:57.420690 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:57.478615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c775c77-7630-4434-ae78-f76a9a8b9018 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.483777 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 784/1561] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:57.484060 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e6283-12dc-4c8e-953f-1323bb7df499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.484558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e6283-12dc-4c8e-953f-1323bb7df499 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.484833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e6283-12dc-4c8e-953f-1323bb7df499 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.485100 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e6283-12dc-4c8e-953f-1323bb7df499 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.485672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c40a-c54d-4ad4-a1ff-544164ae8a8f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.485840 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e6283-12dc-4c8e-953f-1323bb7df499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.486138 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c40a-c54d-4ad4-a1ff-544164ae8a8f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.486575 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1c40a-c54d-4ad4-a1ff-544164ae8a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.487432 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e6283-12dc-4c8e-953f-1323bb7df499 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.502826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 778/1562] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:52:57.502826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e6283-12dc-4c8e-953f-1323bb7df499 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.508147 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-66a1c40a-c54d-4ad4-a1ff-544164ae8a8f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:57.509505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-66a1c40a-c54d-4ad4-a1ff-544164ae8a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:57.513055 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e6283-12dc-4c8e-953f-1323bb7df499 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.517657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 785/1563] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:57.518144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7eb37-7664-468f-b63c-284cd5014fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.518773 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7eb37-7664-468f-b63c-284cd5014fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.518941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e73da1-8843-44de-8f64-5f8050e24315 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.519116 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7eb37-7664-468f-b63c-284cd5014fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.519262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e73da1-8843-44de-8f64-5f8050e24315 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.519464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7eb37-7664-468f-b63c-284cd5014fd7 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.519614 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e73da1-8843-44de-8f64-5f8050e24315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.520219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7eb37-7664-468f-b63c-284cd5014fd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.523488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7eb37-7664-468f-b63c-284cd5014fd7 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.544181 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-b9e73da1-8843-44de-8f64-5f8050e24315 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:57.545949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b9e73da1-8843-44de-8f64-5f8050e24315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:57.553269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 779/1564] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:52:57 2022] POST /identity/v3/users => generated 290 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:52:57.554269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7eb37-7664-468f-b63c-284cd5014fd7 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.560821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 786/1565] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:57.560821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e73da1-8843-44de-8f64-5f8050e24315 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.565374 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7eb37-7664-468f-b63c-284cd5014fd7 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.570304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f82542-796b-4f3a-a7d6-41c548093ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.570939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82542-796b-4f3a-a7d6-41c548093ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.571181 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e73da1-8843-44de-8f64-5f8050e24315 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.571312 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82542-796b-4f3a-a7d6-41c548093ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.571633 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82542-796b-4f3a-a7d6-41c548093ba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.572335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f82542-796b-4f3a-a7d6-41c548093ba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:52:57.572635 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f82542-796b-4f3a-a7d6-41c548093ba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.574361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f82542-796b-4f3a-a7d6-41c548093ba8 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.577861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625bc98-9369-47e4-8074-a0f9a3e3768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.578521 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625bc98-9369-47e4-8074-a0f9a3e3768a admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.578776 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625bc98-9369-47e4-8074-a0f9a3e3768a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.579040 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625bc98-9369-47e4-8074-a0f9a3e3768a admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.579682 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625bc98-9369-47e4-8074-a0f9a3e3768a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.581709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625bc98-9369-47e4-8074-a0f9a3e3768a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.589753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 780/1566] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:52:57.592322 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f82542-796b-4f3a-a7d6-41c548093ba8 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.606457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 787/1567] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:52:57 2022] POST /identity/v3/users => generated 294 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:52:57.607507 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625bc98-9369-47e4-8074-a0f9a3e3768a admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.615788 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f82542-796b-4f3a-a7d6-41c548093ba8 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.618567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625bc98-9369-47e4-8074-a0f9a3e3768a admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.621364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fd3ef-2c7c-4842-86cd-086fee0f5712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.622214 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fd3ef-2c7c-4842-86cd-086fee0f5712 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.622550 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fd3ef-2c7c-4842-86cd-086fee0f5712 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.622929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fd3ef-2c7c-4842-86cd-086fee0f5712 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.623340 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f2896-c051-449a-80ad-9cf6f5cbb685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.623881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fd3ef-2c7c-4842-86cd-086fee0f5712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.623989 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f2896-c051-449a-80ad-9cf6f5cbb685 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.624434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f2896-c051-449a-80ad-9cf6f5cbb685 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.624434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f2896-c051-449a-80ad-9cf6f5cbb685 admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.625178 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f2896-c051-449a-80ad-9cf6f5cbb685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:52:57.625518 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f2896-c051-449a-80ad-9cf6f5cbb685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.626244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fd3ef-2c7c-4842-86cd-086fee0f5712 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.627118 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f2896-c051-449a-80ad-9cf6f5cbb685 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.642702 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 788/1568] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:52:57.643611 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f2896-c051-449a-80ad-9cf6f5cbb685 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.657240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f2896-c051-449a-80ad-9cf6f5cbb685 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.662473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5f3c5-9e17-4c47-afe0-2af8069172d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.663194 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 781/1569] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:52:57 2022] POST /identity/v3/users => generated 289 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:52:57.663358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5f3c5-9e17-4c47-afe0-2af8069172d9 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.663358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5f3c5-9e17-4c47-afe0-2af8069172d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.663768 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5f3c5-9e17-4c47-afe0-2af8069172d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.664437 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5f3c5-9e17-4c47-afe0-2af8069172d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.664614 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee995f9d-b64a-4aab-960f-c9b8eb235933 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.664858 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee995f9d-b64a-4aab-960f-c9b8eb235933 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.665147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee995f9d-b64a-4aab-960f-c9b8eb235933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.666476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5f3c5-9e17-4c47-afe0-2af8069172d9 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.682417 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 789/1570] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:52:57.682417 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5f3c5-9e17-4c47-afe0-2af8069172d9 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.694489 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-ee995f9d-b64a-4aab-960f-c9b8eb235933 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:57.695740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ee995f9d-b64a-4aab-960f-c9b8eb235933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:57.698058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5f3c5-9e17-4c47-afe0-2af8069172d9 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.704792 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 782/1571] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:57.705727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee995f9d-b64a-4aab-960f-c9b8eb235933 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.707177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a080592-6a11-40a0-a6bb-602b733f7e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.708256 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a080592-6a11-40a0-a6bb-602b733f7e63 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.708964 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a080592-6a11-40a0-a6bb-602b733f7e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.709488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a080592-6a11-40a0-a6bb-602b733f7e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.710744 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a080592-6a11-40a0-a6bb-602b733f7e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.714014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a080592-6a11-40a0-a6bb-602b733f7e63 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.715988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee995f9d-b64a-4aab-960f-c9b8eb235933 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.720919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077c653-e6fb-4954-9d2a-a6201f2906a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.721599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c653-e6fb-4954-9d2a-a6201f2906a8 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.721946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c653-e6fb-4954-9d2a-a6201f2906a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.722225 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c653-e6fb-4954-9d2a-a6201f2906a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.722902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077c653-e6fb-4954-9d2a-a6201f2906a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:52:57.723235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077c653-e6fb-4954-9d2a-a6201f2906a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.725197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077c653-e6fb-4954-9d2a-a6201f2906a8 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.733145 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 790/1572] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:52:57.734907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a080592-6a11-40a0-a6bb-602b733f7e63 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.745156 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 783/1573] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:52:57.746599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077c653-e6fb-4954-9d2a-a6201f2906a8 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.756342 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a080592-6a11-40a0-a6bb-602b733f7e63 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.758295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077c653-e6fb-4954-9d2a-a6201f2906a8 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.764602 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51394edf-5120-449c-9cc8-d486fb87faf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.764862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fb492-3602-4c05-bcfd-5b01c3ed58ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.765507 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fb492-3602-4c05-bcfd-5b01c3ed58ae admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.765803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fb492-3602-4c05-bcfd-5b01c3ed58ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.765920 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51394edf-5120-449c-9cc8-d486fb87faf1 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.766059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fb492-3602-4c05-bcfd-5b01c3ed58ae admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.766364 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51394edf-5120-449c-9cc8-d486fb87faf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.766727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fb492-3602-4c05-bcfd-5b01c3ed58ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.766850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51394edf-5120-449c-9cc8-d486fb87faf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.768024 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51394edf-5120-449c-9cc8-d486fb87faf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.768395 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fb492-3602-4c05-bcfd-5b01c3ed58ae admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.772029 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51394edf-5120-449c-9cc8-d486fb87faf1 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.781332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 784/1574] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:52:57.782055 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fb492-3602-4c05-bcfd-5b01c3ed58ae admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.792919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fb492-3602-4c05-bcfd-5b01c3ed58ae admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.798779 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab7c60-94d0-43ca-98db-19c97ea4c5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.799414 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab7c60-94d0-43ca-98db-19c97ea4c5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.799695 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab7c60-94d0-43ca-98db-19c97ea4c5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.799965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab7c60-94d0-43ca-98db-19c97ea4c5c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.800966 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab7c60-94d0-43ca-98db-19c97ea4c5c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.803066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab7c60-94d0-43ca-98db-19c97ea4c5c0 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.821107 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 791/1575] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:52:57 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:52:57.821107 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51394edf-5120-449c-9cc8-d486fb87faf1 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.841159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 785/1576] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:52:57 2022] POST /identity/v3/projects => generated 391 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:52:57.842028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab7c60-94d0-43ca-98db-19c97ea4c5c0 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:57.880870 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:57.912775 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51394edf-5120-449c-9cc8-d486fb87faf1 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.937216 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab7c60-94d0-43ca-98db-19c97ea4c5c0 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:57.943858 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc9de7-dc6f-4e96-b9e5-75aecc8419d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:57.944755 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9de7-dc6f-4e96-b9e5-75aecc8419d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:57.945118 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9de7-dc6f-4e96-b9e5-75aecc8419d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:57.945575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9de7-dc6f-4e96-b9e5-75aecc8419d8 admin admin] PATH_INFO: `/v3/projects/0c5b0898583d4508b8f7449aa16c0656/users/1f69ab01440e406f86f50bedc7e02fa4/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:57.962379 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:57.965903 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc9de7-dc6f-4e96-b9e5-75aecc8419d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5b0898583d4508b8f7449aa16c0656, user_id=1f69ab01440e406f86f50bedc7e02fa4, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:57.967772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: WARNING py.warnings [None req-98dc9de7-dc6f-4e96-b9e5-75aecc8419d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:52:57.967772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: warnings.warn(msg) Sep 12 23:52:57.967772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: Sep 12 23:52:57.970367 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc9de7-dc6f-4e96-b9e5-75aecc8419d8 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:57.994663 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 786/1577] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:52:57 2022] PUT /identity/v3/projects/0c5b0898583d4508b8f7449aa16c0656/users/1f69ab01440e406f86f50bedc7e02fa4/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:52:57.994663 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc9de7-dc6f-4e96-b9e5-75aecc8419d8 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.001743 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc795d3-a16c-455a-ba84-7a849c2ee225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.002803 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc795d3-a16c-455a-ba84-7a849c2ee225 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.003280 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc795d3-a16c-455a-ba84-7a849c2ee225 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.003775 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc795d3-a16c-455a-ba84-7a849c2ee225 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.004587 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc795d3-a16c-455a-ba84-7a849c2ee225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.006389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc795d3-a16c-455a-ba84-7a849c2ee225 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.018133 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 792/1578] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:52:58.019019 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc795d3-a16c-455a-ba84-7a849c2ee225 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.033707 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc795d3-a16c-455a-ba84-7a849c2ee225 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.095077 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc9de7-dc6f-4e96-b9e5-75aecc8419d8 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.101019 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92bff8-d911-46fa-979d-07556978256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.101686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92bff8-d911-46fa-979d-07556978256b admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.102009 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92bff8-d911-46fa-979d-07556978256b admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.102163 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31a8cb-3edb-451c-a065-d1f2d9913e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.102334 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92bff8-d911-46fa-979d-07556978256b admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.102749 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31a8cb-3edb-451c-a065-d1f2d9913e39 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.103030 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31a8cb-3edb-451c-a065-d1f2d9913e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.103199 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92bff8-d911-46fa-979d-07556978256b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:52:58.103347 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31a8cb-3edb-451c-a065-d1f2d9913e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.103508 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92bff8-d911-46fa-979d-07556978256b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.103960 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31a8cb-3edb-451c-a065-d1f2d9913e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.105131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92bff8-d911-46fa-979d-07556978256b admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.105604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31a8cb-3edb-451c-a065-d1f2d9913e39 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.117794 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 793/1579] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:52:58.119003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31a8cb-3edb-451c-a065-d1f2d9913e39 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.121545 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 787/1580] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:52:58.122938 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92bff8-d911-46fa-979d-07556978256b admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.135328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31a8cb-3edb-451c-a065-d1f2d9913e39 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.137732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92bff8-d911-46fa-979d-07556978256b admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.142890 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51427eb7-afd3-4c9f-9df5-e2b6afc68b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.143898 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51427eb7-afd3-4c9f-9df5-e2b6afc68b7c admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.144346 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51427eb7-afd3-4c9f-9df5-e2b6afc68b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.144763 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51427eb7-afd3-4c9f-9df5-e2b6afc68b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.144902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc874d-26c6-4151-a2bd-07cb92bf0efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.145748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc874d-26c6-4151-a2bd-07cb92bf0efc admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.145900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51427eb7-afd3-4c9f-9df5-e2b6afc68b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.146155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc874d-26c6-4151-a2bd-07cb92bf0efc admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.146589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc874d-26c6-4151-a2bd-07cb92bf0efc admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.147629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc874d-26c6-4151-a2bd-07cb92bf0efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.149228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51427eb7-afd3-4c9f-9df5-e2b6afc68b7c admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.150826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc874d-26c6-4151-a2bd-07cb92bf0efc admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.169582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 788/1581] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:52:58.170873 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc874d-26c6-4151-a2bd-07cb92bf0efc admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.188261 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc874d-26c6-4151-a2bd-07cb92bf0efc admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.194577 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 794/1582] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:52:58 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:52:58.195667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51427eb7-afd3-4c9f-9df5-e2b6afc68b7c admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.195875 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc40eb-2224-4a61-9a08-e2f0d7db8457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.196749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc40eb-2224-4a61-9a08-e2f0d7db8457 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.197122 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc40eb-2224-4a61-9a08-e2f0d7db8457 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.197511 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc40eb-2224-4a61-9a08-e2f0d7db8457 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.198462 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc40eb-2224-4a61-9a08-e2f0d7db8457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.202058 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc40eb-2224-4a61-9a08-e2f0d7db8457 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.230916 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 789/1583] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:52:58 2022] POST /identity/v3/users => generated 287 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:52:58.232392 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d5bb-2371-463e-9c1c-526b1d8d07fd None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.232693 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d5bb-2371-463e-9c1c-526b1d8d07fd None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.232999 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50d5bb-2371-463e-9c1c-526b1d8d07fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.256219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-8b50d5bb-2371-463e-9c1c-526b1d8d07fd None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:58.257400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-8b50d5bb-2371-463e-9c1c-526b1d8d07fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:58.276865 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51427eb7-afd3-4c9f-9df5-e2b6afc68b7c admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.282196 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf43872-4629-4464-a89a-22a185f8351e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.282850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf43872-4629-4464-a89a-22a185f8351e admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.283128 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf43872-4629-4464-a89a-22a185f8351e admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.283402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf43872-4629-4464-a89a-22a185f8351e admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.284052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf43872-4629-4464-a89a-22a185f8351e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.286045 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf43872-4629-4464-a89a-22a185f8351e admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.312229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 795/1584] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:52:58 2022] POST /identity/v3/users => generated 296 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:52:58.313116 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf43872-4629-4464-a89a-22a185f8351e admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.324472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf43872-4629-4464-a89a-22a185f8351e admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.330169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10b797-d099-4672-b42f-45659132eadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.330806 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10b797-d099-4672-b42f-45659132eadd admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.331081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10b797-d099-4672-b42f-45659132eadd admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.331365 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10b797-d099-4672-b42f-45659132eadd admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.332055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10b797-d099-4672-b42f-45659132eadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.333811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10b797-d099-4672-b42f-45659132eadd admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.345252 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 796/1585] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:52:58.346276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10b797-d099-4672-b42f-45659132eadd admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.355243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 790/1586] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:58.356383 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50d5bb-2371-463e-9c1c-526b1d8d07fd None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.362124 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10b797-d099-4672-b42f-45659132eadd admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.368577 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9121e02-3ffc-466f-b051-d4b8c79c5a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.369310 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9121e02-3ffc-466f-b051-d4b8c79c5a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.369616 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9121e02-3ffc-466f-b051-d4b8c79c5a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.369900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9121e02-3ffc-466f-b051-d4b8c79c5a49 admin admin] PATH_INFO: `/v3/projects/e92b1dea1e7048e69520940256aef913/users/e6b8d0f089b44ba38c2b22289e61734e/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.373810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50d5bb-2371-463e-9c1c-526b1d8d07fd None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.379739 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7fc21-26dd-47fb-9a1c-22c3220db49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.380497 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7fc21-26dd-47fb-9a1c-22c3220db49f admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.380921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7fc21-26dd-47fb-9a1c-22c3220db49f admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.381423 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7fc21-26dd-47fb-9a1c-22c3220db49f admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.382176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7fc21-26dd-47fb-9a1c-22c3220db49f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.384863 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7fc21-26dd-47fb-9a1c-22c3220db49f admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.391600 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9121e02-3ffc-466f-b051-d4b8c79c5a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92b1dea1e7048e69520940256aef913, user_id=e6b8d0f089b44ba38c2b22289e61734e, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.395436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9121e02-3ffc-466f-b051-d4b8c79c5a49 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.396735 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:58.411566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:58.419585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 797/1587] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:52:58 2022] PUT /identity/v3/projects/e92b1dea1e7048e69520940256aef913/users/e6b8d0f089b44ba38c2b22289e61734e/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:52:58.421137 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9121e02-3ffc-466f-b051-d4b8c79c5a49 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.429872 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 791/1588] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:52:58 2022] POST /identity/v3/projects => generated 357 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:52:58.431654 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7fc21-26dd-47fb-9a1c-22c3220db49f admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.511302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7fc21-26dd-47fb-9a1c-22c3220db49f admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.517261 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e87ee-f620-48a5-85d1-81c0e05c2009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.517943 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e87ee-f620-48a5-85d1-81c0e05c2009 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.518059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9121e02-3ffc-466f-b051-d4b8c79c5a49 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.518220 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e87ee-f620-48a5-85d1-81c0e05c2009 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.518486 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e87ee-f620-48a5-85d1-81c0e05c2009 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.519142 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e87ee-f620-48a5-85d1-81c0e05c2009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.521104 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e87ee-f620-48a5-85d1-81c0e05c2009 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.525918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df7574-f5e0-4ca7-bd34-472586004078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.527097 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df7574-f5e0-4ca7-bd34-472586004078 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.527614 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df7574-f5e0-4ca7-bd34-472586004078 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.528113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df7574-f5e0-4ca7-bd34-472586004078 admin admin] PATH_INFO: `/v3/projects/5593113ae7974e1697c20edb07eaa227/users/56e481141db84b40892770337a0b8f50/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.547343 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 792/1589] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:52:58 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:52:58.552318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e87ee-f620-48a5-85d1-81c0e05c2009 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.553885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df7574-f5e0-4ca7-bd34-472586004078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5593113ae7974e1697c20edb07eaa227, user_id=56e481141db84b40892770337a0b8f50, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.557752 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df7574-f5e0-4ca7-bd34-472586004078 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.559500 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e87ee-f620-48a5-85d1-81c0e05c2009 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.564903 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109df5be-e29d-40c4-a2ab-414b015fc680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.565833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109df5be-e29d-40c4-a2ab-414b015fc680 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.566001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109df5be-e29d-40c4-a2ab-414b015fc680 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.566230 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109df5be-e29d-40c4-a2ab-414b015fc680 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.566911 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109df5be-e29d-40c4-a2ab-414b015fc680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.568615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109df5be-e29d-40c4-a2ab-414b015fc680 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.579942 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 798/1590] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:52:58 2022] PUT /identity/v3/projects/5593113ae7974e1697c20edb07eaa227/users/56e481141db84b40892770337a0b8f50/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:52:58.580975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 793/1591] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:52:58.581384 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df7574-f5e0-4ca7-bd34-472586004078 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.584797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109df5be-e29d-40c4-a2ab-414b015fc680 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.596196 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109df5be-e29d-40c4-a2ab-414b015fc680 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.667559 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306b42d-c22f-4d98-b8ea-82658fef3740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.668263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306b42d-c22f-4d98-b8ea-82658fef3740 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.668538 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306b42d-c22f-4d98-b8ea-82658fef3740 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.668818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306b42d-c22f-4d98-b8ea-82658fef3740 admin admin] PATH_INFO: `/v3/projects/61cc23b70e5c4c9fba8cae710001ae70/users/a3caf53b684542ac87474ab807b5fdcc/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.686217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306b42d-c22f-4d98-b8ea-82658fef3740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61cc23b70e5c4c9fba8cae710001ae70, user_id=a3caf53b684542ac87474ab807b5fdcc, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.689565 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306b42d-c22f-4d98-b8ea-82658fef3740 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.691183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df7574-f5e0-4ca7-bd34-472586004078 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.699840 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf299b4-f44b-4105-bd3d-104ffdbf1bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.701044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf299b4-f44b-4105-bd3d-104ffdbf1bec admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.701584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf299b4-f44b-4105-bd3d-104ffdbf1bec admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.702077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf299b4-f44b-4105-bd3d-104ffdbf1bec admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.703290 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf299b4-f44b-4105-bd3d-104ffdbf1bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.706534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf299b4-f44b-4105-bd3d-104ffdbf1bec admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.707025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 794/1592] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:52:58 2022] PUT /identity/v3/projects/61cc23b70e5c4c9fba8cae710001ae70/users/a3caf53b684542ac87474ab807b5fdcc/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:52:58.708159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306b42d-c22f-4d98-b8ea-82658fef3740 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.731421 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 799/1593] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:52:58.731421 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92cce-e6d8-4ff0-94a1-ad2067f5e38d None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.731421 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92cce-e6d8-4ff0-94a1-ad2067f5e38d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.731421 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92cce-e6d8-4ff0-94a1-ad2067f5e38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.764402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-7ac92cce-e6d8-4ff0-94a1-ad2067f5e38d None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:58.766562 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-7ac92cce-e6d8-4ff0-94a1-ad2067f5e38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:58.770814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306b42d-c22f-4d98-b8ea-82658fef3740 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.774851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c4e81-ba0b-471c-ab69-ac30c478cbba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.775501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c4e81-ba0b-471c-ab69-ac30c478cbba service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.775767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c4e81-ba0b-471c-ab69-ac30c478cbba service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.776030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c4e81-ba0b-471c-ab69-ac30c478cbba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.782482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:58.849277 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 800/1594] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:58.850468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac92cce-e6d8-4ff0-94a1-ad2067f5e38d None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.863234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac92cce-e6d8-4ff0-94a1-ad2067f5e38d None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.869480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7a361-0648-482b-824c-7b18651db819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.870589 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7a361-0648-482b-824c-7b18651db819 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.871010 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7a361-0648-482b-824c-7b18651db819 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.871392 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7a361-0648-482b-824c-7b18651db819 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.872176 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7a361-0648-482b-824c-7b18651db819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.874322 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7a361-0648-482b-824c-7b18651db819 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.884865 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c4e81-ba0b-471c-ab69-ac30c478cbba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.887613 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c4e81-ba0b-471c-ab69-ac30c478cbba service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.902068 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 801/1595] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:52:58 2022] POST /identity/v3/users => generated 279 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:52:58.906782 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7a361-0648-482b-824c-7b18651db819 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.909143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 795/1596] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:52:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:52:58.910637 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c4e81-ba0b-471c-ab69-ac30c478cbba service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:58.913426 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:58.920978 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7a361-0648-482b-824c-7b18651db819 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.929242 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182ebd0-9af6-402c-b55e-5773b7e1aae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.930390 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c4e81-ba0b-471c-ab69-ac30c478cbba service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:58.930566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182ebd0-9af6-402c-b55e-5773b7e1aae7 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.930566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182ebd0-9af6-402c-b55e-5773b7e1aae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.930566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182ebd0-9af6-402c-b55e-5773b7e1aae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.931188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182ebd0-9af6-402c-b55e-5773b7e1aae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.932951 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182ebd0-9af6-402c-b55e-5773b7e1aae7 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.940294 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e625dcf-73cb-4cef-b7ef-4f015de4eb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:58.941602 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e625dcf-73cb-4cef-b7ef-4f015de4eb14 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.942133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e625dcf-73cb-4cef-b7ef-4f015de4eb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.942540 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e625dcf-73cb-4cef-b7ef-4f015de4eb14 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.944042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e625dcf-73cb-4cef-b7ef-4f015de4eb14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:58.947621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e625dcf-73cb-4cef-b7ef-4f015de4eb14 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:58.949668 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 802/1597] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:52:58.951029 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f026b-7b57-4151-ad97-c511b0e156cc None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.951312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f026b-7b57-4151-ad97-c511b0e156cc None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.951583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f026b-7b57-4151-ad97-c511b0e156cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.972425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 796/1598] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:52:58.974720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9734c-2790-4d21-94c0-a68cec465d91 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:58.975218 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9734c-2790-4d21-94c0-a68cec465d91 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:58.976946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9734c-2790-4d21-94c0-a68cec465d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:58.986246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-337f026b-7b57-4151-ad97-c511b0e156cc None None] MFA Rules not processed for user `56e481141db84b40892770337a0b8f50`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:58.987836 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-337f026b-7b57-4151-ad97-c511b0e156cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:59.015212 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-08b9734c-2790-4d21-94c0-a68cec465d91 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:59.017619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-08b9734c-2790-4d21-94c0-a68cec465d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:59.035575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 797/1599] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:59.037464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9734c-2790-4d21-94c0-a68cec465d91 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:59.059258 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9734c-2790-4d21-94c0-a68cec465d91 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:59.071726 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8262825-d8e5-47fe-af75-f5e3a92a6730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:59.073090 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8262825-d8e5-47fe-af75-f5e3a92a6730 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:59.073841 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8262825-d8e5-47fe-af75-f5e3a92a6730 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:59.074333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8262825-d8e5-47fe-af75-f5e3a92a6730 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:59.076052 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8262825-d8e5-47fe-af75-f5e3a92a6730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:59.079472 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8262825-d8e5-47fe-af75-f5e3a92a6730 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:59.091766 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 803/1600] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:59.093011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f026b-7b57-4151-ad97-c511b0e156cc None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:59.101583 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 798/1601] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:52:59.103174 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8262825-d8e5-47fe-af75-f5e3a92a6730 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:59.110588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f026b-7b57-4151-ad97-c511b0e156cc None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:59.115569 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8262825-d8e5-47fe-af75-f5e3a92a6730 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:59.116000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42954e1b-8887-4a42-bc3a-b4743cb96b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:59.116864 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42954e1b-8887-4a42-bc3a-b4743cb96b8a service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:59.117151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42954e1b-8887-4a42-bc3a-b4743cb96b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:59.118609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42954e1b-8887-4a42-bc3a-b4743cb96b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:59.123280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3dd06-d926-4705-b7e5-6404ac5495a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:59.123652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3dd06-d926-4705-b7e5-6404ac5495a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:59.123987 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3dd06-d926-4705-b7e5-6404ac5495a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:59.124321 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3dd06-d926-4705-b7e5-6404ac5495a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:59.125065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3dd06-d926-4705-b7e5-6404ac5495a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:59.126906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3dd06-d926-4705-b7e5-6404ac5495a5 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:59.131753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42954e1b-8887-4a42-bc3a-b4743cb96b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:59.133570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42954e1b-8887-4a42-bc3a-b4743cb96b8a service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:59.144251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 799/1602] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:52:59.144251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3dd06-d926-4705-b7e5-6404ac5495a5 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:59.152394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 804/1603] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:52:59.153055 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3dd06-d926-4705-b7e5-6404ac5495a5 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:59.153248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42954e1b-8887-4a42-bc3a-b4743cb96b8a service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:59.159041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e045adb-8806-4f06-b008-09367eff6d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:59.161206 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e045adb-8806-4f06-b008-09367eff6d0c admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:59.161206 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e045adb-8806-4f06-b008-09367eff6d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:59.161206 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e045adb-8806-4f06-b008-09367eff6d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:59.161206 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e045adb-8806-4f06-b008-09367eff6d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:59.163802 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e045adb-8806-4f06-b008-09367eff6d0c admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:59.167301 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42954e1b-8887-4a42-bc3a-b4743cb96b8a service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:59.181061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb806f-af29-4f9f-894e-3c0f02863d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:59.181061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb806f-af29-4f9f-894e-3c0f02863d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:59.181061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb806f-af29-4f9f-894e-3c0f02863d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:59.181061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb806f-af29-4f9f-894e-3c0f02863d08 admin admin] PATH_INFO: `/v3/projects/5d541ffdd04b4f9f890eca3e9d468cb1/users/79dd7e7ebf59445598803aed347c87dd/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:59.181648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 800/1604] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:52:59.181648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e045adb-8806-4f06-b008-09367eff6d0c admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:59.184548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-2e045adb-8806-4f06-b008-09367eff6d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:59.199126 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e045adb-8806-4f06-b008-09367eff6d0c admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:59.203678 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb7e4a-be3f-4977-867e-a6e82199628e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:59.204413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb7e4a-be3f-4977-867e-a6e82199628e service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:59.204754 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb7e4a-be3f-4977-867e-a6e82199628e service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:59.205091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb7e4a-be3f-4977-867e-a6e82199628e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:59.216314 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb7e4a-be3f-4977-867e-a6e82199628e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:59.218088 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb7e4a-be3f-4977-867e-a6e82199628e service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:59.222548 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb806f-af29-4f9f-894e-3c0f02863d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d541ffdd04b4f9f890eca3e9d468cb1, user_id=79dd7e7ebf59445598803aed347c87dd, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:59.232562 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 801/1605] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:52:59.233691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb7e4a-be3f-4977-867e-a6e82199628e service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:59.234265 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb806f-af29-4f9f-894e-3c0f02863d08 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:59.245217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb7e4a-be3f-4977-867e-a6e82199628e service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:59.251292 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf65de0-8a5f-4737-a73d-3516e93bb7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:59.252309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf65de0-8a5f-4737-a73d-3516e93bb7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:59.252665 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf65de0-8a5f-4737-a73d-3516e93bb7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:59.253117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf65de0-8a5f-4737-a73d-3516e93bb7c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:59.254004 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf65de0-8a5f-4737-a73d-3516e93bb7c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:59.256585 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf65de0-8a5f-4737-a73d-3516e93bb7c0 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:59.271818 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 805/1606] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:52:59 2022] PUT /identity/v3/projects/5d541ffdd04b4f9f890eca3e9d468cb1/users/79dd7e7ebf59445598803aed347c87dd/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:52:59.273368 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb806f-af29-4f9f-894e-3c0f02863d08 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:59.296230 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 802/1607] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:52:59 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:52:59.301123 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf65de0-8a5f-4737-a73d-3516e93bb7c0 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:59.418797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf65de0-8a5f-4737-a73d-3516e93bb7c0 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:59.421421 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb806f-af29-4f9f-894e-3c0f02863d08 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:59.427073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b02a8-c09c-4c60-aaf3-4b3d580cd10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:59.428005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b02a8-c09c-4c60-aaf3-4b3d580cd10d admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:59.428398 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b02a8-c09c-4c60-aaf3-4b3d580cd10d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:59.428829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b02a8-c09c-4c60-aaf3-4b3d580cd10d admin admin] PATH_INFO: `/v3/projects/599db5bc6cd74f27ae885c9994f06953/users/4e71cfb3bd8646798cd5ab0d1a7445d7/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:59.443114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8648c-10d6-470b-96d1-10c75fd51c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:59.444164 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8648c-10d6-470b-96d1-10c75fd51c4a admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:59.444609 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8648c-10d6-470b-96d1-10c75fd51c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:59.445477 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8648c-10d6-470b-96d1-10c75fd51c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:59.446580 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8648c-10d6-470b-96d1-10c75fd51c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:59.449650 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8648c-10d6-470b-96d1-10c75fd51c4a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:59.454928 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b02a8-c09c-4c60-aaf3-4b3d580cd10d admin admin] RBAC: Authorizing `identity:create_grant(project_id=599db5bc6cd74f27ae885c9994f06953, user_id=4e71cfb3bd8646798cd5ab0d1a7445d7, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:59.459754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b02a8-c09c-4c60-aaf3-4b3d580cd10d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:59.475290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 803/1608] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:52:59.475290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8648c-10d6-470b-96d1-10c75fd51c4a admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:59.497991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8648c-10d6-470b-96d1-10c75fd51c4a admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:59.516200 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 806/1609] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:52:59 2022] PUT /identity/v3/projects/599db5bc6cd74f27ae885c9994f06953/users/4e71cfb3bd8646798cd5ab0d1a7445d7/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:52:59.518238 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c7afa-ae01-4fee-bfe2-602226358323 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:59.518786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c7afa-ae01-4fee-bfe2-602226358323 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:59.519151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c7afa-ae01-4fee-bfe2-602226358323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:59.534019 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:59.612000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-5b8c7afa-ae01-4fee-bfe2-602226358323 None None] MFA Rules not processed for user `79dd7e7ebf59445598803aed347c87dd`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:52:59.613280 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5b8c7afa-ae01-4fee-bfe2-602226358323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:52:59.657905 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:59.685712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a032a9f-8cc7-4d3b-a18c-838901004819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:59.687274 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a032a9f-8cc7-4d3b-a18c-838901004819 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:59.687762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a032a9f-8cc7-4d3b-a18c-838901004819 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:59.688266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a032a9f-8cc7-4d3b-a18c-838901004819 admin admin] PATH_INFO: `/v3/projects/ab58084505214e418111dccbb5db889e/users/c760a9f2d22e449a8bce9964e2f0fec7/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:59.732372 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a032a9f-8cc7-4d3b-a18c-838901004819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab58084505214e418111dccbb5db889e, user_id=c760a9f2d22e449a8bce9964e2f0fec7, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:59.740469 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a032a9f-8cc7-4d3b-a18c-838901004819 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:59.785282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 804/1610] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:52:59 2022] PUT /identity/v3/projects/ab58084505214e418111dccbb5db889e/users/c760a9f2d22e449a8bce9964e2f0fec7/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:52:59.787098 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a032a9f-8cc7-4d3b-a18c-838901004819 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:59.905139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 807/1611] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:52:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:52:59.907303 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c7afa-ae01-4fee-bfe2-602226358323 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:52:59.945921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c7afa-ae01-4fee-bfe2-602226358323 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:59.947393 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a032a9f-8cc7-4d3b-a18c-838901004819 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:52:59.959052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d8b69-2756-48dc-bb2f-97763e74f63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:59.959754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d8b69-2756-48dc-bb2f-97763e74f63c admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:59.960032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d8b69-2756-48dc-bb2f-97763e74f63c admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:59.960383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d8b69-2756-48dc-bb2f-97763e74f63c admin admin] PATH_INFO: `/v3/projects/bd3ca225ebe249098ba6cd7d027232f7/users/d57acbe6c9034afd9d4ec1d615e133d5/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:59.961624 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884d47f-6a18-49e0-a34d-246f9b48ba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:52:59.962743 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884d47f-6a18-49e0-a34d-246f9b48ba4e admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:52:59.963637 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884d47f-6a18-49e0-a34d-246f9b48ba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:52:59.964137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884d47f-6a18-49e0-a34d-246f9b48ba4e admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:52:59.967338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884d47f-6a18-49e0-a34d-246f9b48ba4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:59.982355 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d8b69-2756-48dc-bb2f-97763e74f63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3ca225ebe249098ba6cd7d027232f7, user_id=d57acbe6c9034afd9d4ec1d615e133d5, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:52:59.985924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d8b69-2756-48dc-bb2f-97763e74f63c admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:52:59.987017 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884d47f-6a18-49e0-a34d-246f9b48ba4e admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:00.018965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 808/1612] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:52:59 2022] PUT /identity/v3/projects/bd3ca225ebe249098ba6cd7d027232f7/users/d57acbe6c9034afd9d4ec1d615e133d5/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:00.020525 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61322769-924b-4714-9861-f9e94cb5dc22 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:00.020949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61322769-924b-4714-9861-f9e94cb5dc22 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:00.021236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61322769-924b-4714-9861-f9e94cb5dc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:00.055434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 805/1613] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:52:59 2022] POST /identity/v3/users => generated 300 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:00.058925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af8780-8461-4512-8632-279e7efbea37 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:00.061144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af8780-8461-4512-8632-279e7efbea37 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:00.061475 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af8780-8461-4512-8632-279e7efbea37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:00.065412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-61322769-924b-4714-9861-f9e94cb5dc22 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:00.066853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-61322769-924b-4714-9861-f9e94cb5dc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:00.146461 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 809/1614] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:00.147653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61322769-924b-4714-9861-f9e94cb5dc22 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:00.159130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-f5af8780-8461-4512-8632-279e7efbea37 None None] MFA Rules not processed for user `c760a9f2d22e449a8bce9964e2f0fec7`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:00.159580 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61322769-924b-4714-9861-f9e94cb5dc22 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:00.161751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f5af8780-8461-4512-8632-279e7efbea37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:00.165090 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a1127-d6b6-4627-a54e-a19172f47fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:00.165820 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a1127-d6b6-4627-a54e-a19172f47fcb admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:00.166153 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a1127-d6b6-4627-a54e-a19172f47fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:00.166477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a1127-d6b6-4627-a54e-a19172f47fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:00.167257 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a1127-d6b6-4627-a54e-a19172f47fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:00.169677 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a1127-d6b6-4627-a54e-a19172f47fcb admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:00.225627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 810/1615] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:00 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:00.225627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eda910-712b-477a-89be-39c1723b3300 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:00.225627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eda910-712b-477a-89be-39c1723b3300 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:00.225627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eda910-712b-477a-89be-39c1723b3300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:00.267016 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-f3eda910-712b-477a-89be-39c1723b3300 None None] MFA Rules not processed for user `d57acbe6c9034afd9d4ec1d615e133d5`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:00.269710 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-f3eda910-712b-477a-89be-39c1723b3300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:00.358898 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:00.369591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 811/1616] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:00.371670 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eda910-712b-477a-89be-39c1723b3300 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:00.403074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 806/1617] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:00.404862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af8780-8461-4512-8632-279e7efbea37 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:00.441731 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:00.547002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eda910-712b-477a-89be-39c1723b3300 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:00.565793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92713594-8f99-47b2-bcc6-0cdcf478f331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:00.566448 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92713594-8f99-47b2-bcc6-0cdcf478f331 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:00.567166 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92713594-8f99-47b2-bcc6-0cdcf478f331 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:00.567645 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92713594-8f99-47b2-bcc6-0cdcf478f331 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:00.568468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92713594-8f99-47b2-bcc6-0cdcf478f331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:00.570338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af8780-8461-4512-8632-279e7efbea37 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:00.570562 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92713594-8f99-47b2-bcc6-0cdcf478f331 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:00.599779 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 812/1618] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:00.601143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92713594-8f99-47b2-bcc6-0cdcf478f331 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:00.621321 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92713594-8f99-47b2-bcc6-0cdcf478f331 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:00.639947 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4657d-0d33-486b-8710-333b0c0256f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:00.640800 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4657d-0d33-486b-8710-333b0c0256f0 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:00.641121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4657d-0d33-486b-8710-333b0c0256f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:00.641551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4657d-0d33-486b-8710-333b0c0256f0 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:00.644364 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4657d-0d33-486b-8710-333b0c0256f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:00.646924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4657d-0d33-486b-8710-333b0c0256f0 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:00.694410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 813/1619] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:00 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:00.695490 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4657d-0d33-486b-8710-333b0c0256f0 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:00.721136 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4657d-0d33-486b-8710-333b0c0256f0 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:00.738347 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64c52b-e961-43d9-b83c-40b3f168aa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:00.739193 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64c52b-e961-43d9-b83c-40b3f168aa52 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:00.742320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64c52b-e961-43d9-b83c-40b3f168aa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:00.742705 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f1a42-7110-48b4-bdd5-daa2d07978ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:00.743180 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64c52b-e961-43d9-b83c-40b3f168aa52 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:00.743465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64c52b-e961-43d9-b83c-40b3f168aa52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:00.744526 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f1a42-7110-48b4-bdd5-daa2d07978ad service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:00.744675 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f1a42-7110-48b4-bdd5-daa2d07978ad service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:00.745153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f1a42-7110-48b4-bdd5-daa2d07978ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:00.745631 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64c52b-e961-43d9-b83c-40b3f168aa52 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:00.770343 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f1a42-7110-48b4-bdd5-daa2d07978ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:00.774341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f1a42-7110-48b4-bdd5-daa2d07978ad service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:00.783869 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 814/1620] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:00 2022] POST /identity/v3/projects => generated 357 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:00.785261 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64c52b-e961-43d9-b83c-40b3f168aa52 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:00.806459 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 807/1621] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:00.813769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f1a42-7110-48b4-bdd5-daa2d07978ad service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:00.836148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f1a42-7110-48b4-bdd5-daa2d07978ad service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:00.931899 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64c52b-e961-43d9-b83c-40b3f168aa52 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:00.940591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef03f01-34bd-491c-9f33-2e963254745d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:00.942485 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef03f01-34bd-491c-9f33-2e963254745d service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:00.943236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef03f01-34bd-491c-9f33-2e963254745d service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:00.944003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef03f01-34bd-491c-9f33-2e963254745d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:01.006339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd00887-fd33-4562-bf0b-1770710aef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:01.007039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd00887-fd33-4562-bf0b-1770710aef27 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:01.007316 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd00887-fd33-4562-bf0b-1770710aef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:01.007588 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd00887-fd33-4562-bf0b-1770710aef27 admin admin] PATH_INFO: `/v3/projects/8f86f9158d6041928708f64e10722adb/users/5e95970b0a4b40f0a6bf87c6bdf12c8c/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:01.047099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd00887-fd33-4562-bf0b-1770710aef27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f86f9158d6041928708f64e10722adb, user_id=5e95970b0a4b40f0a6bf87c6bdf12c8c, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:01.061053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd00887-fd33-4562-bf0b-1770710aef27 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:01.085838 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 808/1622] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:00 2022] PUT /identity/v3/projects/8f86f9158d6041928708f64e10722adb/users/5e95970b0a4b40f0a6bf87c6bdf12c8c/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:01.090064 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd00887-fd33-4562-bf0b-1770710aef27 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:01.108350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef03f01-34bd-491c-9f33-2e963254745d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:01.113386 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef03f01-34bd-491c-9f33-2e963254745d service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:01.141594 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 815/1623] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:01.143560 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef03f01-34bd-491c-9f33-2e963254745d service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:01.171631 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef03f01-34bd-491c-9f33-2e963254745d service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:01.206661 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:01.225487 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:01.231528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd00887-fd33-4562-bf0b-1770710aef27 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:01.245115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c8613-05a8-4531-85f2-0acb49b95c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:01.245796 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c8613-05a8-4531-85f2-0acb49b95c11 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:01.246083 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c8613-05a8-4531-85f2-0acb49b95c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:01.246353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c8613-05a8-4531-85f2-0acb49b95c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:01.247039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c8613-05a8-4531-85f2-0acb49b95c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:01.249219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c8613-05a8-4531-85f2-0acb49b95c11 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:01.273240 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 809/1624] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:01.274324 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c8613-05a8-4531-85f2-0acb49b95c11 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:01.295930 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c8613-05a8-4531-85f2-0acb49b95c11 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:01.309023 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b13fb-4163-49bd-bdcd-0abc18abb1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:01.309588 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b13fb-4163-49bd-bdcd-0abc18abb1fb admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:01.309869 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b13fb-4163-49bd-bdcd-0abc18abb1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:01.310146 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b13fb-4163-49bd-bdcd-0abc18abb1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:01.310809 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b13fb-4163-49bd-bdcd-0abc18abb1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:01.312491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b13fb-4163-49bd-bdcd-0abc18abb1fb admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:01.337298 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 810/1625] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:01.341880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b13fb-4163-49bd-bdcd-0abc18abb1fb admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:01.367812 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b13fb-4163-49bd-bdcd-0abc18abb1fb admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:01.380451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c05e0-af5f-4704-a4e0-1aa5b2d6cf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:01.381155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c05e0-af5f-4704-a4e0-1aa5b2d6cf4e admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:01.381463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c05e0-af5f-4704-a4e0-1aa5b2d6cf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:01.381739 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c05e0-af5f-4704-a4e0-1aa5b2d6cf4e admin admin] PATH_INFO: `/v3/projects/129abb7974aa41d6a6d71048ebdae43a/users/dcbf0ef3dead4ffc8aefa4dcdb453a98/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:01.409691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c05e0-af5f-4704-a4e0-1aa5b2d6cf4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=129abb7974aa41d6a6d71048ebdae43a, user_id=dcbf0ef3dead4ffc8aefa4dcdb453a98, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:01.412483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c05e0-af5f-4704-a4e0-1aa5b2d6cf4e admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:01.451467 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 811/1626] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:01 2022] PUT /identity/v3/projects/129abb7974aa41d6a6d71048ebdae43a/users/dcbf0ef3dead4ffc8aefa4dcdb453a98/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:01.452461 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c05e0-af5f-4704-a4e0-1aa5b2d6cf4e admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:01.461522 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609abcc-e6ad-4071-8a77-5a60c06650ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:01.462717 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609abcc-e6ad-4071-8a77-5a60c06650ca admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:01.464113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609abcc-e6ad-4071-8a77-5a60c06650ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:01.465993 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609abcc-e6ad-4071-8a77-5a60c06650ca admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:01.472047 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609abcc-e6ad-4071-8a77-5a60c06650ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:01.485745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609abcc-e6ad-4071-8a77-5a60c06650ca admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:01.601906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 816/1627] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:01 2022] POST /identity/v3/users => generated 285 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:01.607665 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609abcc-e6ad-4071-8a77-5a60c06650ca admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:01.648367 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c05e0-af5f-4704-a4e0-1aa5b2d6cf4e admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:01.652572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609abcc-e6ad-4071-8a77-5a60c06650ca admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:01.664296 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35ccf0-5190-4a35-864e-c1477371f3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:01.665237 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35ccf0-5190-4a35-864e-c1477371f3ec admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:01.665852 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35ccf0-5190-4a35-864e-c1477371f3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:01.666361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35ccf0-5190-4a35-864e-c1477371f3ec admin admin] PATH_INFO: `/v3/projects/8f86f9158d6041928708f64e10722adb/users/5e95970b0a4b40f0a6bf87c6bdf12c8c/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:01.671116 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2138cf3-96d5-4c9c-ba5d-56923d572fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:01.674387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35ccf0-5190-4a35-864e-c1477371f3ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f86f9158d6041928708f64e10722adb, user_id=5e95970b0a4b40f0a6bf87c6bdf12c8c, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:01.677286 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2138cf3-96d5-4c9c-ba5d-56923d572fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:01.679522 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2138cf3-96d5-4c9c-ba5d-56923d572fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:01.680000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2138cf3-96d5-4c9c-ba5d-56923d572fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:01.681082 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2138cf3-96d5-4c9c-ba5d-56923d572fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:01.684374 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35ccf0-5190-4a35-864e-c1477371f3ec admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:01.693776 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2138cf3-96d5-4c9c-ba5d-56923d572fe2 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:01.731096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 812/1628] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:01 2022] PUT /identity/v3/projects/8f86f9158d6041928708f64e10722adb/users/5e95970b0a4b40f0a6bf87c6bdf12c8c/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:01.733218 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35ccf0-5190-4a35-864e-c1477371f3ec admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:01.772108 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 817/1629] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:01.781911 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45683ec8-2886-421d-b72d-8d875c6a88a2 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:01.782438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45683ec8-2886-421d-b72d-8d875c6a88a2 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:01.782917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45683ec8-2886-421d-b72d-8d875c6a88a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:01.886383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-45683ec8-2886-421d-b72d-8d875c6a88a2 None None] MFA Rules not processed for user `5e95970b0a4b40f0a6bf87c6bdf12c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:01.889132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-45683ec8-2886-421d-b72d-8d875c6a88a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:01.947474 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35ccf0-5190-4a35-864e-c1477371f3ec admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:01.965762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8b501-9d6b-4767-ad6f-1d83a849e19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:01.966846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8b501-9d6b-4767-ad6f-1d83a849e19b admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:01.967491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8b501-9d6b-4767-ad6f-1d83a849e19b admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:01.967996 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8b501-9d6b-4767-ad6f-1d83a849e19b admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:01.969621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8b501-9d6b-4767-ad6f-1d83a849e19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:01.974417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8b501-9d6b-4767-ad6f-1d83a849e19b admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:02.006061 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 813/1630] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:02.007226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8b501-9d6b-4767-ad6f-1d83a849e19b admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:02.039686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8b501-9d6b-4767-ad6f-1d83a849e19b admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:02.058258 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66278edd-a63a-4b3a-9d47-843069f3434d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:02.059128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66278edd-a63a-4b3a-9d47-843069f3434d admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:02.059510 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66278edd-a63a-4b3a-9d47-843069f3434d admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:02.060213 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66278edd-a63a-4b3a-9d47-843069f3434d admin admin] PATH_INFO: `/v3/projects/129abb7974aa41d6a6d71048ebdae43a/users/dcbf0ef3dead4ffc8aefa4dcdb453a98/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:02.067938 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66278edd-a63a-4b3a-9d47-843069f3434d admin admin] RBAC: Authorizing `identity:create_grant(project_id=129abb7974aa41d6a6d71048ebdae43a, user_id=dcbf0ef3dead4ffc8aefa4dcdb453a98, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:02.070966 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66278edd-a63a-4b3a-9d47-843069f3434d admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:02.117390 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 814/1631] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:02 2022] PUT /identity/v3/projects/129abb7974aa41d6a6d71048ebdae43a/users/dcbf0ef3dead4ffc8aefa4dcdb453a98/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:02.117390 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66278edd-a63a-4b3a-9d47-843069f3434d admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:02.220368 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:02.270907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 818/1632] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 494 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:02.270907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0239f2-2e7c-4916-8d57-f269f4e7b47d None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:02.270907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0239f2-2e7c-4916-8d57-f269f4e7b47d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:02.271652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0239f2-2e7c-4916-8d57-f269f4e7b47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:02.312526 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66278edd-a63a-4b3a-9d47-843069f3434d admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:02.319501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee35a50-3602-4511-b3cf-69c8717663e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:02.320255 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee35a50-3602-4511-b3cf-69c8717663e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:02.320538 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee35a50-3602-4511-b3cf-69c8717663e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:02.320901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee35a50-3602-4511-b3cf-69c8717663e6 admin admin] PATH_INFO: `/v3/projects/67c74643bcf14629b0df170c14a837dc/users/658c71d9d2df40da9a6c1f8c28d5ebef/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:02.352457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee35a50-3602-4511-b3cf-69c8717663e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c74643bcf14629b0df170c14a837dc, user_id=658c71d9d2df40da9a6c1f8c28d5ebef, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:02.355851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee35a50-3602-4511-b3cf-69c8717663e6 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:02.391892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-6e0239f2-2e7c-4916-8d57-f269f4e7b47d None None] MFA Rules not processed for user `dcbf0ef3dead4ffc8aefa4dcdb453a98`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:02.394667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6e0239f2-2e7c-4916-8d57-f269f4e7b47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:02.400736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 815/1633] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:02 2022] PUT /identity/v3/projects/67c74643bcf14629b0df170c14a837dc/users/658c71d9d2df40da9a6c1f8c28d5ebef/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:02.402370 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee35a50-3602-4511-b3cf-69c8717663e6 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:02.625531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee35a50-3602-4511-b3cf-69c8717663e6 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:02.636164 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394182e-b19d-4630-973a-ea681a38648c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:02.636817 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394182e-b19d-4630-973a-ea681a38648c service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:02.637096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394182e-b19d-4630-973a-ea681a38648c service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:02.637537 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394182e-b19d-4630-973a-ea681a38648c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:02.650515 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:02.674905 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 819/1634] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:02.677554 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0239f2-2e7c-4916-8d57-f269f4e7b47d None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:02.798052 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394182e-b19d-4630-973a-ea681a38648c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:02.799660 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394182e-b19d-4630-973a-ea681a38648c service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:02.827475 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 816/1635] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:02.830452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394182e-b19d-4630-973a-ea681a38648c service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:02.839090 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0239f2-2e7c-4916-8d57-f269f4e7b47d None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:02.851430 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394182e-b19d-4630-973a-ea681a38648c service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:02.852537 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adfd67-0540-4588-97da-8e6a063553d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:02.854366 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adfd67-0540-4588-97da-8e6a063553d5 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:02.854908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adfd67-0540-4588-97da-8e6a063553d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:02.855410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adfd67-0540-4588-97da-8e6a063553d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:02.857098 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adfd67-0540-4588-97da-8e6a063553d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:02.861601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adfd67-0540-4588-97da-8e6a063553d5 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:02.864365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3f611-6189-4525-9ddf-f5924eb6ea92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:02.865030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f611-6189-4525-9ddf-f5924eb6ea92 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:02.865311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f611-6189-4525-9ddf-f5924eb6ea92 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:02.865803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f611-6189-4525-9ddf-f5924eb6ea92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:02.892744 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 820/1636] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:02.895257 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adfd67-0540-4588-97da-8e6a063553d5 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:02.895925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3f611-6189-4525-9ddf-f5924eb6ea92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:02.897597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3f611-6189-4525-9ddf-f5924eb6ea92 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:02.922118 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 817/1637] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:02.923221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3f611-6189-4525-9ddf-f5924eb6ea92 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:02.928223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adfd67-0540-4588-97da-8e6a063553d5 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:02.937486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a435a3-1213-4f7a-b065-747db8975501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:02.939146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a435a3-1213-4f7a-b065-747db8975501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:02.939921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a435a3-1213-4f7a-b065-747db8975501 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:02.940691 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a435a3-1213-4f7a-b065-747db8975501 admin admin] PATH_INFO: `/v3/users/56e481141db84b40892770337a0b8f50` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:02.943357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a435a3-1213-4f7a-b065-747db8975501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e481141db84b40892770337a0b8f50)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:02.948583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a435a3-1213-4f7a-b065-747db8975501 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:02.951596 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3f611-6189-4525-9ddf-f5924eb6ea92 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:02.963760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e5b0a-da64-4270-945a-c56d8a56f30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:02.964462 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e5b0a-da64-4270-945a-c56d8a56f30f admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:02.964795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e5b0a-da64-4270-945a-c56d8a56f30f admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:02.965051 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e5b0a-da64-4270-945a-c56d8a56f30f admin admin] PATH_INFO: `/v3/projects/67c74643bcf14629b0df170c14a837dc/users/658c71d9d2df40da9a6c1f8c28d5ebef/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:02.969972 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e5b0a-da64-4270-945a-c56d8a56f30f admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c74643bcf14629b0df170c14a837dc, user_id=658c71d9d2df40da9a6c1f8c28d5ebef, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:02.973964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e5b0a-da64-4270-945a-c56d8a56f30f admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:03.015764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 818/1638] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:02 2022] PUT /identity/v3/projects/67c74643bcf14629b0df170c14a837dc/users/658c71d9d2df40da9a6c1f8c28d5ebef/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:03.018275 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46f886-282c-4250-827e-4137abf94cd8 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:03.018715 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46f886-282c-4250-827e-4137abf94cd8 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:03.019033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46f886-282c-4250-827e-4137abf94cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:03.074646 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-6b46f886-282c-4250-827e-4137abf94cd8 None None] MFA Rules not processed for user `658c71d9d2df40da9a6c1f8c28d5ebef`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:03.076316 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6b46f886-282c-4250-827e-4137abf94cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:03.100420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-33a435a3-1213-4f7a-b065-747db8975501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e481141db84b40892770337a0b8f50'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:03.116913 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-33a435a3-1213-4f7a-b065-747db8975501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e481141db84b40892770337a0b8f50'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:03.153833 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-33a435a3-1213-4f7a-b065-747db8975501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e481141db84b40892770337a0b8f50'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:03.154108 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:03.176682 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-33a435a3-1213-4f7a-b065-747db8975501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e481141db84b40892770337a0b8f50'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:03.177838 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-33a435a3-1213-4f7a-b065-747db8975501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e481141db84b40892770337a0b8f50'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:03.218921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 821/1639] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:02 2022] DELETE /identity/v3/users/56e481141db84b40892770337a0b8f50 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:03.222090 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266090b2-f1da-4c74-934c-4abfbe928ea7 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:03.222598 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266090b2-f1da-4c74-934c-4abfbe928ea7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:03.223126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266090b2-f1da-4c74-934c-4abfbe928ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:03.289966 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 819/1640] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:03 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:03.295906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46f886-282c-4250-827e-4137abf94cd8 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:03.297567 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6b46f886-282c-4250-827e-4137abf94cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:03.299504 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-266090b2-f1da-4c74-934c-4abfbe928ea7 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:03.306195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-266090b2-f1da-4c74-934c-4abfbe928ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:03.391524 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46f886-282c-4250-827e-4137abf94cd8 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:03.550711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a9bc8-0596-47d6-a0f2-b2bc890c274d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:03.553995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a9bc8-0596-47d6-a0f2-b2bc890c274d service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:03.554298 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a9bc8-0596-47d6-a0f2-b2bc890c274d service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:03.554575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a9bc8-0596-47d6-a0f2-b2bc890c274d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:03.643143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 822/1641] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:53:03.713793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266090b2-f1da-4c74-934c-4abfbe928ea7 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:03.717503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-266090b2-f1da-4c74-934c-4abfbe928ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:03.784988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:03.786931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a9bc8-0596-47d6-a0f2-b2bc890c274d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:03.795081 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a9bc8-0596-47d6-a0f2-b2bc890c274d service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:03.848661 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 820/1642] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:53:03.942295 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266090b2-f1da-4c74-934c-4abfbe928ea7 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:03.949884 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374ffc1-9dfe-48d3-a63a-6097edf54392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:03.951109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374ffc1-9dfe-48d3-a63a-6097edf54392 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:03.952569 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374ffc1-9dfe-48d3-a63a-6097edf54392 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:03.953050 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374ffc1-9dfe-48d3-a63a-6097edf54392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:03.998024 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374ffc1-9dfe-48d3-a63a-6097edf54392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:04.001206 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374ffc1-9dfe-48d3-a63a-6097edf54392 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:04.028679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 823/1643] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:04.037087 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a9bc8-0596-47d6-a0f2-b2bc890c274d service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:04.055184 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a9bc8-0596-47d6-a0f2-b2bc890c274d service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:04.072221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc3cd2-a663-4953-87e8-527e206efe6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:04.072590 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc3cd2-a663-4953-87e8-527e206efe6a service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:04.072737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc3cd2-a663-4953-87e8-527e206efe6a service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:04.073205 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc3cd2-a663-4953-87e8-527e206efe6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:04.082948 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-fcbc3cd2-a663-4953-87e8-527e206efe6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:04.195648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:04.279684 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc3cd2-a663-4953-87e8-527e206efe6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:04.285600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc3cd2-a663-4953-87e8-527e206efe6a service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:04.317698 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 821/1644] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:04.360253 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015760f-aa35-44ee-b4f1-0772f1a44d54 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:04.361871 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015760f-aa35-44ee-b4f1-0772f1a44d54 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:04.362962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015760f-aa35-44ee-b4f1-0772f1a44d54 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:04.368868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 824/1645] 10.222.0.23 () {54 vars in 962 bytes} [Mon Sep 12 23:53:04 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:53:04.386489 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519a939-a3c3-444d-9009-f6fb51003e0b None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:04.387122 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519a939-a3c3-444d-9009-f6fb51003e0b None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:04.387654 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519a939-a3c3-444d-9009-f6fb51003e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:04.516354 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-c519a939-a3c3-444d-9009-f6fb51003e0b None None] MFA Rules not processed for user `4a87e18c89ff419f8e428e376d33462c`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:04.518272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c519a939-a3c3-444d-9009-f6fb51003e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:04.539742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015760f-aa35-44ee-b4f1-0772f1a44d54 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:04.542785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5015760f-aa35-44ee-b4f1-0772f1a44d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:04.578407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015760f-aa35-44ee-b4f1-0772f1a44d54 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:04.585668 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f20437-1d23-4ce2-999f-21667736bcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:04.586410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f20437-1d23-4ce2-999f-21667736bcd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:04.586679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f20437-1d23-4ce2-999f-21667736bcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:04.586947 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f20437-1d23-4ce2-999f-21667736bcd8 admin admin] PATH_INFO: `/v3/users/79dd7e7ebf59445598803aed347c87dd` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:04.594476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f20437-1d23-4ce2-999f-21667736bcd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79dd7e7ebf59445598803aed347c87dd)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:04.596844 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f20437-1d23-4ce2-999f-21667736bcd8 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:04.712804 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 822/1646] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Sep 12 23:53:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:04.722323 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-61f20437-1d23-4ce2-999f-21667736bcd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79dd7e7ebf59445598803aed347c87dd'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:04.723009 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f9670-c918-4a68-be3d-aabfca04c586 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:04.723434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f9670-c918-4a68-be3d-aabfca04c586 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:04.723715 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f9670-c918-4a68-be3d-aabfca04c586 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:04.726519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 823/1647] 10.222.0.23 () {54 vars in 912 bytes} [Mon Sep 12 23:53:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:53:04.732204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174b854-a77e-4f78-92a9-ea439edd68ab None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:04.732786 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174b854-a77e-4f78-92a9-ea439edd68ab None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:04.733121 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174b854-a77e-4f78-92a9-ea439edd68ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:04.738685 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-61f20437-1d23-4ce2-999f-21667736bcd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79dd7e7ebf59445598803aed347c87dd'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:04.754792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-61f20437-1d23-4ce2-999f-21667736bcd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79dd7e7ebf59445598803aed347c87dd'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:04.767253 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-61f20437-1d23-4ce2-999f-21667736bcd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79dd7e7ebf59445598803aed347c87dd'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:04.768592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-61f20437-1d23-4ce2-999f-21667736bcd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79dd7e7ebf59445598803aed347c87dd'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:04.777614 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-c174b854-a77e-4f78-92a9-ea439edd68ab None None] MFA Rules not processed for user `4a87e18c89ff419f8e428e376d33462c`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:04.778884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c174b854-a77e-4f78-92a9-ea439edd68ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:04.785277 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 825/1648] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:04 2022] DELETE /identity/v3/users/79dd7e7ebf59445598803aed347c87dd => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:04.791736 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724600be-3d8d-486f-9210-2dfc8b08c023 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:04.792192 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724600be-3d8d-486f-9210-2dfc8b08c023 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:04.794941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724600be-3d8d-486f-9210-2dfc8b08c023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:04.824161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-724600be-3d8d-486f-9210-2dfc8b08c023 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:04.826399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-724600be-3d8d-486f-9210-2dfc8b08c023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:04.967516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 824/1649] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 23:53:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:53:04.970504 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174b854-a77e-4f78-92a9-ea439edd68ab None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:04.972548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c174b854-a77e-4f78-92a9-ea439edd68ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:05.017782 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 826/1650] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:05.019101 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724600be-3d8d-486f-9210-2dfc8b08c023 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:05.029451 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-724600be-3d8d-486f-9210-2dfc8b08c023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:05.079089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:05.083655 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:05.139876 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174b854-a77e-4f78-92a9-ea439edd68ab None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:05.149872 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ba0b9-247b-48a6-8872-1882b0f45d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:05.150570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ba0b9-247b-48a6-8872-1882b0f45d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:05.151109 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ba0b9-247b-48a6-8872-1882b0f45d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:05.151397 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ba0b9-247b-48a6-8872-1882b0f45d17 admin admin] PATH_INFO: `/v3/projects/5593113ae7974e1697c20edb07eaa227` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:05.153335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ba0b9-247b-48a6-8872-1882b0f45d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5593113ae7974e1697c20edb07eaa227)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:05.156589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ba0b9-247b-48a6-8872-1882b0f45d17 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:05.199383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724600be-3d8d-486f-9210-2dfc8b08c023 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:05.237170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0143de9-3908-45c8-8386-1423c313914e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:05.238570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143de9-3908-45c8-8386-1423c313914e service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:05.238570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143de9-3908-45c8-8386-1423c313914e service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:05.238570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143de9-3908-45c8-8386-1423c313914e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:05.263371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0143de9-3908-45c8-8386-1423c313914e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:05.265237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0143de9-3908-45c8-8386-1423c313914e service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:05.293037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 827/1651] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:05.294743 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0143de9-3908-45c8-8386-1423c313914e service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:05.306476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a0143de9-3908-45c8-8386-1423c313914e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:05.456162 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-659ba0b9-247b-48a6-8872-1882b0f45d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5593113ae7974e1697c20edb07eaa227', 'request_id': 'req-659ba0b9-247b-48a6-8872-1882b0f45d17'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:05.479838 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-659ba0b9-247b-48a6-8872-1882b0f45d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5593113ae7974e1697c20edb07eaa227', 'request_id': 'req-659ba0b9-247b-48a6-8872-1882b0f45d17'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:05.503337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0143de9-3908-45c8-8386-1423c313914e service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:05.507556 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-659ba0b9-247b-48a6-8872-1882b0f45d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5593113ae7974e1697c20edb07eaa227', 'request_id': 'req-659ba0b9-247b-48a6-8872-1882b0f45d17'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:05.544554 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-659ba0b9-247b-48a6-8872-1882b0f45d17 admin admin] The token cache is being invalidate because project 5593113ae7974e1697c20edb07eaa227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:05.546675 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-659ba0b9-247b-48a6-8872-1882b0f45d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:05.549102 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-659ba0b9-247b-48a6-8872-1882b0f45d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:05.554491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 825/1652] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:04 2022] DELETE /identity/v3/projects/5593113ae7974e1697c20edb07eaa227 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:05.563620 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ba0b9-247b-48a6-8872-1882b0f45d17 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:05.567099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-659ba0b9-247b-48a6-8872-1882b0f45d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:05.744665 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b6671-5829-4284-97eb-ae68ef5c8a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:05.745830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b6671-5829-4284-97eb-ae68ef5c8a38 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:05.746278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b6671-5829-4284-97eb-ae68ef5c8a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:05.746740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b6671-5829-4284-97eb-ae68ef5c8a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:05.759358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4d9b6671-5829-4284-97eb-ae68ef5c8a38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:05.943188 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ba0b9-247b-48a6-8872-1882b0f45d17 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:05.953961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb5375-8fac-461d-bfed-17f8b1252f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:05.955043 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb5375-8fac-461d-bfed-17f8b1252f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:05.955495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb5375-8fac-461d-bfed-17f8b1252f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:05.956158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb5375-8fac-461d-bfed-17f8b1252f61 admin admin] PATH_INFO: `/v3/users/5e95970b0a4b40f0a6bf87c6bdf12c8c` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:05.960024 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb5375-8fac-461d-bfed-17f8b1252f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e95970b0a4b40f0a6bf87c6bdf12c8c)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:05.962190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: WARNING py.warnings [None req-12eb5375-8fac-461d-bfed-17f8b1252f61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:53:05.962190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: warnings.warn(msg) Sep 12 23:53:05.962190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: Sep 12 23:53:05.964680 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb5375-8fac-461d-bfed-17f8b1252f61 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:06.219320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b6671-5829-4284-97eb-ae68ef5c8a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:06.222108 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b6671-5829-4284-97eb-ae68ef5c8a38 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:06.308597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 828/1653] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1011 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:06.369224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-12eb5375-8fac-461d-bfed-17f8b1252f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e95970b0a4b40f0a6bf87c6bdf12c8c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:06.372164 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-12eb5375-8fac-461d-bfed-17f8b1252f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e95970b0a4b40f0a6bf87c6bdf12c8c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:06.373822 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-12eb5375-8fac-461d-bfed-17f8b1252f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e95970b0a4b40f0a6bf87c6bdf12c8c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:06.519651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-12eb5375-8fac-461d-bfed-17f8b1252f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e95970b0a4b40f0a6bf87c6bdf12c8c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:06.562685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:06.568075 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-12eb5375-8fac-461d-bfed-17f8b1252f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e95970b0a4b40f0a6bf87c6bdf12c8c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:06.618723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 826/1654] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:05 2022] DELETE /identity/v3/users/5e95970b0a4b40f0a6bf87c6bdf12c8c => generated 0 bytes in 1050 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:53:08.478763 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b6671-5829-4284-97eb-ae68ef5c8a38 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:08.481500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4d9b6671-5829-4284-97eb-ae68ef5c8a38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:08.544792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b6671-5829-4284-97eb-ae68ef5c8a38 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:08.731987 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:08.871132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152c948-e15c-45f8-b317-f255d4b366f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:08.873021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152c948-e15c-45f8-b317-f255d4b366f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:08.876659 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152c948-e15c-45f8-b317-f255d4b366f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:08.877224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152c948-e15c-45f8-b317-f255d4b366f9 admin admin] PATH_INFO: `/v3/projects/5d541ffdd04b4f9f890eca3e9d468cb1` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:08.879274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152c948-e15c-45f8-b317-f255d4b366f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d541ffdd04b4f9f890eca3e9d468cb1)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:08.881806 dv-cinder-820027-26-smb devstack@keystone.service[87847]: WARNING py.warnings [None req-a152c948-e15c-45f8-b317-f255d4b366f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 12 23:53:08.881806 dv-cinder-820027-26-smb devstack@keystone.service[87847]: warnings.warn(msg) Sep 12 23:53:08.881806 dv-cinder-820027-26-smb devstack@keystone.service[87847]: Sep 12 23:53:08.888767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152c948-e15c-45f8-b317-f255d4b366f9 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:09.047475 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb5375-8fac-461d-bfed-17f8b1252f61 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:09.050919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-12eb5375-8fac-461d-bfed-17f8b1252f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:09.094945 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb5375-8fac-461d-bfed-17f8b1252f61 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:09.117568 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a152c948-e15c-45f8-b317-f255d4b366f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d541ffdd04b4f9f890eca3e9d468cb1', 'request_id': 'req-a152c948-e15c-45f8-b317-f255d4b366f9'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:09.145192 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a152c948-e15c-45f8-b317-f255d4b366f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d541ffdd04b4f9f890eca3e9d468cb1', 'request_id': 'req-a152c948-e15c-45f8-b317-f255d4b366f9'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:09.159642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a152c948-e15c-45f8-b317-f255d4b366f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d541ffdd04b4f9f890eca3e9d468cb1', 'request_id': 'req-a152c948-e15c-45f8-b317-f255d4b366f9'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:09.262541 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a152c948-e15c-45f8-b317-f255d4b366f9 admin admin] The token cache is being invalidate because project 5d541ffdd04b4f9f890eca3e9d468cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:09.262837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a152c948-e15c-45f8-b317-f255d4b366f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:09.263583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a152c948-e15c-45f8-b317-f255d4b366f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:09.269399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 829/1655] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:08 2022] DELETE /identity/v3/projects/5d541ffdd04b4f9f890eca3e9d468cb1 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:53:09.270986 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152c948-e15c-45f8-b317-f255d4b366f9 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:09.272853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a152c948-e15c-45f8-b317-f255d4b366f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:09.395141 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac45bb5-15b1-4b6f-b1e4-f59e31eac8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:09.396726 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac45bb5-15b1-4b6f-b1e4-f59e31eac8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:09.397490 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac45bb5-15b1-4b6f-b1e4-f59e31eac8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:09.398172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac45bb5-15b1-4b6f-b1e4-f59e31eac8fc admin admin] PATH_INFO: `/v3/projects/8f86f9158d6041928708f64e10722adb` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:09.416978 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac45bb5-15b1-4b6f-b1e4-f59e31eac8fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f86f9158d6041928708f64e10722adb)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:09.422228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac45bb5-15b1-4b6f-b1e4-f59e31eac8fc admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:09.530536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152c948-e15c-45f8-b317-f255d4b366f9 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:09.542376 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6680d9-b3f9-4d1e-97c1-531f42b92c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:09.544808 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6680d9-b3f9-4d1e-97c1-531f42b92c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:09.554866 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6680d9-b3f9-4d1e-97c1-531f42b92c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:09.555488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6680d9-b3f9-4d1e-97c1-531f42b92c03 admin admin] PATH_INFO: `/v3/users/dcbf0ef3dead4ffc8aefa4dcdb453a98` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:09.559416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6680d9-b3f9-4d1e-97c1-531f42b92c03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcbf0ef3dead4ffc8aefa4dcdb453a98)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:09.562764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6680d9-b3f9-4d1e-97c1-531f42b92c03 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:09.627023 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2ac45bb5-15b1-4b6f-b1e4-f59e31eac8fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f86f9158d6041928708f64e10722adb', 'request_id': 'req-2ac45bb5-15b1-4b6f-b1e4-f59e31eac8fc'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:09.651685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2ac45bb5-15b1-4b6f-b1e4-f59e31eac8fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f86f9158d6041928708f64e10722adb', 'request_id': 'req-2ac45bb5-15b1-4b6f-b1e4-f59e31eac8fc'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:09.679377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2ac45bb5-15b1-4b6f-b1e4-f59e31eac8fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f86f9158d6041928708f64e10722adb', 'request_id': 'req-2ac45bb5-15b1-4b6f-b1e4-f59e31eac8fc'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:09.730660 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2ac45bb5-15b1-4b6f-b1e4-f59e31eac8fc admin admin] The token cache is being invalidate because project 8f86f9158d6041928708f64e10722adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:09.731129 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2ac45bb5-15b1-4b6f-b1e4-f59e31eac8fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:09.745120 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2ac45bb5-15b1-4b6f-b1e4-f59e31eac8fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:09.751653 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 827/1656] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:09 2022] DELETE /identity/v3/projects/8f86f9158d6041928708f64e10722adb => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:09.753944 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a349e2-9ed6-4f94-96dc-af5d103eff52 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:09.754402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a349e2-9ed6-4f94-96dc-af5d103eff52 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:09.754860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a349e2-9ed6-4f94-96dc-af5d103eff52 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:09.771953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 828/1657] 10.222.0.23 () {54 vars in 962 bytes} [Mon Sep 12 23:53:09 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:53:09.774415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27133271-6cc4-41b3-aa75-6e8f2118e60b None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:09.774695 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27133271-6cc4-41b3-aa75-6e8f2118e60b None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:09.775153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27133271-6cc4-41b3-aa75-6e8f2118e60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:09.779316 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-aa6680d9-b3f9-4d1e-97c1-531f42b92c03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcbf0ef3dead4ffc8aefa4dcdb453a98'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:09.811131 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-aa6680d9-b3f9-4d1e-97c1-531f42b92c03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcbf0ef3dead4ffc8aefa4dcdb453a98'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:09.846558 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:09.862847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-27133271-6cc4-41b3-aa75-6e8f2118e60b None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:09.865175 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-27133271-6cc4-41b3-aa75-6e8f2118e60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:09.872452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-aa6680d9-b3f9-4d1e-97c1-531f42b92c03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcbf0ef3dead4ffc8aefa4dcdb453a98'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:09.902536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-aa6680d9-b3f9-4d1e-97c1-531f42b92c03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcbf0ef3dead4ffc8aefa4dcdb453a98'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:09.903772 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-aa6680d9-b3f9-4d1e-97c1-531f42b92c03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcbf0ef3dead4ffc8aefa4dcdb453a98'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:09.934530 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 830/1658] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:09 2022] DELETE /identity/v3/users/dcbf0ef3dead4ffc8aefa4dcdb453a98 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:09.941861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e568bf-ab44-433c-948a-4ba1cc8f6f38 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:09.943343 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e568bf-ab44-433c-948a-4ba1cc8f6f38 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:09.943343 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e568bf-ab44-433c-948a-4ba1cc8f6f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:10.045102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-63e568bf-ab44-433c-948a-4ba1cc8f6f38 None None] MFA Rules not processed for user `4a87e18c89ff419f8e428e376d33462c`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:10.047151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-63e568bf-ab44-433c-948a-4ba1cc8f6f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:10.236899 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 829/1659] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:10.255556 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b84ba-609d-478c-936b-2a81fb495024 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:10.257303 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b84ba-609d-478c-936b-2a81fb495024 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:10.258203 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b84ba-609d-478c-936b-2a81fb495024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:10.354747 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-866b84ba-609d-478c-936b-2a81fb495024 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:10.357782 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-866b84ba-609d-478c-936b-2a81fb495024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:10.458561 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:10.565907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 831/1660] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Sep 12 23:53:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 630 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:10.578197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c7410-2786-47df-94da-ed07703b0ca7 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:10.578461 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c7410-2786-47df-94da-ed07703b0ca7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:10.578817 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c7410-2786-47df-94da-ed07703b0ca7 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:10.584621 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 832/1661] 10.222.0.23 () {54 vars in 912 bytes} [Mon Sep 12 23:53:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 12 23:53:10.597470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4356add-45dc-4ab7-8109-af3ff991b4f0 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:10.597978 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4356add-45dc-4ab7-8109-af3ff991b4f0 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:10.598473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4356add-45dc-4ab7-8109-af3ff991b4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:10.684951 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-a4356add-45dc-4ab7-8109-af3ff991b4f0 None None] MFA Rules not processed for user `4a87e18c89ff419f8e428e376d33462c`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:10.687208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a4356add-45dc-4ab7-8109-af3ff991b4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:10.760380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 833/1662] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 23:53:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:53:10.762701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 830/1663] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:53:10.763666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4356add-45dc-4ab7-8109-af3ff991b4f0 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:10.768433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b84ba-609d-478c-936b-2a81fb495024 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:10.775071 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-866b84ba-609d-478c-936b-2a81fb495024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:10.811239 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4356add-45dc-4ab7-8109-af3ff991b4f0 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:10.856374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157018c2-7380-4b7e-b6f9-2b3a4c39a03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:10.858117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157018c2-7380-4b7e-b6f9-2b3a4c39a03b admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:10.862925 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157018c2-7380-4b7e-b6f9-2b3a4c39a03b admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:10.863606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157018c2-7380-4b7e-b6f9-2b3a4c39a03b admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:10.868663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157018c2-7380-4b7e-b6f9-2b3a4c39a03b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:53:10.871925 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157018c2-7380-4b7e-b6f9-2b3a4c39a03b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:10.880607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157018c2-7380-4b7e-b6f9-2b3a4c39a03b admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:10.926551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 834/1664] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:53:10.933177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157018c2-7380-4b7e-b6f9-2b3a4c39a03b admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:10.979805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157018c2-7380-4b7e-b6f9-2b3a4c39a03b admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:11.000193 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dde3d-afbf-470e-bf37-1d0ed03f95d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:11.004319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dde3d-afbf-470e-bf37-1d0ed03f95d6 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:11.004650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dde3d-afbf-470e-bf37-1d0ed03f95d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:11.007386 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dde3d-afbf-470e-bf37-1d0ed03f95d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:11.008222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3dde3d-afbf-470e-bf37-1d0ed03f95d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:11.020187 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3dde3d-afbf-470e-bf37-1d0ed03f95d6 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:11.053067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b84ba-609d-478c-936b-2a81fb495024 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:11.067120 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9fbfb-df4e-461d-9c45-ce5ce5c18698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:11.067697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9fbfb-df4e-461d-9c45-ce5ce5c18698 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:11.067981 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9fbfb-df4e-461d-9c45-ce5ce5c18698 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:11.068254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9fbfb-df4e-461d-9c45-ce5ce5c18698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:11.114248 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9fbfb-df4e-461d-9c45-ce5ce5c18698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:11.116761 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9fbfb-df4e-461d-9c45-ce5ce5c18698 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:11.133014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 835/1665] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:10 2022] POST /identity/v3/projects => generated 379 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:11.142327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dde3d-afbf-470e-bf37-1d0ed03f95d6 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:11.181593 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 831/1666] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:11.355381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dde3d-afbf-470e-bf37-1d0ed03f95d6 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:11.372106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab14044-c818-486e-84e7-9a5530c98800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:11.372777 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab14044-c818-486e-84e7-9a5530c98800 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:11.373060 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab14044-c818-486e-84e7-9a5530c98800 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:11.373319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab14044-c818-486e-84e7-9a5530c98800 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:11.374038 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab14044-c818-486e-84e7-9a5530c98800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:11.376240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab14044-c818-486e-84e7-9a5530c98800 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:11.439908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 836/1667] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:11 2022] POST /identity/v3/users => generated 290 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:11.446717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9fbfb-df4e-461d-9c45-ce5ce5c18698 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:11.466378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9fbfb-df4e-461d-9c45-ce5ce5c18698 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:11.476745 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ed477-835a-4213-a54b-3e93e81546c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:11.477687 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ed477-835a-4213-a54b-3e93e81546c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:11.478137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ed477-835a-4213-a54b-3e93e81546c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:11.478448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ed477-835a-4213-a54b-3e93e81546c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:11.479025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ed477-835a-4213-a54b-3e93e81546c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:11.483955 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ed477-835a-4213-a54b-3e93e81546c3 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:11.508786 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 832/1668] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:11.514535 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab14044-c818-486e-84e7-9a5530c98800 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:11.530041 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab14044-c818-486e-84e7-9a5530c98800 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:11.541676 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a1e33-a9d0-4d41-a29f-1f32f649e37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:11.543818 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1e33-a9d0-4d41-a29f-1f32f649e37d admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:11.545947 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1e33-a9d0-4d41-a29f-1f32f649e37d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:11.546628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a1e33-a9d0-4d41-a29f-1f32f649e37d admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:11.551353 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a1e33-a9d0-4d41-a29f-1f32f649e37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:11.555128 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a1e33-a9d0-4d41-a29f-1f32f649e37d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:11.637019 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 837/1669] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:11.641125 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ed477-835a-4213-a54b-3e93e81546c3 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:11.666988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ed477-835a-4213-a54b-3e93e81546c3 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:11.689503 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d157f-f89f-4c5a-a6a9-02ff2e37d68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:11.690232 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d157f-f89f-4c5a-a6a9-02ff2e37d68f admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:11.690519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d157f-f89f-4c5a-a6a9-02ff2e37d68f admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:11.690796 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d157f-f89f-4c5a-a6a9-02ff2e37d68f admin admin] PATH_INFO: `/v3/projects/d66d874429604a40aa2ab2c76d29d54d/users/0bf237aac73648e297e1d56a0d6eace6/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:11.748058 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d157f-f89f-4c5a-a6a9-02ff2e37d68f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66d874429604a40aa2ab2c76d29d54d, user_id=0bf237aac73648e297e1d56a0d6eace6, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:11.755311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d157f-f89f-4c5a-a6a9-02ff2e37d68f admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:11.786241 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 833/1670] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:11 2022] PUT /identity/v3/projects/d66d874429604a40aa2ab2c76d29d54d/users/0bf237aac73648e297e1d56a0d6eace6/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:11.804864 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b9401-196d-4c24-81a2-cea75baaf4d7 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:11.805637 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b9401-196d-4c24-81a2-cea75baaf4d7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:11.806208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b9401-196d-4c24-81a2-cea75baaf4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:11.924019 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:11.979608 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-7f7b9401-196d-4c24-81a2-cea75baaf4d7 None None] MFA Rules not processed for user `0bf237aac73648e297e1d56a0d6eace6`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:11.994391 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-7f7b9401-196d-4c24-81a2-cea75baaf4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:12.235329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 838/1671] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:12.245388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d157f-f89f-4c5a-a6a9-02ff2e37d68f admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:12.476385 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d157f-f89f-4c5a-a6a9-02ff2e37d68f admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:12.484651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158cc19-2921-4f51-b2e8-703ac5fe9204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:12.486483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158cc19-2921-4f51-b2e8-703ac5fe9204 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:12.487167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158cc19-2921-4f51-b2e8-703ac5fe9204 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:12.488907 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158cc19-2921-4f51-b2e8-703ac5fe9204 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:12.490103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158cc19-2921-4f51-b2e8-703ac5fe9204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:12.492711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158cc19-2921-4f51-b2e8-703ac5fe9204 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:12.555775 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 834/1672] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:12 2022] POST /identity/v3/projects => generated 379 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:12.560492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b9401-196d-4c24-81a2-cea75baaf4d7 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:12.583798 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b9401-196d-4c24-81a2-cea75baaf4d7 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:12.875692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df658bfc-b8da-4519-a6a1-6e4fab12e285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:12.877972 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df658bfc-b8da-4519-a6a1-6e4fab12e285 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:12.878684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df658bfc-b8da-4519-a6a1-6e4fab12e285 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:12.879377 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df658bfc-b8da-4519-a6a1-6e4fab12e285 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:12.892790 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df658bfc-b8da-4519-a6a1-6e4fab12e285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:12.897842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df658bfc-b8da-4519-a6a1-6e4fab12e285 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:12.945425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158cc19-2921-4f51-b2e8-703ac5fe9204 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:12.949492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-2158cc19-2921-4f51-b2e8-703ac5fe9204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:12.951424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 839/1673] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:12 2022] POST /identity/v3/users => generated 296 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:12.953254 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df658bfc-b8da-4519-a6a1-6e4fab12e285 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:12.974058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df658bfc-b8da-4519-a6a1-6e4fab12e285 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:12.980465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158cc19-2921-4f51-b2e8-703ac5fe9204 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:12.992992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74efeb-1b4e-4c9a-842c-b1ed458dc94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:12.994012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74efeb-1b4e-4c9a-842c-b1ed458dc94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:12.994176 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41e793-c474-4c90-b7e5-98de6b8ade57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:12.994340 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74efeb-1b4e-4c9a-842c-b1ed458dc94f admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:12.994648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74efeb-1b4e-4c9a-842c-b1ed458dc94f admin admin] PATH_INFO: `/v3/projects/129abb7974aa41d6a6d71048ebdae43a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:12.996440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41e793-c474-4c90-b7e5-98de6b8ade57 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:12.996440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41e793-c474-4c90-b7e5-98de6b8ade57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:12.996733 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74efeb-1b4e-4c9a-842c-b1ed458dc94f admin admin] RBAC: Authorizing `identity:delete_project(project_id=129abb7974aa41d6a6d71048ebdae43a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:12.996985 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41e793-c474-4c90-b7e5-98de6b8ade57 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:12.998407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41e793-c474-4c90-b7e5-98de6b8ade57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:12.998799 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74efeb-1b4e-4c9a-842c-b1ed458dc94f admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:13.007162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41e793-c474-4c90-b7e5-98de6b8ade57 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:13.014881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:13.059135 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 840/1674] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:13.063259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41e793-c474-4c90-b7e5-98de6b8ade57 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:13.106252 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41e793-c474-4c90-b7e5-98de6b8ade57 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:13.106902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-7d74efeb-1b4e-4c9a-842c-b1ed458dc94f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '129abb7974aa41d6a6d71048ebdae43a', 'request_id': 'req-7d74efeb-1b4e-4c9a-842c-b1ed458dc94f'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:13.127981 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-7d74efeb-1b4e-4c9a-842c-b1ed458dc94f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '129abb7974aa41d6a6d71048ebdae43a', 'request_id': 'req-7d74efeb-1b4e-4c9a-842c-b1ed458dc94f'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:13.154421 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-7d74efeb-1b4e-4c9a-842c-b1ed458dc94f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '129abb7974aa41d6a6d71048ebdae43a', 'request_id': 'req-7d74efeb-1b4e-4c9a-842c-b1ed458dc94f'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:13.190144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-7d74efeb-1b4e-4c9a-842c-b1ed458dc94f admin admin] The token cache is being invalidate because project 129abb7974aa41d6a6d71048ebdae43a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:13.190457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-7d74efeb-1b4e-4c9a-842c-b1ed458dc94f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:13.191324 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-7d74efeb-1b4e-4c9a-842c-b1ed458dc94f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:13.197597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 835/1675] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:12 2022] DELETE /identity/v3/projects/129abb7974aa41d6a6d71048ebdae43a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:13.204758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282c9c0-d896-4e16-a506-f42d79ceb912 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:13.205063 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282c9c0-d896-4e16-a506-f42d79ceb912 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:13.205557 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282c9c0-d896-4e16-a506-f42d79ceb912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:13.253234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-4282c9c0-d896-4e16-a506-f42d79ceb912 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:13.260944 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4282c9c0-d896-4e16-a506-f42d79ceb912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:13.331005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4d0b9-a3d2-450e-8e08-2817be4fcd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:13.333925 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4d0b9-a3d2-450e-8e08-2817be4fcd9a admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:13.336096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4d0b9-a3d2-450e-8e08-2817be4fcd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:13.337065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4d0b9-a3d2-450e-8e08-2817be4fcd9a admin admin] PATH_INFO: `/v3/projects/c3e12c033f2942c8b4d3af6c10841d30/users/22f1ce3fea694b049cf2cd3526fb684c/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:13.407440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4d0b9-a3d2-450e-8e08-2817be4fcd9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e12c033f2942c8b4d3af6c10841d30, user_id=22f1ce3fea694b049cf2cd3526fb684c, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:13.416820 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4d0b9-a3d2-450e-8e08-2817be4fcd9a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:13.473944 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 841/1676] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:13 2022] PUT /identity/v3/projects/c3e12c033f2942c8b4d3af6c10841d30/users/22f1ce3fea694b049cf2cd3526fb684c/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:13.486996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4d0b9-a3d2-450e-8e08-2817be4fcd9a admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:13.495425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-90f4d0b9-a3d2-450e-8e08-2817be4fcd9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:13.514355 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:13.517843 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 836/1677] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:53:13.527819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fc800-ebe4-405a-9da1-3ca17903a16d None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:13.527819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fc800-ebe4-405a-9da1-3ca17903a16d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:13.538855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fc800-ebe4-405a-9da1-3ca17903a16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:13.634256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-9e4fc800-ebe4-405a-9da1-3ca17903a16d None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:13.644760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9e4fc800-ebe4-405a-9da1-3ca17903a16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:13.739294 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4d0b9-a3d2-450e-8e08-2817be4fcd9a admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:13.754570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007db2e-0773-4d81-9b0d-5588226fe583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:13.755228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007db2e-0773-4d81-9b0d-5588226fe583 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:13.755514 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007db2e-0773-4d81-9b0d-5588226fe583 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:13.755781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007db2e-0773-4d81-9b0d-5588226fe583 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:13.756475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007db2e-0773-4d81-9b0d-5588226fe583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:13.761594 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007db2e-0773-4d81-9b0d-5588226fe583 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:13.778437 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 842/1678] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:13.780057 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007db2e-0773-4d81-9b0d-5588226fe583 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:13.791870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007db2e-0773-4d81-9b0d-5588226fe583 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:13.798603 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c212966-520b-4eb8-82e2-620ff0e3d90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:13.799720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c212966-520b-4eb8-82e2-620ff0e3d90f admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:13.799720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c212966-520b-4eb8-82e2-620ff0e3d90f admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:13.799879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c212966-520b-4eb8-82e2-620ff0e3d90f admin admin] PATH_INFO: `/v3/projects/c3e12c033f2942c8b4d3af6c10841d30/users/22f1ce3fea694b049cf2cd3526fb684c/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:13.803114 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c212966-520b-4eb8-82e2-620ff0e3d90f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e12c033f2942c8b4d3af6c10841d30, user_id=22f1ce3fea694b049cf2cd3526fb684c, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:13.806943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c212966-520b-4eb8-82e2-620ff0e3d90f admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:13.844793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 843/1679] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:13 2022] PUT /identity/v3/projects/c3e12c033f2942c8b4d3af6c10841d30/users/22f1ce3fea694b049cf2cd3526fb684c/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:13.851313 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa9366-b1a8-404c-8e62-af308ce10317 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:13.851772 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa9366-b1a8-404c-8e62-af308ce10317 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:13.852180 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa9366-b1a8-404c-8e62-af308ce10317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:13.925764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-ebfa9366-b1a8-404c-8e62-af308ce10317 None None] MFA Rules not processed for user `22f1ce3fea694b049cf2cd3526fb684c`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:13.930452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ebfa9366-b1a8-404c-8e62-af308ce10317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:13.976920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 837/1680] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:13.983409 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fc800-ebe4-405a-9da1-3ca17903a16d None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:14.037318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fc800-ebe4-405a-9da1-3ca17903a16d None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:14.141662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 844/1681] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:14.151940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa9366-b1a8-404c-8e62-af308ce10317 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:14.153539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ebfa9366-b1a8-404c-8e62-af308ce10317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:14.237746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:14.308241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa9366-b1a8-404c-8e62-af308ce10317 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:14.320084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddc8cc-02d8-4f47-b596-628aa7604b95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:14.320847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddc8cc-02d8-4f47-b596-628aa7604b95 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:14.321126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddc8cc-02d8-4f47-b596-628aa7604b95 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:14.322419 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddc8cc-02d8-4f47-b596-628aa7604b95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:14.329509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2cddc8cc-02d8-4f47-b596-628aa7604b95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:14.342995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe818-6fb2-4cd8-aef9-427539bc80c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:14.343953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe818-6fb2-4cd8-aef9-427539bc80c1 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:14.348802 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe818-6fb2-4cd8-aef9-427539bc80c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:14.349268 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe818-6fb2-4cd8-aef9-427539bc80c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:14.351850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afe818-6fb2-4cd8-aef9-427539bc80c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:53:14.353586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afe818-6fb2-4cd8-aef9-427539bc80c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:14.362755 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afe818-6fb2-4cd8-aef9-427539bc80c1 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:14.398098 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:14.452559 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 838/1682] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:53:14.459871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe818-6fb2-4cd8-aef9-427539bc80c1 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:14.497319 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe818-6fb2-4cd8-aef9-427539bc80c1 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:14.511577 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319eedae-ee63-4738-b22f-6a65ce70df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:14.513288 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eedae-ee63-4738-b22f-6a65ce70df16 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:14.513778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eedae-ee63-4738-b22f-6a65ce70df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:14.514203 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eedae-ee63-4738-b22f-6a65ce70df16 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:14.515375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319eedae-ee63-4738-b22f-6a65ce70df16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:14.519887 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319eedae-ee63-4738-b22f-6a65ce70df16 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:14.522536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cddc8cc-02d8-4f47-b596-628aa7604b95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:14.529458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cddc8cc-02d8-4f47-b596-628aa7604b95 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:14.609495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 845/1683] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:53:14.694765 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 839/1684] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:14 2022] POST /identity/v3/projects => generated 367 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:14.700396 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddc8cc-02d8-4f47-b596-628aa7604b95 service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:14.759908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddc8cc-02d8-4f47-b596-628aa7604b95 service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:15.051368 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cf7d4-57c3-4958-aa94-9af05a8804bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:15.053026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cf7d4-57c3-4958-aa94-9af05a8804bc admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:15.053520 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cf7d4-57c3-4958-aa94-9af05a8804bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:15.053971 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cf7d4-57c3-4958-aa94-9af05a8804bc admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:15.055140 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9cf7d4-57c3-4958-aa94-9af05a8804bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:15.066797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9cf7d4-57c3-4958-aa94-9af05a8804bc admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:15.210243 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 846/1685] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:14 2022] POST /identity/v3/users => generated 284 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:15.216519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319eedae-ee63-4738-b22f-6a65ce70df16 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:15.277628 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319eedae-ee63-4738-b22f-6a65ce70df16 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:15.318377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521df13-0758-47db-988a-8d085e34e7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:15.327033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521df13-0758-47db-988a-8d085e34e7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:15.327726 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521df13-0758-47db-988a-8d085e34e7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:15.328224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521df13-0758-47db-988a-8d085e34e7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:15.329720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521df13-0758-47db-988a-8d085e34e7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:15.333064 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521df13-0758-47db-988a-8d085e34e7b3 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:15.407932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cf7d4-57c3-4958-aa94-9af05a8804bc admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:15.410023 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 840/1686] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:15.453860 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cf7d4-57c3-4958-aa94-9af05a8804bc admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:15.489148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa925aa1-562b-4c31-b35e-a7dbb91a1808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:15.490350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa925aa1-562b-4c31-b35e-a7dbb91a1808 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:15.490870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa925aa1-562b-4c31-b35e-a7dbb91a1808 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:15.491379 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa925aa1-562b-4c31-b35e-a7dbb91a1808 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:15.492604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa925aa1-562b-4c31-b35e-a7dbb91a1808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:15.496132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa925aa1-562b-4c31-b35e-a7dbb91a1808 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:15.516625 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 847/1687] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:53:15.524635 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521df13-0758-47db-988a-8d085e34e7b3 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:15.574728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521df13-0758-47db-988a-8d085e34e7b3 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:15.614844 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6431b0-fb10-4e1b-a054-29ca24f03e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:15.615959 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6431b0-fb10-4e1b-a054-29ca24f03e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:15.616426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6431b0-fb10-4e1b-a054-29ca24f03e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:15.616949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6431b0-fb10-4e1b-a054-29ca24f03e4b admin admin] PATH_INFO: `/v3/projects/5e62c7f9576649bf9335012586764215/users/ab0076e154314dcc86f914bec61ac57e/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:15.681311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6431b0-fb10-4e1b-a054-29ca24f03e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e62c7f9576649bf9335012586764215, user_id=ab0076e154314dcc86f914bec61ac57e, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:15.684120 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6431b0-fb10-4e1b-a054-29ca24f03e4b admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:15.753720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 841/1688] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:15 2022] PUT /identity/v3/projects/5e62c7f9576649bf9335012586764215/users/ab0076e154314dcc86f914bec61ac57e/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:15.776841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3992a-fa38-47e7-81e4-2a5ccf6d829f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:15.777599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3992a-fa38-47e7-81e4-2a5ccf6d829f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:15.778046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3992a-fa38-47e7-81e4-2a5ccf6d829f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:15.948723 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-bdd3992a-fa38-47e7-81e4-2a5ccf6d829f None None] MFA Rules not processed for user `ab0076e154314dcc86f914bec61ac57e`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:15.951090 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-bdd3992a-fa38-47e7-81e4-2a5ccf6d829f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:16.404922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6431b0-fb10-4e1b-a054-29ca24f03e4b admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:16.419090 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 848/1689] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 644 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:16.754321 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6431b0-fb10-4e1b-a054-29ca24f03e4b admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:16.778338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ac7a7-5425-4ea0-bb34-fff42bdf1786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:16.779403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ac7a7-5425-4ea0-bb34-fff42bdf1786 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:16.779954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ac7a7-5425-4ea0-bb34-fff42bdf1786 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:16.780478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ac7a7-5425-4ea0-bb34-fff42bdf1786 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:16.783500 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ac7a7-5425-4ea0-bb34-fff42bdf1786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:16.787270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ac7a7-5425-4ea0-bb34-fff42bdf1786 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:16.911895 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 842/1690] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:16 2022] POST /identity/v3/projects => generated 369 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:16.919766 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3992a-fa38-47e7-81e4-2a5ccf6d829f None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:16.993755 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3992a-fa38-47e7-81e4-2a5ccf6d829f None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:17.203734 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:17.286454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ac7a7-5425-4ea0-bb34-fff42bdf1786 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:17.420766 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab43b7-ecbc-4bbc-b025-9a14b1daa9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:17.423100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab43b7-ecbc-4bbc-b025-9a14b1daa9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:17.425382 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab43b7-ecbc-4bbc-b025-9a14b1daa9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:17.437514 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab43b7-ecbc-4bbc-b025-9a14b1daa9e3 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:17.443514 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab43b7-ecbc-4bbc-b025-9a14b1daa9e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:17.450762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab43b7-ecbc-4bbc-b025-9a14b1daa9e3 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:17.537850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 849/1691] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:16 2022] POST /identity/v3/users => generated 291 bytes in 619 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:17.540101 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab43b7-ecbc-4bbc-b025-9a14b1daa9e3 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:17.565653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab43b7-ecbc-4bbc-b025-9a14b1daa9e3 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:17.591071 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fe0de-d01b-472f-8aa8-9ebf50d06bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:17.596750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fe0de-d01b-472f-8aa8-9ebf50d06bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:17.599134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fe0de-d01b-472f-8aa8-9ebf50d06bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:17.601641 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fe0de-d01b-472f-8aa8-9ebf50d06bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:17.605713 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fe0de-d01b-472f-8aa8-9ebf50d06bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:17.614510 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fe0de-d01b-472f-8aa8-9ebf50d06bd9 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:17.642362 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ac7a7-5425-4ea0-bb34-fff42bdf1786 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:17.660913 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1c2c8-f0a7-475a-a700-c6a52535e63d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:17.662107 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1c2c8-f0a7-475a-a700-c6a52535e63d service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:17.669024 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1c2c8-f0a7-475a-a700-c6a52535e63d service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:17.669564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 850/1692] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:17.671324 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fe0de-d01b-472f-8aa8-9ebf50d06bd9 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:17.672001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1c2c8-f0a7-475a-a700-c6a52535e63d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:17.725528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fe0de-d01b-472f-8aa8-9ebf50d06bd9 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:17.730167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:17.768847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcccd39-6878-4151-9f4c-873154d11828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:17.774798 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcccd39-6878-4151-9f4c-873154d11828 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:17.775940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcccd39-6878-4151-9f4c-873154d11828 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:17.776590 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcccd39-6878-4151-9f4c-873154d11828 admin admin] PATH_INFO: `/v3/projects/344f9105f2af446690f2c658f76f374a/users/323d8824194c48cd927d2b52774088bd/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:17.846219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcccd39-6878-4151-9f4c-873154d11828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=344f9105f2af446690f2c658f76f374a, user_id=323d8824194c48cd927d2b52774088bd, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:17.862662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcccd39-6878-4151-9f4c-873154d11828 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:17.914994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1c2c8-f0a7-475a-a700-c6a52535e63d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:17.916051 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 851/1693] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:17 2022] PUT /identity/v3/projects/344f9105f2af446690f2c658f76f374a/users/323d8824194c48cd927d2b52774088bd/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:17.919836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1c2c8-f0a7-475a-a700-c6a52535e63d service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:17.922957 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcccd39-6878-4151-9f4c-873154d11828 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:17.953187 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 843/1694] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:18.067006 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcccd39-6878-4151-9f4c-873154d11828 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:18.078645 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecf5ea-fb5f-44d5-8423-0d6070002a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:18.079301 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecf5ea-fb5f-44d5-8423-0d6070002a28 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:18.079582 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecf5ea-fb5f-44d5-8423-0d6070002a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:18.079856 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecf5ea-fb5f-44d5-8423-0d6070002a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:18.080544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecf5ea-fb5f-44d5-8423-0d6070002a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:18.082348 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecf5ea-fb5f-44d5-8423-0d6070002a28 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:18.095764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 852/1695] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:53:18.100286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1c2c8-f0a7-475a-a700-c6a52535e63d service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:18.114277 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1c2c8-f0a7-475a-a700-c6a52535e63d service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:18.121497 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fe3e7-7e8b-411b-adbe-51488d25b349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:18.122735 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fe3e7-7e8b-411b-adbe-51488d25b349 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:18.123225 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fe3e7-7e8b-411b-adbe-51488d25b349 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:18.123735 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fe3e7-7e8b-411b-adbe-51488d25b349 admin admin] PATH_INFO: `/v3/projects/344f9105f2af446690f2c658f76f374a/users/323d8824194c48cd927d2b52774088bd/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:18.127043 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fe3e7-7e8b-411b-adbe-51488d25b349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=344f9105f2af446690f2c658f76f374a, user_id=323d8824194c48cd927d2b52774088bd, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:18.134584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fe3e7-7e8b-411b-adbe-51488d25b349 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:18.165388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 844/1696] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:18 2022] PUT /identity/v3/projects/344f9105f2af446690f2c658f76f374a/users/323d8824194c48cd927d2b52774088bd/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:53:18.176686 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166d252-7844-4eb9-bde2-5299fbc62525 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:18.177251 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166d252-7844-4eb9-bde2-5299fbc62525 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:18.177757 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166d252-7844-4eb9-bde2-5299fbc62525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:18.227922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-3166d252-7844-4eb9-bde2-5299fbc62525 None None] MFA Rules not processed for user `323d8824194c48cd927d2b52774088bd`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:18.232279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3166d252-7844-4eb9-bde2-5299fbc62525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:18.628851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 853/1697] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:18.779739 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fe3e7-7e8b-411b-adbe-51488d25b349 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:18.783138 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9a9fe3e7-7e8b-411b-adbe-51488d25b349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:19.124955 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fe3e7-7e8b-411b-adbe-51488d25b349 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:19.160193 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93e63d-0ad2-421f-8afb-a2b627e8d843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:19.162206 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93e63d-0ad2-421f-8afb-a2b627e8d843 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:19.163717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93e63d-0ad2-421f-8afb-a2b627e8d843 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:19.166057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93e63d-0ad2-421f-8afb-a2b627e8d843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:19.214161 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93e63d-0ad2-421f-8afb-a2b627e8d843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:19.221616 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93e63d-0ad2-421f-8afb-a2b627e8d843 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:19.255991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 845/1698] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:21.246319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166d252-7844-4eb9-bde2-5299fbc62525 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:21.276709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3166d252-7844-4eb9-bde2-5299fbc62525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:21.372327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:21.566882 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c1530-adc7-44cf-800f-bfb44fd6aab9 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:21.567848 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c1530-adc7-44cf-800f-bfb44fd6aab9 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:21.568366 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c1530-adc7-44cf-800f-bfb44fd6aab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:21.651512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166d252-7844-4eb9-bde2-5299fbc62525 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:21.679737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62de3f-e5dd-4b52-b324-4e28089cf04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:21.680147 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62de3f-e5dd-4b52-b324-4e28089cf04a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:21.680422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62de3f-e5dd-4b52-b324-4e28089cf04a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:21.680748 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62de3f-e5dd-4b52-b324-4e28089cf04a admin admin] PATH_INFO: `/v3/users/c760a9f2d22e449a8bce9964e2f0fec7` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:21.690382 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62de3f-e5dd-4b52-b324-4e28089cf04a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c760a9f2d22e449a8bce9964e2f0fec7)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:21.692487 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62de3f-e5dd-4b52-b324-4e28089cf04a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:21.721572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-fd3c1530-adc7-44cf-800f-bfb44fd6aab9 None None] MFA Rules not processed for user `4e71cfb3bd8646798cd5ab0d1a7445d7`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:21.727863 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-fd3c1530-adc7-44cf-800f-bfb44fd6aab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:21.850990 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4f62de3f-e5dd-4b52-b324-4e28089cf04a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c760a9f2d22e449a8bce9964e2f0fec7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:21.910212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4f62de3f-e5dd-4b52-b324-4e28089cf04a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c760a9f2d22e449a8bce9964e2f0fec7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:21.976765 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4f62de3f-e5dd-4b52-b324-4e28089cf04a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c760a9f2d22e449a8bce9964e2f0fec7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:22.011464 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4f62de3f-e5dd-4b52-b324-4e28089cf04a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c760a9f2d22e449a8bce9964e2f0fec7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:22.013803 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4f62de3f-e5dd-4b52-b324-4e28089cf04a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c760a9f2d22e449a8bce9964e2f0fec7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:22.076353 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 854/1699] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:21 2022] DELETE /identity/v3/users/c760a9f2d22e449a8bce9964e2f0fec7 => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:22.083363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc8ca2-9170-4210-9757-d84b7ec4323b None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:22.086031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 846/1700] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 521 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:22.089104 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51957b22-4079-4bf0-b561-debaa83115ba None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:22.090446 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51957b22-4079-4bf0-b561-debaa83115ba None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:22.091215 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51957b22-4079-4bf0-b561-debaa83115ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:22.092636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc8ca2-9170-4210-9757-d84b7ec4323b None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:22.093099 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc8ca2-9170-4210-9757-d84b7ec4323b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:22.181069 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-51957b22-4079-4bf0-b561-debaa83115ba None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:22.187460 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-51957b22-4079-4bf0-b561-debaa83115ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:22.218339 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-d5dc8ca2-9170-4210-9757-d84b7ec4323b None None] MFA Rules not processed for user `1f69ab01440e406f86f50bedc7e02fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:22.223416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d5dc8ca2-9170-4210-9757-d84b7ec4323b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:22.334207 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:22.512094 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 847/1701] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:22.525173 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aded7-06dc-45af-aabb-0fbc46ad4908 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:22.527060 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aded7-06dc-45af-aabb-0fbc46ad4908 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:22.527868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4aded7-06dc-45af-aabb-0fbc46ad4908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:22.654391 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-9c4aded7-06dc-45af-aabb-0fbc46ad4908 None None] MFA Rules not processed for user `4e71cfb3bd8646798cd5ab0d1a7445d7`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:22.659088 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 855/1702] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 582 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:22.660197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc8ca2-9170-4210-9757-d84b7ec4323b None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:22.665320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d5dc8ca2-9170-4210-9757-d84b7ec4323b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:22.667764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9c4aded7-06dc-45af-aabb-0fbc46ad4908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:22.875866 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:22.905868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 848/1703] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:22.907061 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4aded7-06dc-45af-aabb-0fbc46ad4908 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:22.940244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9c4aded7-06dc-45af-aabb-0fbc46ad4908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:23.220519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4aded7-06dc-45af-aabb-0fbc46ad4908 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:23.274368 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62db97-68c7-488a-b8fb-aa1d6fa9c687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:23.275063 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62db97-68c7-488a-b8fb-aa1d6fa9c687 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:23.276791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62db97-68c7-488a-b8fb-aa1d6fa9c687 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:23.277111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62db97-68c7-488a-b8fb-aa1d6fa9c687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:23.311160 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc8ca2-9170-4210-9757-d84b7ec4323b None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:23.332690 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53696b-0491-4a95-ad33-1b83b42932ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:23.336898 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53696b-0491-4a95-ad33-1b83b42932ea service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:23.338002 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62db97-68c7-488a-b8fb-aa1d6fa9c687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:23.339123 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53696b-0491-4a95-ad33-1b83b42932ea service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:23.339997 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62db97-68c7-488a-b8fb-aa1d6fa9c687 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:23.341136 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53696b-0491-4a95-ad33-1b83b42932ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:23.367161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53696b-0491-4a95-ad33-1b83b42932ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:23.371520 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53696b-0491-4a95-ad33-1b83b42932ea service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:23.396275 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 849/1704] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:23.397403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62db97-68c7-488a-b8fb-aa1d6fa9c687 service nova] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:23.406919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0b62db97-68c7-488a-b8fb-aa1d6fa9c687 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:23.459585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 856/1705] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 800 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:23.465774 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53696b-0491-4a95-ad33-1b83b42932ea service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:23.476794 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-da53696b-0491-4a95-ad33-1b83b42932ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:23.479281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62db97-68c7-488a-b8fb-aa1d6fa9c687 service nova] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:23.510330 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9d46d-9350-43c2-9d04-cfcfa15c96e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:23.510986 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9d46d-9350-43c2-9d04-cfcfa15c96e9 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:23.511267 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9d46d-9350-43c2-9d04-cfcfa15c96e9 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:23.511541 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9d46d-9350-43c2-9d04-cfcfa15c96e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:23.551336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9d46d-9350-43c2-9d04-cfcfa15c96e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:23.553240 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9d46d-9350-43c2-9d04-cfcfa15c96e9 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:23.563037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53696b-0491-4a95-ad33-1b83b42932ea service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:23.583965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 850/1706] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:23 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:23.585887 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c8eba-3a89-4fd8-8230-6a46fe817801 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:23.586454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c8eba-3a89-4fd8-8230-6a46fe817801 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:23.587010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c8eba-3a89-4fd8-8230-6a46fe817801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:23.593936 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ee87e-96bb-4ed6-81cd-9ab8f269ce5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:23.596432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ee87e-96bb-4ed6-81cd-9ab8f269ce5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:23.596936 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ee87e-96bb-4ed6-81cd-9ab8f269ce5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:23.602258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ee87e-96bb-4ed6-81cd-9ab8f269ce5d admin admin] PATH_INFO: `/v3/users/0bf237aac73648e297e1d56a0d6eace6` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:23.612001 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ee87e-96bb-4ed6-81cd-9ab8f269ce5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf237aac73648e297e1d56a0d6eace6)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:23.625850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ee87e-96bb-4ed6-81cd-9ab8f269ce5d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:23.655051 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-3d0c8eba-3a89-4fd8-8230-6a46fe817801 None None] MFA Rules not processed for user `e6b8d0f089b44ba38c2b22289e61734e`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:23.657134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-3d0c8eba-3a89-4fd8-8230-6a46fe817801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:23.749508 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:23.884419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 851/1707] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:23.896570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0925beb-229c-4e4e-864d-9e4dc8ad2317 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:23.897487 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0925beb-229c-4e4e-864d-9e4dc8ad2317 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:23.898256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0925beb-229c-4e4e-864d-9e4dc8ad2317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:23.928053 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-005ee87e-96bb-4ed6-81cd-9ab8f269ce5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf237aac73648e297e1d56a0d6eace6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:23.974270 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-005ee87e-96bb-4ed6-81cd-9ab8f269ce5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf237aac73648e297e1d56a0d6eace6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:24.067613 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-b0925beb-229c-4e4e-864d-9e4dc8ad2317 None None] MFA Rules not processed for user `e6b8d0f089b44ba38c2b22289e61734e`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:24.076417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-b0925beb-229c-4e4e-864d-9e4dc8ad2317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:24.112538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-005ee87e-96bb-4ed6-81cd-9ab8f269ce5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf237aac73648e297e1d56a0d6eace6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:24.117698 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 852/1708] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:53:24.186109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-005ee87e-96bb-4ed6-81cd-9ab8f269ce5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf237aac73648e297e1d56a0d6eace6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:24.190175 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-005ee87e-96bb-4ed6-81cd-9ab8f269ce5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf237aac73648e297e1d56a0d6eace6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:24.194740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0925beb-229c-4e4e-864d-9e4dc8ad2317 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:24.219585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 857/1709] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:23 2022] DELETE /identity/v3/users/0bf237aac73648e297e1d56a0d6eace6 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:24.228285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0925beb-229c-4e4e-864d-9e4dc8ad2317 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:24.237758 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3d564-e237-4516-b8ed-074d947bd955 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:24.238661 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3d564-e237-4516-b8ed-074d947bd955 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:24.241197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3d564-e237-4516-b8ed-074d947bd955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:24.366159 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-b5a3d564-e237-4516-b8ed-074d947bd955 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:24.368799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b5a3d564-e237-4516-b8ed-074d947bd955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:24.509022 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0c7f4-7ea6-41ae-8a8f-bafd7b6a2f13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:24.520070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c7f4-7ea6-41ae-8a8f-bafd7b6a2f13 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:24.521026 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c7f4-7ea6-41ae-8a8f-bafd7b6a2f13 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:24.521689 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c7f4-7ea6-41ae-8a8f-bafd7b6a2f13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:24.527670 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-1fa0c7f4-7ea6-41ae-8a8f-bafd7b6a2f13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:24.713195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 858/1710] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:24.750257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0c7f4-7ea6-41ae-8a8f-bafd7b6a2f13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:24.755681 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0c7f4-7ea6-41ae-8a8f-bafd7b6a2f13 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:24.776247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3d564-e237-4516-b8ed-074d947bd955 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:24.778619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b5a3d564-e237-4516-b8ed-074d947bd955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:24.787546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 853/1711] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:24.992323 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:25.053253 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0e383-98c7-4d84-8515-f8f24697e0ba None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:25.053558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0e383-98c7-4d84-8515-f8f24697e0ba None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:25.054116 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0e383-98c7-4d84-8515-f8f24697e0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:25.100696 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-4fc0e383-98c7-4d84-8515-f8f24697e0ba None None] MFA Rules not processed for user `a3caf53b684542ac87474ab807b5fdcc`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:25.104502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4fc0e383-98c7-4d84-8515-f8f24697e0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:25.132055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3d564-e237-4516-b8ed-074d947bd955 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:25.161385 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e955c49-f131-4908-b3d1-74879583ebe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:25.162460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e955c49-f131-4908-b3d1-74879583ebe0 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:25.162918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e955c49-f131-4908-b3d1-74879583ebe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:25.163382 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e955c49-f131-4908-b3d1-74879583ebe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:25.222387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:25.226942 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e955c49-f131-4908-b3d1-74879583ebe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:25.229689 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e955c49-f131-4908-b3d1-74879583ebe0 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:25.280039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 854/1712] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:25.281892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0e383-98c7-4d84-8515-f8f24697e0ba None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:25.282106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 859/1713] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:53:25.287639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4fc0e383-98c7-4d84-8515-f8f24697e0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:25.301188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e955c49-f131-4908-b3d1-74879583ebe0 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:25.303914 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6e955c49-f131-4908-b3d1-74879583ebe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:25.347315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e955c49-f131-4908-b3d1-74879583ebe0 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:25.354365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0e383-98c7-4d84-8515-f8f24697e0ba None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:25.368301 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfde1fd-f2de-476e-a1bd-6449b0b45aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:25.369882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfde1fd-f2de-476e-a1bd-6449b0b45aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:25.370743 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfde1fd-f2de-476e-a1bd-6449b0b45aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:25.371387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfde1fd-f2de-476e-a1bd-6449b0b45aaf admin admin] PATH_INFO: `/v3/users/ab0076e154314dcc86f914bec61ac57e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:25.374671 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfde1fd-f2de-476e-a1bd-6449b0b45aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab0076e154314dcc86f914bec61ac57e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:25.379098 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62038300-03b9-4a74-8ca3-298261e5adf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:25.380616 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62038300-03b9-4a74-8ca3-298261e5adf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:25.381082 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62038300-03b9-4a74-8ca3-298261e5adf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:25.381592 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62038300-03b9-4a74-8ca3-298261e5adf3 admin admin] PATH_INFO: `/v3/projects/ab58084505214e418111dccbb5db889e` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:25.382092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfde1fd-f2de-476e-a1bd-6449b0b45aaf admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:25.384145 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62038300-03b9-4a74-8ca3-298261e5adf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab58084505214e418111dccbb5db889e)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:25.394900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62038300-03b9-4a74-8ca3-298261e5adf3 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:25.547447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-dcfde1fd-f2de-476e-a1bd-6449b0b45aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab0076e154314dcc86f914bec61ac57e'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:25.573250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-dcfde1fd-f2de-476e-a1bd-6449b0b45aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab0076e154314dcc86f914bec61ac57e'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:25.585443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-62038300-03b9-4a74-8ca3-298261e5adf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab58084505214e418111dccbb5db889e', 'request_id': 'req-62038300-03b9-4a74-8ca3-298261e5adf3'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:25.602108 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-62038300-03b9-4a74-8ca3-298261e5adf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab58084505214e418111dccbb5db889e', 'request_id': 'req-62038300-03b9-4a74-8ca3-298261e5adf3'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:25.624450 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-62038300-03b9-4a74-8ca3-298261e5adf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab58084505214e418111dccbb5db889e', 'request_id': 'req-62038300-03b9-4a74-8ca3-298261e5adf3'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:25.627371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-dcfde1fd-f2de-476e-a1bd-6449b0b45aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab0076e154314dcc86f914bec61ac57e'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:25.654757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-62038300-03b9-4a74-8ca3-298261e5adf3 admin admin] The token cache is being invalidate because project ab58084505214e418111dccbb5db889e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:25.655239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-62038300-03b9-4a74-8ca3-298261e5adf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:25.656044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-dcfde1fd-f2de-476e-a1bd-6449b0b45aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab0076e154314dcc86f914bec61ac57e'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:25.658539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-62038300-03b9-4a74-8ca3-298261e5adf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:25.659012 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-dcfde1fd-f2de-476e-a1bd-6449b0b45aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab0076e154314dcc86f914bec61ac57e'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:25.662357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 855/1714] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:25 2022] DELETE /identity/v3/projects/ab58084505214e418111dccbb5db889e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:25.668476 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87ce55-82df-4258-85be-758ecba4f791 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:25.675565 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87ce55-82df-4258-85be-758ecba4f791 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:25.676651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87ce55-82df-4258-85be-758ecba4f791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:25.680830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 860/1715] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:25 2022] DELETE /identity/v3/users/ab0076e154314dcc86f914bec61ac57e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:53:25.688041 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fd624-f419-4128-b181-f83888a0ce96 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:25.688484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fd624-f419-4128-b181-f83888a0ce96 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:25.688797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fd624-f419-4128-b181-f83888a0ce96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:25.736064 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-6e7fd624-f419-4128-b181-f83888a0ce96 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:25.737392 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6e7fd624-f419-4128-b181-f83888a0ce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:25.746264 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-9c87ce55-82df-4258-85be-758ecba4f791 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:25.750581 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9c87ce55-82df-4258-85be-758ecba4f791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:25.890636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 861/1716] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:53:25.908906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fd624-f419-4128-b181-f83888a0ce96 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:25.910551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6e7fd624-f419-4128-b181-f83888a0ce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:26.059477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:26.074800 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fd624-f419-4128-b181-f83888a0ce96 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:26.075082 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 856/1717] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:26.084172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff1ead-e603-4a4d-8f8f-2d82b65c5537 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:26.084953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff1ead-e603-4a4d-8f8f-2d82b65c5537 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:26.086408 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff1ead-e603-4a4d-8f8f-2d82b65c5537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:26.090839 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95de47-8651-4a60-853e-6392661e8292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:26.091861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95de47-8651-4a60-853e-6392661e8292 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:26.092154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95de47-8651-4a60-853e-6392661e8292 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:26.092430 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95de47-8651-4a60-853e-6392661e8292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:26.127725 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95de47-8651-4a60-853e-6392661e8292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:26.132552 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95de47-8651-4a60-853e-6392661e8292 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:26.138259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-27ff1ead-e603-4a4d-8f8f-2d82b65c5537 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:26.139713 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-27ff1ead-e603-4a4d-8f8f-2d82b65c5537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:26.150249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 857/1718] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:26.151928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a046c02-09f0-45fd-95be-76df218d2902 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:26.152317 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a046c02-09f0-45fd-95be-76df218d2902 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:26.152899 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a046c02-09f0-45fd-95be-76df218d2902 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:26.155489 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 858/1719] 10.222.0.23 () {54 vars in 912 bytes} [Mon Sep 12 23:53:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:53:26.156748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a046c02-09f0-45fd-95be-76df218d2902 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:26.164207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 862/1720] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:53:26.165534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328cb62-cc7f-4a72-a391-b88036a14989 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:26.165822 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328cb62-cc7f-4a72-a391-b88036a14989 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:26.166698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328cb62-cc7f-4a72-a391-b88036a14989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:26.179668 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a046c02-09f0-45fd-95be-76df218d2902 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:26.186356 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f748cf1-f8d3-47ee-8c99-1d3182f6f0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:26.187395 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f748cf1-f8d3-47ee-8c99-1d3182f6f0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:26.187879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f748cf1-f8d3-47ee-8c99-1d3182f6f0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:26.188380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f748cf1-f8d3-47ee-8c99-1d3182f6f0c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:26.189956 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f748cf1-f8d3-47ee-8c99-1d3182f6f0c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:53:26.190282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f748cf1-f8d3-47ee-8c99-1d3182f6f0c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:26.192099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f748cf1-f8d3-47ee-8c99-1d3182f6f0c2 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:26.247083 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 859/1721] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:53:26.258484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f748cf1-f8d3-47ee-8c99-1d3182f6f0c2 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:26.270778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-1328cb62-cc7f-4a72-a391-b88036a14989 None None] MFA Rules not processed for user `a5814ac53752455697e050944b6d32b7`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:26.272226 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1328cb62-cc7f-4a72-a391-b88036a14989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:26.290036 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f748cf1-f8d3-47ee-8c99-1d3182f6f0c2 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:26.297148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 863/1722] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 23:53:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:26.306711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d194d-54dc-4a31-85e9-2e3e09c1352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:26.306711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d194d-54dc-4a31-85e9-2e3e09c1352c admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:26.306711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d194d-54dc-4a31-85e9-2e3e09c1352c admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:26.307100 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d194d-54dc-4a31-85e9-2e3e09c1352c admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:26.307721 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d194d-54dc-4a31-85e9-2e3e09c1352c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:26.316991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d194d-54dc-4a31-85e9-2e3e09c1352c admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:26.329125 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328cb62-cc7f-4a72-a391-b88036a14989 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:26.330686 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1328cb62-cc7f-4a72-a391-b88036a14989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:26.351289 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328cb62-cc7f-4a72-a391-b88036a14989 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:26.361046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c2e56-e471-49f9-8721-f3dd4fa594ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:26.362080 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c2e56-e471-49f9-8721-f3dd4fa594ee service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:26.362706 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c2e56-e471-49f9-8721-f3dd4fa594ee service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:26.363146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c2e56-e471-49f9-8721-f3dd4fa594ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:26.384171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c2e56-e471-49f9-8721-f3dd4fa594ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:26.386161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c2e56-e471-49f9-8721-f3dd4fa594ee service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:26.415465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 864/1723] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:53:26.418043 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c898a86-f924-4504-babc-1b689ab9e18f None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:26.420812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c898a86-f924-4504-babc-1b689ab9e18f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:26.421367 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c898a86-f924-4504-babc-1b689ab9e18f None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:26.424242 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 865/1724] 10.222.0.23 () {54 vars in 912 bytes} [Mon Sep 12 23:53:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:53:26.430214 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c898a86-f924-4504-babc-1b689ab9e18f None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:26.449280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 860/1725] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:26 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:26.451227 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca033040-fbc9-4db8-8f06-3cc8f8391305 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:26.451631 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca033040-fbc9-4db8-8f06-3cc8f8391305 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:26.451818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca033040-fbc9-4db8-8f06-3cc8f8391305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:26.506625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-ca033040-fbc9-4db8-8f06-3cc8f8391305 None None] MFA Rules not processed for user `a5814ac53752455697e050944b6d32b7`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:26.507929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ca033040-fbc9-4db8-8f06-3cc8f8391305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:26.625249 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c898a86-f924-4504-babc-1b689ab9e18f None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:26.631327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb4ef5-3937-49ee-94ec-d03565ba4bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:26.632363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb4ef5-3937-49ee-94ec-d03565ba4bdb admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:26.632636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb4ef5-3937-49ee-94ec-d03565ba4bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:26.633052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb4ef5-3937-49ee-94ec-d03565ba4bdb admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:26.634134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb4ef5-3937-49ee-94ec-d03565ba4bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:26.636432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb4ef5-3937-49ee-94ec-d03565ba4bdb admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:26.641855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:26.698866 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 866/1726] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:26 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:53:26.703276 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 861/1727] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 23:53:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:26.703774 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb4ef5-3937-49ee-94ec-d03565ba4bdb admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:26.728536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb4ef5-3937-49ee-94ec-d03565ba4bdb admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:26.741149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7265c-0921-46a8-bdc2-e0e807465c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:26.741841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7265c-0921-46a8-bdc2-e0e807465c82 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:26.742272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7265c-0921-46a8-bdc2-e0e807465c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:26.742425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7265c-0921-46a8-bdc2-e0e807465c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:26.743298 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7265c-0921-46a8-bdc2-e0e807465c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:26.745116 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7265c-0921-46a8-bdc2-e0e807465c82 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:26.774525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca033040-fbc9-4db8-8f06-3cc8f8391305 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:26.802720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca033040-fbc9-4db8-8f06-3cc8f8391305 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:26.811401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 867/1728] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:53:26.811601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e77602-b7f6-4c6a-b141-6912c30988dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:26.814286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e77602-b7f6-4c6a-b141-6912c30988dd service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:26.814286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e77602-b7f6-4c6a-b141-6912c30988dd service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:26.814286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e77602-b7f6-4c6a-b141-6912c30988dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:26.815531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7265c-0921-46a8-bdc2-e0e807465c82 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:26.831807 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e77602-b7f6-4c6a-b141-6912c30988dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:26.832059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7265c-0921-46a8-bdc2-e0e807465c82 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:26.841791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e77602-b7f6-4c6a-b141-6912c30988dd service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:26.852253 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcb339-d2a1-4a85-82a0-6f683d101114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:26.853047 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcb339-d2a1-4a85-82a0-6f683d101114 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:26.853324 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcb339-d2a1-4a85-82a0-6f683d101114 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:26.853618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcb339-d2a1-4a85-82a0-6f683d101114 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:26.854295 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcb339-d2a1-4a85-82a0-6f683d101114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:26.857264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcb339-d2a1-4a85-82a0-6f683d101114 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:26.875622 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 862/1729] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:53:26.888757 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 868/1730] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:53:26.902754 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e77602-b7f6-4c6a-b141-6912c30988dd service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:26.944558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e77602-b7f6-4c6a-b141-6912c30988dd service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:26.953385 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169de793-e8b9-46a5-b9a0-d0657f2d8f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:26.954202 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169de793-e8b9-46a5-b9a0-d0657f2d8f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:26.954595 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169de793-e8b9-46a5-b9a0-d0657f2d8f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:26.954881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169de793-e8b9-46a5-b9a0-d0657f2d8f58 admin admin] PATH_INFO: `/v3/projects/642b8de2c45645bab2f853bb57c10b05/users/bb092a613fbb471bad6f13b2d332b7b8/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:26.990253 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169de793-e8b9-46a5-b9a0-d0657f2d8f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=642b8de2c45645bab2f853bb57c10b05, user_id=bb092a613fbb471bad6f13b2d332b7b8, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:26.993155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169de793-e8b9-46a5-b9a0-d0657f2d8f58 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:27.028959 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 863/1731] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:26 2022] PUT /identity/v3/projects/642b8de2c45645bab2f853bb57c10b05/users/bb092a613fbb471bad6f13b2d332b7b8/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:27.044418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b33e0-d1ad-4534-a526-c8c589140fe9 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:27.045201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b33e0-d1ad-4534-a526-c8c589140fe9 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:27.045714 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b33e0-d1ad-4534-a526-c8c589140fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:27.147765 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-2d3b33e0-d1ad-4534-a526-c8c589140fe9 None None] MFA Rules not processed for user `bb092a613fbb471bad6f13b2d332b7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:27.152941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2d3b33e0-d1ad-4534-a526-c8c589140fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:27.361521 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 869/1732] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:27.803831 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169de793-e8b9-46a5-b9a0-d0657f2d8f58 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:27.806822 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-169de793-e8b9-46a5-b9a0-d0657f2d8f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:27.927605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b33e0-d1ad-4534-a526-c8c589140fe9 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:27.929320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2d3b33e0-d1ad-4534-a526-c8c589140fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:28.013929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:28.032845 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169de793-e8b9-46a5-b9a0-d0657f2d8f58 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:28.039716 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fd43d-7941-42bc-8c60-8a66274a0c95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:28.040833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fd43d-7941-42bc-8c60-8a66274a0c95 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:28.041384 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fd43d-7941-42bc-8c60-8a66274a0c95 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:28.041864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fd43d-7941-42bc-8c60-8a66274a0c95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:28.044550 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ec1fd43d-7941-42bc-8c60-8a66274a0c95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:28.268733 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b33e0-d1ad-4534-a526-c8c589140fe9 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:28.284770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fd43d-7941-42bc-8c60-8a66274a0c95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:28.293305 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc06153-7af3-4415-9600-ccff1ccb857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:28.296464 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc06153-7af3-4415-9600-ccff1ccb857b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:28.296771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc06153-7af3-4415-9600-ccff1ccb857b admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:28.297027 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc06153-7af3-4415-9600-ccff1ccb857b admin admin] PATH_INFO: `/v3/projects/5e62c7f9576649bf9335012586764215` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:28.299110 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fd43d-7941-42bc-8c60-8a66274a0c95 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:28.301183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc06153-7af3-4415-9600-ccff1ccb857b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e62c7f9576649bf9335012586764215)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:28.303378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc06153-7af3-4415-9600-ccff1ccb857b admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:28.379303 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 864/1733] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:53:28.380843 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fd43d-7941-42bc-8c60-8a66274a0c95 service nova] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:28.403744 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ec1fd43d-7941-42bc-8c60-8a66274a0c95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:28.494645 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-9bc06153-7af3-4415-9600-ccff1ccb857b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e62c7f9576649bf9335012586764215', 'request_id': 'req-9bc06153-7af3-4415-9600-ccff1ccb857b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:28.523217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-9bc06153-7af3-4415-9600-ccff1ccb857b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e62c7f9576649bf9335012586764215', 'request_id': 'req-9bc06153-7af3-4415-9600-ccff1ccb857b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:28.540312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-9bc06153-7af3-4415-9600-ccff1ccb857b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e62c7f9576649bf9335012586764215', 'request_id': 'req-9bc06153-7af3-4415-9600-ccff1ccb857b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:28.585243 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-9bc06153-7af3-4415-9600-ccff1ccb857b admin admin] The token cache is being invalidate because project 5e62c7f9576649bf9335012586764215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:28.585818 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-9bc06153-7af3-4415-9600-ccff1ccb857b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:28.588406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-9bc06153-7af3-4415-9600-ccff1ccb857b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:28.592470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 870/1734] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:27 2022] DELETE /identity/v3/projects/5e62c7f9576649bf9335012586764215 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:28.593863 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc06153-7af3-4415-9600-ccff1ccb857b admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:28.600331 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9bc06153-7af3-4415-9600-ccff1ccb857b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:28.816718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:28.927264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc06153-7af3-4415-9600-ccff1ccb857b admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:28.954960 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fd43d-7941-42bc-8c60-8a66274a0c95 service nova] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:29.024836 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1bd47-12a3-483f-b0b5-440c6a10548f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:29.026140 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1bd47-12a3-483f-b0b5-440c6a10548f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:29.026644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1bd47-12a3-483f-b0b5-440c6a10548f admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:29.027143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1bd47-12a3-483f-b0b5-440c6a10548f admin admin] PATH_INFO: `/v3/projects/d66d874429604a40aa2ab2c76d29d54d` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:29.045827 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1bd47-12a3-483f-b0b5-440c6a10548f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d66d874429604a40aa2ab2c76d29d54d)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:29.078395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1bd47-12a3-483f-b0b5-440c6a10548f admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:29.211072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21b29c-bdd0-42c1-bf15-520422253176 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4395ee0a00df41adacb55b4a8684786b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:29.211729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21b29c-bdd0-42c1-bf15-520422253176 service placement] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:29.212008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21b29c-bdd0-42c1-bf15-520422253176 service placement] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:29.212280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21b29c-bdd0-42c1-bf15-520422253176 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:29.212601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:29.215969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5ab1bd47-12a3-483f-b0b5-440c6a10548f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66d874429604a40aa2ab2c76d29d54d', 'request_id': 'req-5ab1bd47-12a3-483f-b0b5-440c6a10548f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:29.220499 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9b21b29c-bdd0-42c1-bf15-520422253176 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:29.234546 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5ab1bd47-12a3-483f-b0b5-440c6a10548f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66d874429604a40aa2ab2c76d29d54d', 'request_id': 'req-5ab1bd47-12a3-483f-b0b5-440c6a10548f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:29.247139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5ab1bd47-12a3-483f-b0b5-440c6a10548f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66d874429604a40aa2ab2c76d29d54d', 'request_id': 'req-5ab1bd47-12a3-483f-b0b5-440c6a10548f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:29.257031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21b29c-bdd0-42c1-bf15-520422253176 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:29.259421 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21b29c-bdd0-42c1-bf15-520422253176 service placement] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:29.278209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5ab1bd47-12a3-483f-b0b5-440c6a10548f admin admin] The token cache is being invalidate because project d66d874429604a40aa2ab2c76d29d54d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:29.278892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5ab1bd47-12a3-483f-b0b5-440c6a10548f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:29.279990 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5ab1bd47-12a3-483f-b0b5-440c6a10548f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:29.283746 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 871/1735] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:28 2022] DELETE /identity/v3/projects/d66d874429604a40aa2ab2c76d29d54d => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:29.285883 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1bd47-12a3-483f-b0b5-440c6a10548f admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:29.288695 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5ab1bd47-12a3-483f-b0b5-440c6a10548f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:29.298683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 865/1736] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 919 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:29.300725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21b29c-bdd0-42c1-bf15-520422253176 service placement] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:29.302854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9b21b29c-bdd0-42c1-bf15-520422253176 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:29.617762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1bd47-12a3-483f-b0b5-440c6a10548f admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:29.637203 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21b29c-bdd0-42c1-bf15-520422253176 service placement] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:29.655010 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e41cc-850b-4311-8dd2-241a0714a010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:29.655969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e41cc-850b-4311-8dd2-241a0714a010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:29.663442 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e41cc-850b-4311-8dd2-241a0714a010 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:29.664122 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e41cc-850b-4311-8dd2-241a0714a010 admin admin] PATH_INFO: `/v3/users/323d8824194c48cd927d2b52774088bd` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:29.667792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e41cc-850b-4311-8dd2-241a0714a010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=323d8824194c48cd927d2b52774088bd)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:29.672045 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e41cc-850b-4311-8dd2-241a0714a010 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:29.840575 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a57e41cc-850b-4311-8dd2-241a0714a010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '323d8824194c48cd927d2b52774088bd'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:29.871167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a57e41cc-850b-4311-8dd2-241a0714a010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '323d8824194c48cd927d2b52774088bd'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:29.909162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a57e41cc-850b-4311-8dd2-241a0714a010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '323d8824194c48cd927d2b52774088bd'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:29.932758 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a57e41cc-850b-4311-8dd2-241a0714a010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '323d8824194c48cd927d2b52774088bd'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:29.933594 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a57e41cc-850b-4311-8dd2-241a0714a010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '323d8824194c48cd927d2b52774088bd'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:29.948868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 872/1737] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:29 2022] DELETE /identity/v3/users/323d8824194c48cd927d2b52774088bd => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:29.953565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaa9ff-5412-4338-9136-ddb0385784c3 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:29.953919 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaa9ff-5412-4338-9136-ddb0385784c3 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:29.954211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaa9ff-5412-4338-9136-ddb0385784c3 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:29.958786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 873/1738] 10.222.0.23 () {54 vars in 961 bytes} [Mon Sep 12 23:53:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:53:29.962936 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaa9ff-5412-4338-9136-ddb0385784c3 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:29.969182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-8efaa9ff-5412-4338-9136-ddb0385784c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:30.079379 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cbc8e-7748-479a-beda-bfd73c84788b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:30.081609 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cbc8e-7748-479a-beda-bfd73c84788b service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:30.083370 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cbc8e-7748-479a-beda-bfd73c84788b service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:30.084239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cbc8e-7748-479a-beda-bfd73c84788b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:30.105673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-702cbc8e-7748-479a-beda-bfd73c84788b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:30.195087 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:30.216340 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaa9ff-5412-4338-9136-ddb0385784c3 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:30.224375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:30.230134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cad77f-af2e-48c7-8684-d3f434bae90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:30.232466 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cad77f-af2e-48c7-8684-d3f434bae90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:30.232865 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cad77f-af2e-48c7-8684-d3f434bae90f admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:30.233040 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cad77f-af2e-48c7-8684-d3f434bae90f admin admin] PATH_INFO: `/v3/users/22f1ce3fea694b049cf2cd3526fb684c` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:30.239912 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cad77f-af2e-48c7-8684-d3f434bae90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=22f1ce3fea694b049cf2cd3526fb684c)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:30.245961 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cad77f-af2e-48c7-8684-d3f434bae90f admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:30.436761 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cbc8e-7748-479a-beda-bfd73c84788b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:30.438483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cbc8e-7748-479a-beda-bfd73c84788b service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:30.455985 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c3cad77f-af2e-48c7-8684-d3f434bae90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22f1ce3fea694b049cf2cd3526fb684c'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:30.467495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 866/1739] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 1168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:30.470635 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3455f3-42ca-4acf-a6f3-5f02d0513384 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:30.471144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3455f3-42ca-4acf-a6f3-5f02d0513384 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:30.472935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3455f3-42ca-4acf-a6f3-5f02d0513384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:30.508759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c3cad77f-af2e-48c7-8684-d3f434bae90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22f1ce3fea694b049cf2cd3526fb684c'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:30.522817 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-7f3455f3-42ca-4acf-a6f3-5f02d0513384 None None] MFA Rules not processed for user `4395ee0a00df41adacb55b4a8684786b`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:30.528164 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7f3455f3-42ca-4acf-a6f3-5f02d0513384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:30.570093 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c3cad77f-af2e-48c7-8684-d3f434bae90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22f1ce3fea694b049cf2cd3526fb684c'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:30.598275 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c3cad77f-af2e-48c7-8684-d3f434bae90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22f1ce3fea694b049cf2cd3526fb684c'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:30.599608 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c3cad77f-af2e-48c7-8684-d3f434bae90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22f1ce3fea694b049cf2cd3526fb684c'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:30.628362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 874/1740] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:29 2022] DELETE /identity/v3/users/22f1ce3fea694b049cf2cd3526fb684c => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:30.628362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd5c76-c382-4660-814a-466aa5ad3f3d None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:30.628362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd5c76-c382-4660-814a-466aa5ad3f3d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:30.628362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd5c76-c382-4660-814a-466aa5ad3f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:30.718480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-7ffd5c76-c382-4660-814a-466aa5ad3f3d None None] MFA Rules not processed for user `4e71cfb3bd8646798cd5ab0d1a7445d7`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:30.723279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-7ffd5c76-c382-4660-814a-466aa5ad3f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:30.922445 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 875/1741] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:30.990654 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 867/1742] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Sep 12 23:53:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 522 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:31.049568 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd5c76-c382-4660-814a-466aa5ad3f3d None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:31.281251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3455f3-42ca-4acf-a6f3-5f02d0513384 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:31.284346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7f3455f3-42ca-4acf-a6f3-5f02d0513384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:31.324537 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3455f3-42ca-4acf-a6f3-5f02d0513384 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:31.359293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd5c76-c382-4660-814a-466aa5ad3f3d None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:31.380035 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932a14b-d8bc-46b1-be84-6c846501dfd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4395ee0a00df41adacb55b4a8684786b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:31.384275 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932a14b-d8bc-46b1-be84-6c846501dfd3 service placement] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:31.384594 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932a14b-d8bc-46b1-be84-6c846501dfd3 service placement] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:31.388483 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932a14b-d8bc-46b1-be84-6c846501dfd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:31.395389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0932a14b-d8bc-46b1-be84-6c846501dfd3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:31.458340 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932a14b-d8bc-46b1-be84-6c846501dfd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:31.461812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932a14b-d8bc-46b1-be84-6c846501dfd3 service placement] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:31.484105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 876/1743] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:31.631925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5f2ff-bac0-467e-abed-7f5b61b6c2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:31.633820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5f2ff-bac0-467e-abed-7f5b61b6c2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:31.634423 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5f2ff-bac0-467e-abed-7f5b61b6c2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:31.634833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5f2ff-bac0-467e-abed-7f5b61b6c2a8 admin admin] PATH_INFO: `/v3/users/bb092a613fbb471bad6f13b2d332b7b8` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:31.636335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5f2ff-bac0-467e-abed-7f5b61b6c2a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb092a613fbb471bad6f13b2d332b7b8)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:31.638592 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5f2ff-bac0-467e-abed-7f5b61b6c2a8 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:31.652826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932a14b-d8bc-46b1-be84-6c846501dfd3 service placement] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:31.654591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0932a14b-d8bc-46b1-be84-6c846501dfd3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:31.692016 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932a14b-d8bc-46b1-be84-6c846501dfd3 service placement] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:31.716456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2dc67-2d7a-4643-971e-b23120bb1fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:31.720635 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2dc67-2d7a-4643-971e-b23120bb1fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:31.723416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2dc67-2d7a-4643-971e-b23120bb1fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:31.724403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2dc67-2d7a-4643-971e-b23120bb1fbd admin admin] PATH_INFO: `/v3/users/d57acbe6c9034afd9d4ec1d615e133d5` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:31.729382 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2dc67-2d7a-4643-971e-b23120bb1fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57acbe6c9034afd9d4ec1d615e133d5)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:31.736834 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2dc67-2d7a-4643-971e-b23120bb1fbd admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:31.746650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:31.784876 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-13c5f2ff-bac0-467e-abed-7f5b61b6c2a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb092a613fbb471bad6f13b2d332b7b8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:31.788138 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-13c5f2ff-bac0-467e-abed-7f5b61b6c2a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb092a613fbb471bad6f13b2d332b7b8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:31.789444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-13c5f2ff-bac0-467e-abed-7f5b61b6c2a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb092a613fbb471bad6f13b2d332b7b8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:31.801160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:31.825179 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-13c5f2ff-bac0-467e-abed-7f5b61b6c2a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb092a613fbb471bad6f13b2d332b7b8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:31.840156 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-13c5f2ff-bac0-467e-abed-7f5b61b6c2a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb092a613fbb471bad6f13b2d332b7b8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:31.886464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 868/1744] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:31 2022] DELETE /identity/v3/users/bb092a613fbb471bad6f13b2d332b7b8 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:31.891817 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd57e6-0303-4cc4-bcad-8c7afa421e07 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:31.892249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd57e6-0303-4cc4-bcad-8c7afa421e07 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:31.892736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd57e6-0303-4cc4-bcad-8c7afa421e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:31.946493 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c4b2dc67-2d7a-4643-971e-b23120bb1fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57acbe6c9034afd9d4ec1d615e133d5'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:31.978953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-cfbd57e6-0303-4cc4-bcad-8c7afa421e07 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:31.983465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-cfbd57e6-0303-4cc4-bcad-8c7afa421e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:31.984398 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c4b2dc67-2d7a-4643-971e-b23120bb1fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57acbe6c9034afd9d4ec1d615e133d5'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:32.024712 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c4b2dc67-2d7a-4643-971e-b23120bb1fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57acbe6c9034afd9d4ec1d615e133d5'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:32.065678 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c4b2dc67-2d7a-4643-971e-b23120bb1fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57acbe6c9034afd9d4ec1d615e133d5'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:32.066452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c4b2dc67-2d7a-4643-971e-b23120bb1fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57acbe6c9034afd9d4ec1d615e133d5'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:32.076346 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 877/1745] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:31 2022] DELETE /identity/v3/users/d57acbe6c9034afd9d4ec1d615e133d5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:53:32.080994 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2ceac-901a-4af6-9472-74899f2739a8 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:32.081454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2ceac-901a-4af6-9472-74899f2739a8 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:32.081804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2ceac-901a-4af6-9472-74899f2739a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:32.111776 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-84a2ceac-901a-4af6-9472-74899f2739a8 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:32.113465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-84a2ceac-901a-4af6-9472-74899f2739a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:32.319623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 869/1746] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:32.320708 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd57e6-0303-4cc4-bcad-8c7afa421e07 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:32.326329 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-cfbd57e6-0303-4cc4-bcad-8c7afa421e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:32.380468 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd57e6-0303-4cc4-bcad-8c7afa421e07 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:32.419167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 878/1747] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:32.423330 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2ceac-901a-4af6-9472-74899f2739a8 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:32.438061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-84a2ceac-901a-4af6-9472-74899f2739a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:32.629634 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790e30b-ed94-4c63-9b83-22db79a91b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:32.636182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790e30b-ed94-4c63-9b83-22db79a91b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:32.637296 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790e30b-ed94-4c63-9b83-22db79a91b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:32.637819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790e30b-ed94-4c63-9b83-22db79a91b0c admin admin] PATH_INFO: `/v3/projects/344f9105f2af446690f2c658f76f374a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:32.644600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790e30b-ed94-4c63-9b83-22db79a91b0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=344f9105f2af446690f2c658f76f374a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:32.648050 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790e30b-ed94-4c63-9b83-22db79a91b0c admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:32.685449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2ceac-901a-4af6-9472-74899f2739a8 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:32.710691 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6ce7c-5e81-4f5d-9664-08c920c4ac35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:32.712481 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6ce7c-5e81-4f5d-9664-08c920c4ac35 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:32.715203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6ce7c-5e81-4f5d-9664-08c920c4ac35 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:32.719502 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6ce7c-5e81-4f5d-9664-08c920c4ac35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:32.802248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6ce7c-5e81-4f5d-9664-08c920c4ac35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:32.816528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6ce7c-5e81-4f5d-9664-08c920c4ac35 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:32.889827 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 879/1748] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:32.890871 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6ce7c-5e81-4f5d-9664-08c920c4ac35 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:32.895515 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-32b6ce7c-5e81-4f5d-9664-08c920c4ac35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:32.927379 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6ce7c-5e81-4f5d-9664-08c920c4ac35 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:32.951891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5790e30b-ed94-4c63-9b83-22db79a91b0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '344f9105f2af446690f2c658f76f374a', 'request_id': 'req-5790e30b-ed94-4c63-9b83-22db79a91b0c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:32.970261 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5790e30b-ed94-4c63-9b83-22db79a91b0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '344f9105f2af446690f2c658f76f374a', 'request_id': 'req-5790e30b-ed94-4c63-9b83-22db79a91b0c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:32.991655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5790e30b-ed94-4c63-9b83-22db79a91b0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '344f9105f2af446690f2c658f76f374a', 'request_id': 'req-5790e30b-ed94-4c63-9b83-22db79a91b0c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:33.012583 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:33.017255 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:33.027010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5790e30b-ed94-4c63-9b83-22db79a91b0c admin admin] The token cache is being invalidate because project 344f9105f2af446690f2c658f76f374a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:33.027327 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5790e30b-ed94-4c63-9b83-22db79a91b0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:33.037899 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5790e30b-ed94-4c63-9b83-22db79a91b0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:33.042673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 870/1749] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:32 2022] DELETE /identity/v3/projects/344f9105f2af446690f2c658f76f374a => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:33.044331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676b61c-19ce-4f40-badc-7c306fd1a334 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:33.048114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676b61c-19ce-4f40-badc-7c306fd1a334 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:33.048547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676b61c-19ce-4f40-badc-7c306fd1a334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:33.114370 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-f676b61c-19ce-4f40-badc-7c306fd1a334 None None] MFA Rules not processed for user `1f69ab01440e406f86f50bedc7e02fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:33.115762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f676b61c-19ce-4f40-badc-7c306fd1a334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:33.123403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9270e8-716b-4df3-942c-3bbedae7d713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:33.124324 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9270e8-716b-4df3-942c-3bbedae7d713 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:33.124612 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9270e8-716b-4df3-942c-3bbedae7d713 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:33.124941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9270e8-716b-4df3-942c-3bbedae7d713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:33.130793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2f9270e8-716b-4df3-942c-3bbedae7d713 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:33.305060 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 871/1750] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:33.306638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f91cf-ae73-4359-a1fe-7023e523911a None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:33.306920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f91cf-ae73-4359-a1fe-7023e523911a None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:33.307192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f91cf-ae73-4359-a1fe-7023e523911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:33.363229 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-7f2f91cf-ae73-4359-a1fe-7023e523911a None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:33.367867 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7f2f91cf-ae73-4359-a1fe-7023e523911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:33.457162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9270e8-716b-4df3-942c-3bbedae7d713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:33.458757 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9270e8-716b-4df3-942c-3bbedae7d713 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:33.495859 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 880/1751] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:33.499107 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9270e8-716b-4df3-942c-3bbedae7d713 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:33.504664 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2f9270e8-716b-4df3-942c-3bbedae7d713 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:33.559541 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9270e8-716b-4df3-942c-3bbedae7d713 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:33.560881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 872/1752] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:33.569583 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6016b-c586-49b2-b2a1-7ccca73d25d0 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:33.570072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6016b-c586-49b2-b2a1-7ccca73d25d0 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:33.570508 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6016b-c586-49b2-b2a1-7ccca73d25d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:33.591369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad56a0-4f7d-4bef-8fc3-fd8bb912cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:33.593514 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad56a0-4f7d-4bef-8fc3-fd8bb912cfa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:33.594283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad56a0-4f7d-4bef-8fc3-fd8bb912cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:33.594570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad56a0-4f7d-4bef-8fc3-fd8bb912cfa0 admin admin] PATH_INFO: `/v3/projects/c3e12c033f2942c8b4d3af6c10841d30` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:33.607141 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad56a0-4f7d-4bef-8fc3-fd8bb912cfa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3e12c033f2942c8b4d3af6c10841d30)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:33.620208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad56a0-4f7d-4bef-8fc3-fd8bb912cfa0 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:33.652987 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-48b6016b-c586-49b2-b2a1-7ccca73d25d0 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:33.655369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-48b6016b-c586-49b2-b2a1-7ccca73d25d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:33.678801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 873/1753] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:53:33.682959 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6016b-c586-49b2-b2a1-7ccca73d25d0 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:33.702311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6016b-c586-49b2-b2a1-7ccca73d25d0 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:33.709668 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5dac33-53e1-42e8-a66d-eb493716747e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:33.710954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dac33-53e1-42e8-a66d-eb493716747e admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:33.711478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dac33-53e1-42e8-a66d-eb493716747e admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:33.711995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dac33-53e1-42e8-a66d-eb493716747e admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:33.712884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5dac33-53e1-42e8-a66d-eb493716747e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:53:33.713375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5dac33-53e1-42e8-a66d-eb493716747e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:33.716131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5dac33-53e1-42e8-a66d-eb493716747e admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:33.742149 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 874/1754] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:53:33.746301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5dac33-53e1-42e8-a66d-eb493716747e admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:33.797882 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5dac33-53e1-42e8-a66d-eb493716747e admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:33.828158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10883c-9496-4343-8723-39bf086b105e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:33.828922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10883c-9496-4343-8723-39bf086b105e admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:33.829557 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10883c-9496-4343-8723-39bf086b105e admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:33.829877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10883c-9496-4343-8723-39bf086b105e admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:33.830628 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10883c-9496-4343-8723-39bf086b105e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:33.847795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10883c-9496-4343-8723-39bf086b105e admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:33.917136 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-daad56a0-4f7d-4bef-8fc3-fd8bb912cfa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e12c033f2942c8b4d3af6c10841d30', 'request_id': 'req-daad56a0-4f7d-4bef-8fc3-fd8bb912cfa0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:33.936007 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-daad56a0-4f7d-4bef-8fc3-fd8bb912cfa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e12c033f2942c8b4d3af6c10841d30', 'request_id': 'req-daad56a0-4f7d-4bef-8fc3-fd8bb912cfa0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:33.959592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-daad56a0-4f7d-4bef-8fc3-fd8bb912cfa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e12c033f2942c8b4d3af6c10841d30', 'request_id': 'req-daad56a0-4f7d-4bef-8fc3-fd8bb912cfa0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:33.986949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 875/1755] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:33 2022] POST /identity/v3/projects => generated 399 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:33.994816 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10883c-9496-4343-8723-39bf086b105e admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:34.027858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-daad56a0-4f7d-4bef-8fc3-fd8bb912cfa0 admin admin] The token cache is being invalidate because project c3e12c033f2942c8b4d3af6c10841d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:34.029181 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-daad56a0-4f7d-4bef-8fc3-fd8bb912cfa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:34.031032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-daad56a0-4f7d-4bef-8fc3-fd8bb912cfa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:34.033331 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 881/1756] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:33 2022] DELETE /identity/v3/projects/c3e12c033f2942c8b4d3af6c10841d30 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:34.040936 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220dc38-06ee-4344-a4c1-3d80cbe7e35b None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:34.041415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220dc38-06ee-4344-a4c1-3d80cbe7e35b None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:34.041928 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220dc38-06ee-4344-a4c1-3d80cbe7e35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:34.098998 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-1220dc38-06ee-4344-a4c1-3d80cbe7e35b None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:34.100529 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1220dc38-06ee-4344-a4c1-3d80cbe7e35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:34.239149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:34.274170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 882/1757] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:34.276741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51111-1744-482e-bf27-a41ddb1dcb0d None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:34.277050 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51111-1744-482e-bf27-a41ddb1dcb0d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:34.277418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51111-1744-482e-bf27-a41ddb1dcb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:34.337201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-c5e51111-1744-482e-bf27-a41ddb1dcb0d None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:34.338751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c5e51111-1744-482e-bf27-a41ddb1dcb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:34.373172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 883/1758] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:34.374476 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10883c-9496-4343-8723-39bf086b105e admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:34.375237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b620d1f-0f53-4cb3-87cc-246c423d3217 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:34.375237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b620d1f-0f53-4cb3-87cc-246c423d3217 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:34.375544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b620d1f-0f53-4cb3-87cc-246c423d3217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:34.401650 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56724a-8c0d-42a3-aaf6-d34f941a24f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:34.403090 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56724a-8c0d-42a3-aaf6-d34f941a24f5 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:34.403750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56724a-8c0d-42a3-aaf6-d34f941a24f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:34.408629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56724a-8c0d-42a3-aaf6-d34f941a24f5 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:34.412940 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56724a-8c0d-42a3-aaf6-d34f941a24f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:34.428788 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56724a-8c0d-42a3-aaf6-d34f941a24f5 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:34.496369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-0b620d1f-0f53-4cb3-87cc-246c423d3217 None None] MFA Rules not processed for user `e1f49820de264982aeec97fa0be3c290`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:34.497945 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:34.499615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0b620d1f-0f53-4cb3-87cc-246c423d3217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:34.551390 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 876/1759] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:33 2022] POST /identity/v3/users => generated 300 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:34.555162 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56724a-8c0d-42a3-aaf6-d34f941a24f5 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:34.637065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56724a-8c0d-42a3-aaf6-d34f941a24f5 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:34.678068 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1d36d-d480-40d0-b9af-af37434043c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:34.679405 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1d36d-d480-40d0-b9af-af37434043c2 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:34.679775 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1d36d-d480-40d0-b9af-af37434043c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:34.686115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1d36d-d480-40d0-b9af-af37434043c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:34.687345 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1d36d-d480-40d0-b9af-af37434043c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:53:34.693700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1d36d-d480-40d0-b9af-af37434043c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:34.703492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1d36d-d480-40d0-b9af-af37434043c2 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:34.798907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 884/1760] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 23:53:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:34.800616 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 877/1761] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:53:34.801627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b620d1f-0f53-4cb3-87cc-246c423d3217 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:34.802866 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1d36d-d480-40d0-b9af-af37434043c2 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:34.806644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0b620d1f-0f53-4cb3-87cc-246c423d3217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:34.855980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1d36d-d480-40d0-b9af-af37434043c2 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:34.861235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b620d1f-0f53-4cb3-87cc-246c423d3217 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:34.875091 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c975d-cd4c-4484-9024-e1af2a7790c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:34.876110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c975d-cd4c-4484-9024-e1af2a7790c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:34.877226 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c975d-cd4c-4484-9024-e1af2a7790c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:34.878721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c975d-cd4c-4484-9024-e1af2a7790c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:34.879726 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c975d-cd4c-4484-9024-e1af2a7790c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:34.884601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c975d-cd4c-4484-9024-e1af2a7790c3 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:34.904611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2c940-3395-41f7-b97a-ee5cb786cf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:34.906494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2c940-3395-41f7-b97a-ee5cb786cf11 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:34.907330 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2c940-3395-41f7-b97a-ee5cb786cf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:34.907884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2c940-3395-41f7-b97a-ee5cb786cf11 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:34.910732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2c940-3395-41f7-b97a-ee5cb786cf11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:34.912176 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 885/1762] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:34.919639 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c975d-cd4c-4484-9024-e1af2a7790c3 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:34.928217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2c940-3395-41f7-b97a-ee5cb786cf11 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:34.960058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c975d-cd4c-4484-9024-e1af2a7790c3 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:34.974555 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07610d-2b0f-4a9d-b965-cbe23c0f18ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:34.975735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07610d-2b0f-4a9d-b965-cbe23c0f18ef admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:34.975735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07610d-2b0f-4a9d-b965-cbe23c0f18ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:34.978665 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07610d-2b0f-4a9d-b965-cbe23c0f18ef admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:34.979587 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07610d-2b0f-4a9d-b965-cbe23c0f18ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:34.983553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07610d-2b0f-4a9d-b965-cbe23c0f18ef admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:35.011576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 886/1763] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:35.012397 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07610d-2b0f-4a9d-b965-cbe23c0f18ef admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:35.014684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5d07610d-2b0f-4a9d-b965-cbe23c0f18ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:35.100044 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 878/1764] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:34 2022] POST /identity/v3/projects => generated 407 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:35.101715 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2c940-3395-41f7-b97a-ee5cb786cf11 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:35.267091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2c940-3395-41f7-b97a-ee5cb786cf11 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:35.273844 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c24dbb-85ae-454d-a450-3ea4b89ad7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:35.274874 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c24dbb-85ae-454d-a450-3ea4b89ad7cf admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:35.275296 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c24dbb-85ae-454d-a450-3ea4b89ad7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:35.276796 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c24dbb-85ae-454d-a450-3ea4b89ad7cf admin admin] PATH_INFO: `/v3/projects/adf1efe012c540f0817a7d36215753a0/users/684d684f8e62450d8f4bc33fbd47f484/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:35.299496 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c24dbb-85ae-454d-a450-3ea4b89ad7cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf1efe012c540f0817a7d36215753a0, user_id=684d684f8e62450d8f4bc33fbd47f484, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:35.304003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c24dbb-85ae-454d-a450-3ea4b89ad7cf admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:35.333173 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 879/1765] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:35 2022] PUT /identity/v3/projects/adf1efe012c540f0817a7d36215753a0/users/684d684f8e62450d8f4bc33fbd47f484/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:35.336357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c24dbb-85ae-454d-a450-3ea4b89ad7cf admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:35.354801 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07610d-2b0f-4a9d-b965-cbe23c0f18ef admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:35.438331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c24dbb-85ae-454d-a450-3ea4b89ad7cf admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:35.452759 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225f936-026c-483d-b066-77567733ca37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:35.453492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225f936-026c-483d-b066-77567733ca37 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:35.453790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225f936-026c-483d-b066-77567733ca37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:35.454066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225f936-026c-483d-b066-77567733ca37 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:35.454758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225f936-026c-483d-b066-77567733ca37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:35.456905 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225f936-026c-483d-b066-77567733ca37 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:35.467144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:35.529826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 880/1766] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:35 2022] POST /identity/v3/users => generated 304 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:35.531441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d12c5-aba2-4893-9fdd-5a881f5c4149 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:35.531734 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d12c5-aba2-4893-9fdd-5a881f5c4149 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:35.532600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d12c5-aba2-4893-9fdd-5a881f5c4149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:35.618370 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-339d12c5-aba2-4893-9fdd-5a881f5c4149 None None] MFA Rules not processed for user `684d684f8e62450d8f4bc33fbd47f484`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:35.621231 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2f6e4-6bf3-4a51-8372-bb3da3600f36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c45ae3144b4fe8ab4e921fda30164a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:35.621960 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-339d12c5-aba2-4893-9fdd-5a881f5c4149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:35.622693 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2f6e4-6bf3-4a51-8372-bb3da3600f36 service swift] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:35.623300 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2f6e4-6bf3-4a51-8372-bb3da3600f36 service swift] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:35.623901 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2f6e4-6bf3-4a51-8372-bb3da3600f36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:35.678861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:35.797927 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 881/1767] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:35 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:35.799404 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d12c5-aba2-4893-9fdd-5a881f5c4149 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:35.829088 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d12c5-aba2-4893-9fdd-5a881f5c4149 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:35.831212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2f6e4-6bf3-4a51-8372-bb3da3600f36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:35.833007 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2f6e4-6bf3-4a51-8372-bb3da3600f36 service swift] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:35.842839 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723e37f-502e-4d0a-a743-1d7c4b06382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:35.843488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723e37f-502e-4d0a-a743-1d7c4b06382c admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:35.843767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723e37f-502e-4d0a-a743-1d7c4b06382c admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:35.844034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723e37f-502e-4d0a-a743-1d7c4b06382c admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:35.844714 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723e37f-502e-4d0a-a743-1d7c4b06382c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:35.846411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723e37f-502e-4d0a-a743-1d7c4b06382c admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:35.860319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 887/1768] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 23:53:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 849 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:53:35.874535 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2f6e4-6bf3-4a51-8372-bb3da3600f36 service swift] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:35.876822 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-f8b2f6e4-6bf3-4a51-8372-bb3da3600f36 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:35.928136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 882/1769] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:35.952970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723e37f-502e-4d0a-a743-1d7c4b06382c admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:35.988569 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723e37f-502e-4d0a-a743-1d7c4b06382c admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:36.010047 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50935e24-1f7b-40df-91ed-83e4d0edba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:36.010698 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50935e24-1f7b-40df-91ed-83e4d0edba3c admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:36.011026 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50935e24-1f7b-40df-91ed-83e4d0edba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:36.011268 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50935e24-1f7b-40df-91ed-83e4d0edba3c admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:36.011899 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50935e24-1f7b-40df-91ed-83e4d0edba3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:36.021786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2f6e4-6bf3-4a51-8372-bb3da3600f36 service swift] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:36.026317 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50935e24-1f7b-40df-91ed-83e4d0edba3c admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:36.069747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2ab08-2737-4637-95ee-d32f94447972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:36.070876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2ab08-2737-4637-95ee-d32f94447972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:36.071389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2ab08-2737-4637-95ee-d32f94447972 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:36.076383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2ab08-2737-4637-95ee-d32f94447972 admin admin] PATH_INFO: `/v3/projects/642b8de2c45645bab2f853bb57c10b05` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:36.085243 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2ab08-2737-4637-95ee-d32f94447972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=642b8de2c45645bab2f853bb57c10b05)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:36.112106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2ab08-2737-4637-95ee-d32f94447972 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:36.247982 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 883/1770] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:35 2022] POST /identity/v3/projects => generated 401 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:36.262808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50935e24-1f7b-40df-91ed-83e4d0edba3c admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:36.386757 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-70a2ab08-2737-4637-95ee-d32f94447972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '642b8de2c45645bab2f853bb57c10b05', 'request_id': 'req-70a2ab08-2737-4637-95ee-d32f94447972'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:36.405980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-70a2ab08-2737-4637-95ee-d32f94447972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '642b8de2c45645bab2f853bb57c10b05', 'request_id': 'req-70a2ab08-2737-4637-95ee-d32f94447972'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:36.419035 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-70a2ab08-2737-4637-95ee-d32f94447972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '642b8de2c45645bab2f853bb57c10b05', 'request_id': 'req-70a2ab08-2737-4637-95ee-d32f94447972'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:36.457837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-70a2ab08-2737-4637-95ee-d32f94447972 admin admin] The token cache is being invalidate because project 642b8de2c45645bab2f853bb57c10b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:36.462246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-70a2ab08-2737-4637-95ee-d32f94447972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:36.464219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-70a2ab08-2737-4637-95ee-d32f94447972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:36.474131 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 888/1771] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:35 2022] DELETE /identity/v3/projects/642b8de2c45645bab2f853bb57c10b05 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:36.477977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2ab08-2737-4637-95ee-d32f94447972 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:36.482660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-70a2ab08-2737-4637-95ee-d32f94447972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:36.650904 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:36.728635 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50935e24-1f7b-40df-91ed-83e4d0edba3c admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:36.741986 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2ab08-2737-4637-95ee-d32f94447972 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:36.747642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd12196-3d15-45b3-bc4e-5c3d62695eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:36.748550 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd12196-3d15-45b3-bc4e-5c3d62695eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:36.748842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd12196-3d15-45b3-bc4e-5c3d62695eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:36.749117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd12196-3d15-45b3-bc4e-5c3d62695eb0 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:36.750193 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd12196-3d15-45b3-bc4e-5c3d62695eb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:36.752319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd12196-3d15-45b3-bc4e-5c3d62695eb0 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:36.759550 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e9c82-108a-49cf-824e-e2262e8ce6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:36.760610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e9c82-108a-49cf-824e-e2262e8ce6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:36.761043 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e9c82-108a-49cf-824e-e2262e8ce6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:36.764028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e9c82-108a-49cf-824e-e2262e8ce6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:36.766364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e9c82-108a-49cf-824e-e2262e8ce6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:36.777738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e9c82-108a-49cf-824e-e2262e8ce6c7 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:36.821089 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 889/1772] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:36 2022] POST /identity/v3/users => generated 307 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:36.822776 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c19e9-599a-46d8-b975-1767e058d0a9 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:36.823076 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c19e9-599a-46d8-b975-1767e058d0a9 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:36.823356 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c19e9-599a-46d8-b975-1767e058d0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:36.864274 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 884/1773] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 615 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:36.866418 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e9c82-108a-49cf-824e-e2262e8ce6c7 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:36.878386 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-990c19e9-599a-46d8-b975-1767e058d0a9 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:36.882754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-990c19e9-599a-46d8-b975-1767e058d0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:36.941732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e9c82-108a-49cf-824e-e2262e8ce6c7 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:36.943893 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 890/1774] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:36.947498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c19e9-599a-46d8-b975-1767e058d0a9 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:36.960656 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-990c19e9-599a-46d8-b975-1767e058d0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:36.985372 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4866d-498c-4892-9f99-342f422e3d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:36.994898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4866d-498c-4892-9f99-342f422e3d29 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:36.996160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4866d-498c-4892-9f99-342f422e3d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:37.002891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4866d-498c-4892-9f99-342f422e3d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:37.007211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4866d-498c-4892-9f99-342f422e3d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:37.016757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4866d-498c-4892-9f99-342f422e3d29 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:37.051792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c19e9-599a-46d8-b975-1767e058d0a9 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:37.075015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 885/1775] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:37.083191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a4873-31e9-4970-8eda-deee7526b49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:37.085248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a4873-31e9-4970-8eda-deee7526b49f admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:37.088428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a4873-31e9-4970-8eda-deee7526b49f admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:37.089191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a4873-31e9-4970-8eda-deee7526b49f admin admin] PATH_INFO: `/v3/projects/77b5ecf4c3f04277a1c007d8e243338d/users/37b4b482a4424c5ab14209030a233e00/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:37.092011 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5fe4f-4da0-482e-891f-6e4918086fe9 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:37.092903 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5fe4f-4da0-482e-891f-6e4918086fe9 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:37.094552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5fe4f-4da0-482e-891f-6e4918086fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:37.202707 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a4873-31e9-4970-8eda-deee7526b49f admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b5ecf4c3f04277a1c007d8e243338d, user_id=37b4b482a4424c5ab14209030a233e00, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:37.240456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a4873-31e9-4970-8eda-deee7526b49f admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:37.259569 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-38b5fe4f-4da0-482e-891f-6e4918086fe9 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:37.279057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-38b5fe4f-4da0-482e-891f-6e4918086fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:37.356527 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 891/1776] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:36 2022] PUT /identity/v3/projects/77b5ecf4c3f04277a1c007d8e243338d/users/37b4b482a4424c5ab14209030a233e00/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:37.373941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a4873-31e9-4970-8eda-deee7526b49f admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:37.803404 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 886/1777] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 724 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:37.813333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ef5f9-5e39-42e3-86a8-1976f826e1b1 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:37.813879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ef5f9-5e39-42e3-86a8-1976f826e1b1 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:37.830573 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ef5f9-5e39-42e3-86a8-1976f826e1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:37.872854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a4873-31e9-4970-8eda-deee7526b49f admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:37.891333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65362f-db3b-458c-9b56-b944d03a6db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:37.892897 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65362f-db3b-458c-9b56-b944d03a6db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:37.893582 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65362f-db3b-458c-9b56-b944d03a6db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:37.894230 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65362f-db3b-458c-9b56-b944d03a6db5 admin admin] PATH_INFO: `/v3/projects/6c774e77702e4dd991684be496243d9d/users/ca8efefc522f49dc968bce36e53ab9e1/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:37.962569 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65362f-db3b-458c-9b56-b944d03a6db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c774e77702e4dd991684be496243d9d, user_id=ca8efefc522f49dc968bce36e53ab9e1, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:37.972687 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:37.979212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65362f-db3b-458c-9b56-b944d03a6db5 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:37.987819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-920ef5f9-5e39-42e3-86a8-1976f826e1b1 None None] MFA Rules not processed for user `37b4b482a4424c5ab14209030a233e00`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:37.992480 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-920ef5f9-5e39-42e3-86a8-1976f826e1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:38.035959 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 892/1778] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:37 2022] PUT /identity/v3/projects/6c774e77702e4dd991684be496243d9d/users/ca8efefc522f49dc968bce36e53ab9e1/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:38.041272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65362f-db3b-458c-9b56-b944d03a6db5 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:38.282535 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65362f-db3b-458c-9b56-b944d03a6db5 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:38.290204 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6c3e8-8ba8-4337-9bf6-7993773d5965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:38.308448 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6c3e8-8ba8-4337-9bf6-7993773d5965 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:38.308890 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6c3e8-8ba8-4337-9bf6-7993773d5965 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:38.309235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 887/1779] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:37 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:38.309718 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6c3e8-8ba8-4337-9bf6-7993773d5965 admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:38.310358 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ef5f9-5e39-42e3-86a8-1976f826e1b1 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:38.310744 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6c3e8-8ba8-4337-9bf6-7993773d5965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:53:38.311481 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6c3e8-8ba8-4337-9bf6-7993773d5965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:38.313468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6c3e8-8ba8-4337-9bf6-7993773d5965 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:38.344363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 893/1780] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:53:38.345485 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6c3e8-8ba8-4337-9bf6-7993773d5965 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:38.348979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ef5f9-5e39-42e3-86a8-1976f826e1b1 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:38.362790 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6c3e8-8ba8-4337-9bf6-7993773d5965 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:38.373407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9b433-86ed-456b-83ec-6f3c0e9dd67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:38.374064 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9b433-86ed-456b-83ec-6f3c0e9dd67f admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:38.374345 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9b433-86ed-456b-83ec-6f3c0e9dd67f admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:38.374618 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9b433-86ed-456b-83ec-6f3c0e9dd67f admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:38.375300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9b433-86ed-456b-83ec-6f3c0e9dd67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:38.376984 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9b433-86ed-456b-83ec-6f3c0e9dd67f admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:38.379770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fde46-d6dc-4fa2-87a8-efda8f12844a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:38.381269 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fde46-d6dc-4fa2-87a8-efda8f12844a admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:38.384318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fde46-d6dc-4fa2-87a8-efda8f12844a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:38.384969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fde46-d6dc-4fa2-87a8-efda8f12844a admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:38.386046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fde46-d6dc-4fa2-87a8-efda8f12844a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:38.390644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fde46-d6dc-4fa2-87a8-efda8f12844a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:38.454828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 894/1781] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:38 2022] POST /identity/v3/projects => generated 409 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:38.456141 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fde46-d6dc-4fa2-87a8-efda8f12844a admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:38.470084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:38.481617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 888/1782] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:38.481617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9b433-86ed-456b-83ec-6f3c0e9dd67f admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:38.547832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9b433-86ed-456b-83ec-6f3c0e9dd67f admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:38.624153 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fde46-d6dc-4fa2-87a8-efda8f12844a admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:38.635288 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e77cf-720b-4562-996a-75e4888318ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:38.636452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e77cf-720b-4562-996a-75e4888318ad admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:38.636919 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e77cf-720b-4562-996a-75e4888318ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:38.637374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e77cf-720b-4562-996a-75e4888318ad admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:38.638918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e77cf-720b-4562-996a-75e4888318ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:38.641216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e77cf-720b-4562-996a-75e4888318ad admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:38.723668 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 895/1783] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:38 2022] POST /identity/v3/projects => generated 405 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:38.729095 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e77cf-720b-4562-996a-75e4888318ad admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:38.734450 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5efb89-373d-4d8a-b2fd-ef8a5998cbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:38.735100 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5efb89-373d-4d8a-b2fd-ef8a5998cbbc admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:38.735378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5efb89-373d-4d8a-b2fd-ef8a5998cbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:38.735644 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5efb89-373d-4d8a-b2fd-ef8a5998cbbc admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:38.736311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5efb89-373d-4d8a-b2fd-ef8a5998cbbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:38.745847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5efb89-373d-4d8a-b2fd-ef8a5998cbbc admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:38.809698 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 889/1784] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:38 2022] POST /identity/v3/users => generated 311 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:38.811346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5efb89-373d-4d8a-b2fd-ef8a5998cbbc admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:38.848949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5efb89-373d-4d8a-b2fd-ef8a5998cbbc admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:38.967658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e77cf-720b-4562-996a-75e4888318ad admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:38.994416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfdefb-ee58-4d64-b0e2-abe4a131816b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:38.995363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfdefb-ee58-4d64-b0e2-abe4a131816b admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:38.995723 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfdefb-ee58-4d64-b0e2-abe4a131816b admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:38.996195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfdefb-ee58-4d64-b0e2-abe4a131816b admin admin] PATH_INFO: `/v3/projects/6c774e77702e4dd991684be496243d9d/users/ca8efefc522f49dc968bce36e53ab9e1/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:39.000843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfdefb-ee58-4d64-b0e2-abe4a131816b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c774e77702e4dd991684be496243d9d, user_id=ca8efefc522f49dc968bce36e53ab9e1, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:39.004068 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfdefb-ee58-4d64-b0e2-abe4a131816b admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:39.044037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 896/1785] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:38 2022] PUT /identity/v3/projects/6c774e77702e4dd991684be496243d9d/users/ca8efefc522f49dc968bce36e53ab9e1/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:39.058743 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfdefb-ee58-4d64-b0e2-abe4a131816b admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:39.180307 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a6408-d239-4c50-840b-1ce510f061cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:39.181441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a6408-d239-4c50-840b-1ce510f061cc admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:39.181887 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a6408-d239-4c50-840b-1ce510f061cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:39.181887 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a6408-d239-4c50-840b-1ce510f061cc admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:39.183445 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a6408-d239-4c50-840b-1ce510f061cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:39.197466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a6408-d239-4c50-840b-1ce510f061cc admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:39.237258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfdefb-ee58-4d64-b0e2-abe4a131816b admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:39.252423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd218c8-75d2-4b81-9925-774bd5db7b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:39.253250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd218c8-75d2-4b81-9925-774bd5db7b99 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:39.253763 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd218c8-75d2-4b81-9925-774bd5db7b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:39.254794 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd218c8-75d2-4b81-9925-774bd5db7b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:39.255891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd218c8-75d2-4b81-9925-774bd5db7b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:39.259805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd218c8-75d2-4b81-9925-774bd5db7b99 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:39.290778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 897/1786] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:39.292521 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f032dc-e5e1-41be-9c08-5858e9a76248 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:39.292910 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f032dc-e5e1-41be-9c08-5858e9a76248 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:39.293289 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f032dc-e5e1-41be-9c08-5858e9a76248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:39.341146 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 890/1787] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:38 2022] POST /identity/v3/users => generated 303 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:39.344034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a6408-d239-4c50-840b-1ce510f061cc admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:39.355176 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-93f032dc-e5e1-41be-9c08-5858e9a76248 None None] MFA Rules not processed for user `ca8efefc522f49dc968bce36e53ab9e1`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:39.356722 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-93f032dc-e5e1-41be-9c08-5858e9a76248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:39.367797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:39.371895 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a6408-d239-4c50-840b-1ce510f061cc admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:39.384642 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96717368-d11c-453a-b705-1ae83012c5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:39.388409 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96717368-d11c-453a-b705-1ae83012c5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:39.388859 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96717368-d11c-453a-b705-1ae83012c5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:39.389375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96717368-d11c-453a-b705-1ae83012c5b3 admin admin] PATH_INFO: `/v3/projects/07334ad52a0b40a983834c75d9f37225/users/88a7f8b4760e4d55bcde59320d8c3075/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:39.418489 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:39.440665 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96717368-d11c-453a-b705-1ae83012c5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07334ad52a0b40a983834c75d9f37225, user_id=88a7f8b4760e4d55bcde59320d8c3075, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:39.445243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96717368-d11c-453a-b705-1ae83012c5b3 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:39.521595 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 891/1788] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:39 2022] PUT /identity/v3/projects/07334ad52a0b40a983834c75d9f37225/users/88a7f8b4760e4d55bcde59320d8c3075/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:39.526002 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96717368-d11c-453a-b705-1ae83012c5b3 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:39.743654 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 898/1789] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:39 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:39.743654 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f032dc-e5e1-41be-9c08-5858e9a76248 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:39.796246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f032dc-e5e1-41be-9c08-5858e9a76248 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:39.801086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96717368-d11c-453a-b705-1ae83012c5b3 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:39.820953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8ddee-0d96-4ddc-95ca-d4c9f5623e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:39.822193 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8ddee-0d96-4ddc-95ca-d4c9f5623e68 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:39.825528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8ddee-0d96-4ddc-95ca-d4c9f5623e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:39.826664 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bde166-f33b-43c0-8e1a-153c7abf766c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:39.826931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8ddee-0d96-4ddc-95ca-d4c9f5623e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:39.827328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bde166-f33b-43c0-8e1a-153c7abf766c admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:39.827523 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bde166-f33b-43c0-8e1a-153c7abf766c admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:39.827868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bde166-f33b-43c0-8e1a-153c7abf766c admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:39.828442 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bde166-f33b-43c0-8e1a-153c7abf766c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:39.830979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8ddee-0d96-4ddc-95ca-d4c9f5623e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:39.831319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bde166-f33b-43c0-8e1a-153c7abf766c admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:39.834495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8ddee-0d96-4ddc-95ca-d4c9f5623e68 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:39.879548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 892/1790] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:39.886711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 899/1791] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:39.886974 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8ddee-0d96-4ddc-95ca-d4c9f5623e68 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:39.888463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-69f8ddee-0d96-4ddc-95ca-d4c9f5623e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:39.889534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bde166-f33b-43c0-8e1a-153c7abf766c admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:39.932853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bde166-f33b-43c0-8e1a-153c7abf766c admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:39.979721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47172e5-0661-49af-b92e-418e253be3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:39.981119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47172e5-0661-49af-b92e-418e253be3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:39.981767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47172e5-0661-49af-b92e-418e253be3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:39.991519 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47172e5-0661-49af-b92e-418e253be3c3 admin admin] PATH_INFO: `/v3/projects/07334ad52a0b40a983834c75d9f37225/users/88a7f8b4760e4d55bcde59320d8c3075/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:40.004203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47172e5-0661-49af-b92e-418e253be3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07334ad52a0b40a983834c75d9f37225, user_id=88a7f8b4760e4d55bcde59320d8c3075, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:40.025595 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47172e5-0661-49af-b92e-418e253be3c3 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:40.098038 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 900/1792] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:39 2022] PUT /identity/v3/projects/07334ad52a0b40a983834c75d9f37225/users/88a7f8b4760e4d55bcde59320d8c3075/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:40.098038 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47172e5-0661-49af-b92e-418e253be3c3 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:40.123923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8ddee-0d96-4ddc-95ca-d4c9f5623e68 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:40.382805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f2b33-649f-4406-8d69-e92234e3674b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:40.383825 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f2b33-649f-4406-8d69-e92234e3674b service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:40.384302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f2b33-649f-4406-8d69-e92234e3674b service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:40.385983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f2b33-649f-4406-8d69-e92234e3674b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:40.461903 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47172e5-0661-49af-b92e-418e253be3c3 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:40.482602 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b78ee-b91d-412b-af37-aadae022722c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:40.484075 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b78ee-b91d-412b-af37-aadae022722c admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:40.484709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b78ee-b91d-412b-af37-aadae022722c admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:40.485260 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b78ee-b91d-412b-af37-aadae022722c admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:40.486902 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b78ee-b91d-412b-af37-aadae022722c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:40.492359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b78ee-b91d-412b-af37-aadae022722c admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:40.556412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 901/1793] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:40.558440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b5e31-fd5d-4bf3-b997-7d98ddee06d5 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:40.559495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b5e31-fd5d-4bf3-b997-7d98ddee06d5 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:40.560167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b5e31-fd5d-4bf3-b997-7d98ddee06d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:40.718883 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-a21b5e31-fd5d-4bf3-b997-7d98ddee06d5 None None] MFA Rules not processed for user `88a7f8b4760e4d55bcde59320d8c3075`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:40.732948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a21b5e31-fd5d-4bf3-b997-7d98ddee06d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:40.799709 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:40.864967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f2b33-649f-4406-8d69-e92234e3674b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:40.886971 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f2b33-649f-4406-8d69-e92234e3674b service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:40.979423 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 893/1794] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:39 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 1099 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:40.981193 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f2b33-649f-4406-8d69-e92234e3674b service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:40.997220 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7d6f2b33-649f-4406-8d69-e92234e3674b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:41.164062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f2b33-649f-4406-8d69-e92234e3674b service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:41.218751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33083a-823d-4b7f-9e4a-67727492782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:41.230065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33083a-823d-4b7f-9e4a-67727492782b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:41.231650 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33083a-823d-4b7f-9e4a-67727492782b admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:41.234432 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33083a-823d-4b7f-9e4a-67727492782b admin admin] PATH_INFO: `/v3/projects/bd3ca225ebe249098ba6cd7d027232f7` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:41.247868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33083a-823d-4b7f-9e4a-67727492782b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd3ca225ebe249098ba6cd7d027232f7)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:41.260199 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33083a-823d-4b7f-9e4a-67727492782b admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:41.329270 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:41.354143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 902/1795] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:40 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 799 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:41.357235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b5e31-fd5d-4bf3-b997-7d98ddee06d5 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:41.448832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b5e31-fd5d-4bf3-b997-7d98ddee06d5 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:41.483332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87948189-52a3-496d-9bd6-c07a500c6754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:41.487016 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87948189-52a3-496d-9bd6-c07a500c6754 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:41.491078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87948189-52a3-496d-9bd6-c07a500c6754 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:41.492499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87948189-52a3-496d-9bd6-c07a500c6754 admin admin] PATH_INFO: `/v3/projects/0f2017d8f06c4fa687a07db5817ecd15/users/11fcec09efe946c085ee14eb5099fb4b/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:41.586819 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87948189-52a3-496d-9bd6-c07a500c6754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2017d8f06c4fa687a07db5817ecd15, user_id=11fcec09efe946c085ee14eb5099fb4b, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:41.588429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0e33083a-823d-4b7f-9e4a-67727492782b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd3ca225ebe249098ba6cd7d027232f7', 'request_id': 'req-0e33083a-823d-4b7f-9e4a-67727492782b'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:41.597115 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87948189-52a3-496d-9bd6-c07a500c6754 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:41.619410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0e33083a-823d-4b7f-9e4a-67727492782b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd3ca225ebe249098ba6cd7d027232f7', 'request_id': 'req-0e33083a-823d-4b7f-9e4a-67727492782b'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:41.678738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0e33083a-823d-4b7f-9e4a-67727492782b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd3ca225ebe249098ba6cd7d027232f7', 'request_id': 'req-0e33083a-823d-4b7f-9e4a-67727492782b'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:41.681617 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 903/1796] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:41 2022] PUT /identity/v3/projects/0f2017d8f06c4fa687a07db5817ecd15/users/11fcec09efe946c085ee14eb5099fb4b/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:41.698139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87948189-52a3-496d-9bd6-c07a500c6754 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:41.766001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0e33083a-823d-4b7f-9e4a-67727492782b admin admin] The token cache is being invalidate because project bd3ca225ebe249098ba6cd7d027232f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:41.776970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0e33083a-823d-4b7f-9e4a-67727492782b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:41.780599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0e33083a-823d-4b7f-9e4a-67727492782b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:41.817218 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 894/1797] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:40 2022] DELETE /identity/v3/projects/bd3ca225ebe249098ba6cd7d027232f7 => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:41.841630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33083a-823d-4b7f-9e4a-67727492782b admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:41.851278 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0e33083a-823d-4b7f-9e4a-67727492782b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:41.907941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87948189-52a3-496d-9bd6-c07a500c6754 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:41.927469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a8481-0f71-47cf-b4a8-6c7fba1919c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:41.928604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a8481-0f71-47cf-b4a8-6c7fba1919c9 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:41.929065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a8481-0f71-47cf-b4a8-6c7fba1919c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:41.929549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a8481-0f71-47cf-b4a8-6c7fba1919c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:41.941599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-389a8481-0f71-47cf-b4a8-6c7fba1919c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:42.320325 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a8481-0f71-47cf-b4a8-6c7fba1919c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:42.331082 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a8481-0f71-47cf-b4a8-6c7fba1919c9 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:42.418454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 904/1798] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:41 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:42.421251 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceb0a3-fcb3-43fb-9216-4bec530f089f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:42.436956 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33083a-823d-4b7f-9e4a-67727492782b admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:42.461855 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceb0a3-fcb3-43fb-9216-4bec530f089f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:42.462924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ceb0a3-fcb3-43fb-9216-4bec530f089f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:42.466016 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12d7bb-c46f-4c23-b178-69790424906d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:42.466878 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12d7bb-c46f-4c23-b178-69790424906d service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:42.467334 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12d7bb-c46f-4c23-b178-69790424906d service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:42.467767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12d7bb-c46f-4c23-b178-69790424906d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:42.491493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ad12d7bb-c46f-4c23-b178-69790424906d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:42.556090 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-58ceb0a3-fcb3-43fb-9216-4bec530f089f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:42.563183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-58ceb0a3-fcb3-43fb-9216-4bec530f089f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:42.861031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12d7bb-c46f-4c23-b178-69790424906d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:42.864908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12d7bb-c46f-4c23-b178-69790424906d service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:42.914889 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 905/1799] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:42.915636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ceb0a3-fcb3-43fb-9216-4bec530f089f None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:42.919117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-58ceb0a3-fcb3-43fb-9216-4bec530f089f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:42.941487 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 895/1800] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:41 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 1124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:42.948597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c98dc-e551-4051-9801-7d349bb2252c None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:42.952172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c98dc-e551-4051-9801-7d349bb2252c None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:42.952830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c98dc-e551-4051-9801-7d349bb2252c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:42.994564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ceb0a3-fcb3-43fb-9216-4bec530f089f None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:43.030005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44298467-82bb-4eab-8d3c-79127a37574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:43.034084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44298467-82bb-4eab-8d3c-79127a37574d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:43.037140 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44298467-82bb-4eab-8d3c-79127a37574d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:43.037526 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44298467-82bb-4eab-8d3c-79127a37574d admin admin] PATH_INFO: `/v3/users/658c71d9d2df40da9a6c1f8c28d5ebef` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:43.045328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44298467-82bb-4eab-8d3c-79127a37574d admin admin] RBAC: Authorizing `identity:delete_user(user_id=658c71d9d2df40da9a6c1f8c28d5ebef)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:43.060736 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44298467-82bb-4eab-8d3c-79127a37574d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:43.115990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-c48c98dc-e551-4051-9801-7d349bb2252c None None] MFA Rules not processed for user `a3caf53b684542ac87474ab807b5fdcc`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:43.122360 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c48c98dc-e551-4051-9801-7d349bb2252c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:43.187520 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:43.262797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-44298467-82bb-4eab-8d3c-79127a37574d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658c71d9d2df40da9a6c1f8c28d5ebef'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:43.303095 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-44298467-82bb-4eab-8d3c-79127a37574d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658c71d9d2df40da9a6c1f8c28d5ebef'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:43.337595 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:43.364488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-44298467-82bb-4eab-8d3c-79127a37574d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658c71d9d2df40da9a6c1f8c28d5ebef'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:43.393036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-44298467-82bb-4eab-8d3c-79127a37574d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658c71d9d2df40da9a6c1f8c28d5ebef'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:43.395997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-44298467-82bb-4eab-8d3c-79127a37574d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658c71d9d2df40da9a6c1f8c28d5ebef'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:43.420585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 906/1801] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:42 2022] DELETE /identity/v3/users/658c71d9d2df40da9a6c1f8c28d5ebef => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:43.422002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df39c0-be15-4d84-abe4-8e9ec48f0a49 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:43.422296 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df39c0-be15-4d84-abe4-8e9ec48f0a49 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:43.422572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df39c0-be15-4d84-abe4-8e9ec48f0a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:43.474968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-a6df39c0-be15-4d84-abe4-8e9ec48f0a49 None None] MFA Rules not processed for user `a5814ac53752455697e050944b6d32b7`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:43.481010 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a6df39c0-be15-4d84-abe4-8e9ec48f0a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:43.645876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 907/1802] 10.222.0.44 () {58 vars in 1015 bytes} [Mon Sep 12 23:53:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:43.647922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df39c0-be15-4d84-abe4-8e9ec48f0a49 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:43.650727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a6df39c0-be15-4d84-abe4-8e9ec48f0a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:43.686752 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df39c0-be15-4d84-abe4-8e9ec48f0a49 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:43.701652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfc7a2-b081-488b-bac1-f0916e5c64ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:43.704362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfc7a2-b081-488b-bac1-f0916e5c64ed service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:43.706767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfc7a2-b081-488b-bac1-f0916e5c64ed service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:43.713304 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfc7a2-b081-488b-bac1-f0916e5c64ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:43.724111 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1bbfc7a2-b081-488b-bac1-f0916e5c64ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:43.731871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 896/1803] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 790 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:43.758510 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c98dc-e551-4051-9801-7d349bb2252c None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:44.035749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c98dc-e551-4051-9801-7d349bb2252c None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:44.044479 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6392df-9cc0-49bc-9d63-27122108377b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:44.048359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6392df-9cc0-49bc-9d63-27122108377b service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:44.049292 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6392df-9cc0-49bc-9d63-27122108377b service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:44.050398 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6392df-9cc0-49bc-9d63-27122108377b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:44.060829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfc7a2-b081-488b-bac1-f0916e5c64ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:44.062516 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfc7a2-b081-488b-bac1-f0916e5c64ed service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:44.088581 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6392df-9cc0-49bc-9d63-27122108377b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:44.092044 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6392df-9cc0-49bc-9d63-27122108377b service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:44.101557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 908/1804] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:44.102739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfc7a2-b081-488b-bac1-f0916e5c64ed service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:44.109927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1bbfc7a2-b081-488b-bac1-f0916e5c64ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:44.111397 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 897/1805] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:53:44.113061 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6392df-9cc0-49bc-9d63-27122108377b service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:44.117089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-1b6392df-9cc0-49bc-9d63-27122108377b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:44.152186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfc7a2-b081-488b-bac1-f0916e5c64ed service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:44.168540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff04150-0f54-42e5-ac16-63c0b671b891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:44.169248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff04150-0f54-42e5-ac16-63c0b671b891 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:44.169569 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff04150-0f54-42e5-ac16-63c0b671b891 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:44.169841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff04150-0f54-42e5-ac16-63c0b671b891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:44.190729 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff04150-0f54-42e5-ac16-63c0b671b891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:44.192078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff04150-0f54-42e5-ac16-63c0b671b891 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:44.222626 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 909/1806] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:44.328364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6392df-9cc0-49bc-9d63-27122108377b service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:44.340110 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68591773-816b-4994-abe7-bafc3510ed86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:44.342333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68591773-816b-4994-abe7-bafc3510ed86 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:44.343227 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68591773-816b-4994-abe7-bafc3510ed86 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:44.343871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68591773-816b-4994-abe7-bafc3510ed86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:44.347444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-68591773-816b-4994-abe7-bafc3510ed86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:44.551186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68591773-816b-4994-abe7-bafc3510ed86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:44.553155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68591773-816b-4994-abe7-bafc3510ed86 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:44.598609 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 898/1807] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:44 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:47.814705 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff04150-0f54-42e5-ac16-63c0b671b891 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:47.821854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-cff04150-0f54-42e5-ac16-63c0b671b891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:47.855010 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff04150-0f54-42e5-ac16-63c0b671b891 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:47.865216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b271e9e-a2ae-4ac4-85f2-1fbbdaf10fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:47.866943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b271e9e-a2ae-4ac4-85f2-1fbbdaf10fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:47.867259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b271e9e-a2ae-4ac4-85f2-1fbbdaf10fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:47.867512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b271e9e-a2ae-4ac4-85f2-1fbbdaf10fe3 admin admin] PATH_INFO: `/v3/projects/67c74643bcf14629b0df170c14a837dc` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:47.870543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b271e9e-a2ae-4ac4-85f2-1fbbdaf10fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c74643bcf14629b0df170c14a837dc)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:47.876415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b271e9e-a2ae-4ac4-85f2-1fbbdaf10fe3 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:47.959521 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:47.999663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-1b271e9e-a2ae-4ac4-85f2-1fbbdaf10fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c74643bcf14629b0df170c14a837dc', 'request_id': 'req-1b271e9e-a2ae-4ac4-85f2-1fbbdaf10fe3'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:48.018406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-1b271e9e-a2ae-4ac4-85f2-1fbbdaf10fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c74643bcf14629b0df170c14a837dc', 'request_id': 'req-1b271e9e-a2ae-4ac4-85f2-1fbbdaf10fe3'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:48.072421 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-1b271e9e-a2ae-4ac4-85f2-1fbbdaf10fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c74643bcf14629b0df170c14a837dc', 'request_id': 'req-1b271e9e-a2ae-4ac4-85f2-1fbbdaf10fe3'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:48.102505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-1b271e9e-a2ae-4ac4-85f2-1fbbdaf10fe3 admin admin] The token cache is being invalidate because project 67c74643bcf14629b0df170c14a837dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:48.102818 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-1b271e9e-a2ae-4ac4-85f2-1fbbdaf10fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:48.105924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-1b271e9e-a2ae-4ac4-85f2-1fbbdaf10fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:48.113421 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 910/1808] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:47 2022] DELETE /identity/v3/projects/67c74643bcf14629b0df170c14a837dc => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:48.115583 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb54b70-66e0-477f-a35d-3e075d4b6b48 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:48.118217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb54b70-66e0-477f-a35d-3e075d4b6b48 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:48.118703 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb54b70-66e0-477f-a35d-3e075d4b6b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:48.228144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-9bb54b70-66e0-477f-a35d-3e075d4b6b48 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:48.237569 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9bb54b70-66e0-477f-a35d-3e075d4b6b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:48.309901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:48.411170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 899/1809] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:53:48.415218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3e527-c867-4566-942d-6bfb540b6d79 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:48.415218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3e527-c867-4566-942d-6bfb540b6d79 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:48.415218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3e527-c867-4566-942d-6bfb540b6d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:48.462772 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-08b3e527-c867-4566-942d-6bfb540b6d79 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:48.464012 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-08b3e527-c867-4566-942d-6bfb540b6d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:48.486318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 911/1810] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:48.488977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb54b70-66e0-477f-a35d-3e075d4b6b48 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:48.542208 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb54b70-66e0-477f-a35d-3e075d4b6b48 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:48.572613 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baecd57-6137-4abc-b356-9ca7ccd11175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:48.576218 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baecd57-6137-4abc-b356-9ca7ccd11175 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:48.577103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baecd57-6137-4abc-b356-9ca7ccd11175 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:48.578438 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baecd57-6137-4abc-b356-9ca7ccd11175 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:48.583155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baecd57-6137-4abc-b356-9ca7ccd11175 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:53:48.584508 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baecd57-6137-4abc-b356-9ca7ccd11175 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:48.590689 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baecd57-6137-4abc-b356-9ca7ccd11175 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:48.660526 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 900/1811] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:53:48.666763 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3e527-c867-4566-942d-6bfb540b6d79 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:48.684225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3e527-c867-4566-942d-6bfb540b6d79 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:48.692250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e7fe5-b1cc-4a9e-909b-b882b595a284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:48.693278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e7fe5-b1cc-4a9e-909b-b882b595a284 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:48.693278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e7fe5-b1cc-4a9e-909b-b882b595a284 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:48.693527 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e7fe5-b1cc-4a9e-909b-b882b595a284 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:48.694165 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e7fe5-b1cc-4a9e-909b-b882b595a284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:48.697228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e7fe5-b1cc-4a9e-909b-b882b595a284 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:48.782869 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 912/1812] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:48 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:48.788534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baecd57-6137-4abc-b356-9ca7ccd11175 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:48.836412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baecd57-6137-4abc-b356-9ca7ccd11175 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:49.080157 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bf379-b61d-4272-aa96-d357fa050a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:49.083834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bf379-b61d-4272-aa96-d357fa050a74 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:49.084438 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bf379-b61d-4272-aa96-d357fa050a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:49.084888 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bf379-b61d-4272-aa96-d357fa050a74 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:49.086263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bf379-b61d-4272-aa96-d357fa050a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:49.093137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bf379-b61d-4272-aa96-d357fa050a74 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:49.153617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 901/1813] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:48 2022] POST /identity/v3/users => generated 291 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:49.156220 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e7fe5-b1cc-4a9e-909b-b882b595a284 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:49.174236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e7fe5-b1cc-4a9e-909b-b882b595a284 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:49.193657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efabe7-aeee-4021-bbc2-bc79c7b5ddb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:49.194120 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efabe7-aeee-4021-bbc2-bc79c7b5ddb3 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:49.194412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efabe7-aeee-4021-bbc2-bc79c7b5ddb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:49.194687 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efabe7-aeee-4021-bbc2-bc79c7b5ddb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:49.195374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efabe7-aeee-4021-bbc2-bc79c7b5ddb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:49.213881 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efabe7-aeee-4021-bbc2-bc79c7b5ddb3 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:49.253462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 913/1814] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:49.253462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efabe7-aeee-4021-bbc2-bc79c7b5ddb3 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:49.256489 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bf379-b61d-4272-aa96-d357fa050a74 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:49.260166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-2d7bf379-b61d-4272-aa96-d357fa050a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:49.280945 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efabe7-aeee-4021-bbc2-bc79c7b5ddb3 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:49.288464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bf379-b61d-4272-aa96-d357fa050a74 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:49.295358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073834c-8068-4d88-bcb6-b610cb5a330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:49.295988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e55834-f1a9-40c6-9608-6fc6204a9779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:49.296160 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073834c-8068-4d88-bcb6-b610cb5a330e admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:49.296406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073834c-8068-4d88-bcb6-b610cb5a330e admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:49.296777 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073834c-8068-4d88-bcb6-b610cb5a330e admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:49.297667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073834c-8068-4d88-bcb6-b610cb5a330e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:49.297936 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55834-f1a9-40c6-9608-6fc6204a9779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:49.298762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55834-f1a9-40c6-9608-6fc6204a9779 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:49.299317 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e55834-f1a9-40c6-9608-6fc6204a9779 admin admin] PATH_INFO: `/v3/users/684d684f8e62450d8f4bc33fbd47f484` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:49.300139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073834c-8068-4d88-bcb6-b610cb5a330e admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:49.303460 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e55834-f1a9-40c6-9608-6fc6204a9779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=684d684f8e62450d8f4bc33fbd47f484)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:49.306866 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e55834-f1a9-40c6-9608-6fc6204a9779 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:49.339798 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 914/1815] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:49.345845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073834c-8068-4d88-bcb6-b610cb5a330e admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:49.376113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073834c-8068-4d88-bcb6-b610cb5a330e admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:49.390211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39081e2-0445-4537-8c68-ad0b60002f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:49.391245 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39081e2-0445-4537-8c68-ad0b60002f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:49.391700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39081e2-0445-4537-8c68-ad0b60002f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:49.392141 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39081e2-0445-4537-8c68-ad0b60002f0b admin admin] PATH_INFO: `/v3/projects/3749d166354a4e9a85ee47fb0d05055a/users/a71e51e6f6e74424a4e974b9e7dd5837/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:49.396348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-b9e55834-f1a9-40c6-9608-6fc6204a9779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '684d684f8e62450d8f4bc33fbd47f484'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:49.397833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-b9e55834-f1a9-40c6-9608-6fc6204a9779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '684d684f8e62450d8f4bc33fbd47f484'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:49.398657 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-b9e55834-f1a9-40c6-9608-6fc6204a9779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '684d684f8e62450d8f4bc33fbd47f484'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:49.434455 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-b9e55834-f1a9-40c6-9608-6fc6204a9779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '684d684f8e62450d8f4bc33fbd47f484'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:49.448689 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-b9e55834-f1a9-40c6-9608-6fc6204a9779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '684d684f8e62450d8f4bc33fbd47f484'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:49.467321 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39081e2-0445-4537-8c68-ad0b60002f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3749d166354a4e9a85ee47fb0d05055a, user_id=a71e51e6f6e74424a4e974b9e7dd5837, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:49.483289 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39081e2-0445-4537-8c68-ad0b60002f0b admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:49.515291 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 902/1816] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:49 2022] DELETE /identity/v3/users/684d684f8e62450d8f4bc33fbd47f484 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:49.525845 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4426-83e4-4a67-8368-2a53e2eb20da None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:49.530043 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4426-83e4-4a67-8368-2a53e2eb20da None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:49.530754 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4426-83e4-4a67-8368-2a53e2eb20da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:49.566791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 915/1817] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:49 2022] PUT /identity/v3/projects/3749d166354a4e9a85ee47fb0d05055a/users/a71e51e6f6e74424a4e974b9e7dd5837/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:49.585363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87854815-44c2-418e-b0f3-bd9462301e80 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:49.586148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87854815-44c2-418e-b0f3-bd9462301e80 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:49.586854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87854815-44c2-418e-b0f3-bd9462301e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:49.591907 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-997d4426-83e4-4a67-8368-2a53e2eb20da None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:49.599306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-997d4426-83e4-4a67-8368-2a53e2eb20da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:49.625042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:49.666622 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-87854815-44c2-418e-b0f3-bd9462301e80 None None] MFA Rules not processed for user `a71e51e6f6e74424a4e974b9e7dd5837`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:49.673095 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-87854815-44c2-418e-b0f3-bd9462301e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:49.819563 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 903/1818] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:49.857422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 916/1819] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:53:49.860492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d4426-83e4-4a67-8368-2a53e2eb20da None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:49.862995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-997d4426-83e4-4a67-8368-2a53e2eb20da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:49.880603 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87854815-44c2-418e-b0f3-bd9462301e80 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:49.881835 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-87854815-44c2-418e-b0f3-bd9462301e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:49.958614 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d4426-83e4-4a67-8368-2a53e2eb20da None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:50.010254 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:50.019686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081f88b-f5a6-419b-bc3c-2c1bee7cfdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:50.020725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081f88b-f5a6-419b-bc3c-2c1bee7cfdc3 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:50.021247 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081f88b-f5a6-419b-bc3c-2c1bee7cfdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:50.021720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081f88b-f5a6-419b-bc3c-2c1bee7cfdc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:50.023122 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081f88b-f5a6-419b-bc3c-2c1bee7cfdc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:50.047030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081f88b-f5a6-419b-bc3c-2c1bee7cfdc3 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:50.109930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87854815-44c2-418e-b0f3-bd9462301e80 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:50.137177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0304e-3139-44ea-8c38-ffce2dbf625a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:50.140004 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0304e-3139-44ea-8c38-ffce2dbf625a service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:50.142217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0304e-3139-44ea-8c38-ffce2dbf625a service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:50.143793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0304e-3139-44ea-8c38-ffce2dbf625a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:50.180191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0304e-3139-44ea-8c38-ffce2dbf625a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:50.185084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0304e-3139-44ea-8c38-ffce2dbf625a service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:50.217472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 917/1820] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:53:50.307144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 904/1821] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:49 2022] POST /identity/v3/projects => generated 379 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:53:50.311617 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0304e-3139-44ea-8c38-ffce2dbf625a service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:50.332460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0304e-3139-44ea-8c38-ffce2dbf625a service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:50.675106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd51bb-93e0-4afb-988f-b8c922653df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:50.676109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd51bb-93e0-4afb-988f-b8c922653df1 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:50.691216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd51bb-93e0-4afb-988f-b8c922653df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:50.693506 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd51bb-93e0-4afb-988f-b8c922653df1 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:50.695299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd51bb-93e0-4afb-988f-b8c922653df1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:50.704850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd51bb-93e0-4afb-988f-b8c922653df1 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:50.797736 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 918/1822] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:50 2022] POST /identity/v3/users => generated 296 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:50.798578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081f88b-f5a6-419b-bc3c-2c1bee7cfdc3 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:50.839130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081f88b-f5a6-419b-bc3c-2c1bee7cfdc3 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:50.862588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12920b-49c8-406b-9b37-db1018cb4533 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:50.862982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12920b-49c8-406b-9b37-db1018cb4533 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:50.863360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12920b-49c8-406b-9b37-db1018cb4533 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:50.865442 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 919/1823] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 23:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:53:50.887985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbc7b0-a76a-4afa-a371-edb7418a7de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:50.888759 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbc7b0-a76a-4afa-a371-edb7418a7de5 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:50.889038 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbc7b0-a76a-4afa-a371-edb7418a7de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:50.897936 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbc7b0-a76a-4afa-a371-edb7418a7de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:50.916499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d7ada-21f5-4180-ba55-f101e1e1a7e7 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:50.916888 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d7ada-21f5-4180-ba55-f101e1e1a7e7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:50.917568 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d7ada-21f5-4180-ba55-f101e1e1a7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:50.921236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbc7b0-a76a-4afa-a371-edb7418a7de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:50.939280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbc7b0-a76a-4afa-a371-edb7418a7de5 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:50.994376 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-085d7ada-21f5-4180-ba55-f101e1e1a7e7 None None] MFA Rules not processed for user `4a87e18c89ff419f8e428e376d33462c`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:51.004732 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-085d7ada-21f5-4180-ba55-f101e1e1a7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:51.023572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 905/1824] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:51.028824 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbc7b0-a76a-4afa-a371-edb7418a7de5 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:51.086685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbc7b0-a76a-4afa-a371-edb7418a7de5 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:51.101258 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13c68e-84bf-49a9-8b21-45a0457a9e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:51.107194 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13c68e-84bf-49a9-8b21-45a0457a9e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:51.107547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13c68e-84bf-49a9-8b21-45a0457a9e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:51.107899 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13c68e-84bf-49a9-8b21-45a0457a9e25 admin admin] PATH_INFO: `/v3/projects/6cd2c9cb8b834275b2bee585b618e037/users/a416f4b0ad7d48da9e342c0b36ebbeae/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:51.149431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13c68e-84bf-49a9-8b21-45a0457a9e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd2c9cb8b834275b2bee585b618e037, user_id=a416f4b0ad7d48da9e342c0b36ebbeae, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:51.157264 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13c68e-84bf-49a9-8b21-45a0457a9e25 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:51.219302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 906/1825] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:51 2022] PUT /identity/v3/projects/6cd2c9cb8b834275b2bee585b618e037/users/a416f4b0ad7d48da9e342c0b36ebbeae/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:51.228598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13c68e-84bf-49a9-8b21-45a0457a9e25 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:51.358943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 920/1826] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 23:53:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:53:51.413980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e531a36-10ed-4295-9c6d-dbd189d3f953 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:51.414514 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e531a36-10ed-4295-9c6d-dbd189d3f953 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:51.416494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e531a36-10ed-4295-9c6d-dbd189d3f953 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:51.419729 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 921/1827] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 23:53:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:53:51.549364 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d504b-412f-4b4e-8743-1d53dada95e3 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:51.550222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d504b-412f-4b4e-8743-1d53dada95e3 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:51.550770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d504b-412f-4b4e-8743-1d53dada95e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:51.648969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-da7d504b-412f-4b4e-8743-1d53dada95e3 None None] MFA Rules not processed for user `4a87e18c89ff419f8e428e376d33462c`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:51.654761 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-da7d504b-412f-4b4e-8743-1d53dada95e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:51.707193 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13c68e-84bf-49a9-8b21-45a0457a9e25 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:51.716760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cd2c5-8639-4090-8ca6-0e35f5cb4ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:51.717841 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cd2c5-8639-4090-8ca6-0e35f5cb4ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:51.718501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cd2c5-8639-4090-8ca6-0e35f5cb4ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:51.719128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cd2c5-8639-4090-8ca6-0e35f5cb4ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:51.720502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cd2c5-8639-4090-8ca6-0e35f5cb4ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:51.723664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cd2c5-8639-4090-8ca6-0e35f5cb4ce0 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:51.755866 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 907/1828] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 531 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:51.761333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cd2c5-8639-4090-8ca6-0e35f5cb4ce0 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:51.797396 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cd2c5-8639-4090-8ca6-0e35f5cb4ce0 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:51.818948 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde437c-a9f8-4da8-8272-a018d5e45cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:51.820143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde437c-a9f8-4da8-8272-a018d5e45cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:51.821077 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde437c-a9f8-4da8-8272-a018d5e45cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:51.821974 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde437c-a9f8-4da8-8272-a018d5e45cb0 admin admin] PATH_INFO: `/v3/projects/6cd2c9cb8b834275b2bee585b618e037/users/a416f4b0ad7d48da9e342c0b36ebbeae/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:51.829257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde437c-a9f8-4da8-8272-a018d5e45cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd2c9cb8b834275b2bee585b618e037, user_id=a416f4b0ad7d48da9e342c0b36ebbeae, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:51.837914 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde437c-a9f8-4da8-8272-a018d5e45cb0 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:51.855274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:51.897259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 908/1829] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:51 2022] PUT /identity/v3/projects/6cd2c9cb8b834275b2bee585b618e037/users/a416f4b0ad7d48da9e342c0b36ebbeae/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:51.901673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0399d5c-f85a-4823-a190-38a8675d2ffa None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:51.902549 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0399d5c-f85a-4823-a190-38a8675d2ffa None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:51.903284 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0399d5c-f85a-4823-a190-38a8675d2ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:51.911349 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 922/1830] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 23:53:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:53:52.007975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-e0399d5c-f85a-4823-a190-38a8675d2ffa None None] MFA Rules not processed for user `a416f4b0ad7d48da9e342c0b36ebbeae`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:52.011148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e0399d5c-f85a-4823-a190-38a8675d2ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:52.097630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:52.127893 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d504b-412f-4b4e-8743-1d53dada95e3 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:52.131256 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-da7d504b-412f-4b4e-8743-1d53dada95e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:52.172594 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d504b-412f-4b4e-8743-1d53dada95e3 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:52.271958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 909/1831] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:53:52.289494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0399d5c-f85a-4823-a190-38a8675d2ffa None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:52.292153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e0399d5c-f85a-4823-a190-38a8675d2ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:52.408637 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0399d5c-f85a-4823-a190-38a8675d2ffa None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:52.419998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70077ac-6fde-43f3-a3d5-1bc9b8a097f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:52.421471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70077ac-6fde-43f3-a3d5-1bc9b8a097f6 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:52.423393 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70077ac-6fde-43f3-a3d5-1bc9b8a097f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:52.424562 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70077ac-6fde-43f3-a3d5-1bc9b8a097f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:52.425444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17cc9e-30b7-404d-967d-3bc86563acf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:52.427921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17cc9e-30b7-404d-967d-3bc86563acf4 service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:52.428588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17cc9e-30b7-404d-967d-3bc86563acf4 service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:52.437766 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17cc9e-30b7-404d-967d-3bc86563acf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:52.447901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70077ac-6fde-43f3-a3d5-1bc9b8a097f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:52.449434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70077ac-6fde-43f3-a3d5-1bc9b8a097f6 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:52.470491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 910/1832] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:52.472359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70077ac-6fde-43f3-a3d5-1bc9b8a097f6 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:52.478082 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f70077ac-6fde-43f3-a3d5-1bc9b8a097f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:52.489392 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17cc9e-30b7-404d-967d-3bc86563acf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:52.494129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17cc9e-30b7-404d-967d-3bc86563acf4 service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:52.544146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 923/1833] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:52.634569 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70077ac-6fde-43f3-a3d5-1bc9b8a097f6 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:52.651089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc63644-afd9-4fba-84c1-f704dd575045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:52.651840 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc63644-afd9-4fba-84c1-f704dd575045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:52.654136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc63644-afd9-4fba-84c1-f704dd575045 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:52.655172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc63644-afd9-4fba-84c1-f704dd575045 admin admin] PATH_INFO: `/v3/users/37b4b482a4424c5ab14209030a233e00` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:52.659057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc63644-afd9-4fba-84c1-f704dd575045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b4b482a4424c5ab14209030a233e00)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:52.665157 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc63644-afd9-4fba-84c1-f704dd575045 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:52.680623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17cc9e-30b7-404d-967d-3bc86563acf4 service nova] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:52.695540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17cc9e-30b7-404d-967d-3bc86563acf4 service nova] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:52.714561 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43670321-5393-4d21-a826-e7715fc50f41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:52.716315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43670321-5393-4d21-a826-e7715fc50f41 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:52.716722 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43670321-5393-4d21-a826-e7715fc50f41 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:52.717146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43670321-5393-4d21-a826-e7715fc50f41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:52.792096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-bfc63644-afd9-4fba-84c1-f704dd575045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b4b482a4424c5ab14209030a233e00'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:52.795474 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-bfc63644-afd9-4fba-84c1-f704dd575045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b4b482a4424c5ab14209030a233e00'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:52.797051 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-bfc63644-afd9-4fba-84c1-f704dd575045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b4b482a4424c5ab14209030a233e00'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:52.828329 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-bfc63644-afd9-4fba-84c1-f704dd575045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b4b482a4424c5ab14209030a233e00'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:52.835495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:52.842675 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-bfc63644-afd9-4fba-84c1-f704dd575045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b4b482a4424c5ab14209030a233e00'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:52.878455 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 911/1834] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:52 2022] DELETE /identity/v3/users/37b4b482a4424c5ab14209030a233e00 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:52.881297 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43670321-5393-4d21-a826-e7715fc50f41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:52.882750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafd4d2-bf76-4a6a-9bfa-7dbb1ba5abde None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:52.883308 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafd4d2-bf76-4a6a-9bfa-7dbb1ba5abde None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:52.883766 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafd4d2-bf76-4a6a-9bfa-7dbb1ba5abde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:52.886266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43670321-5393-4d21-a826-e7715fc50f41 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:52.902213 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 924/1835] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:52.921596 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43670321-5393-4d21-a826-e7715fc50f41 service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:52.946726 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43670321-5393-4d21-a826-e7715fc50f41 service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:52.950409 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-ddafd4d2-bf76-4a6a-9bfa-7dbb1ba5abde None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:52.959769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ddafd4d2-bf76-4a6a-9bfa-7dbb1ba5abde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:53.184987 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 912/1836] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:53.191097 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7420cc-dbd2-49d5-9053-ce19d01a0ef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:53.192178 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7420cc-dbd2-49d5-9053-ce19d01a0ef3 service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:53.192178 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7420cc-dbd2-49d5-9053-ce19d01a0ef3 service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:53.192368 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7420cc-dbd2-49d5-9053-ce19d01a0ef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:53.205818 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1e7420cc-dbd2-49d5-9053-ce19d01a0ef3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:53.236346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafd4d2-bf76-4a6a-9bfa-7dbb1ba5abde None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:53.238586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ddafd4d2-bf76-4a6a-9bfa-7dbb1ba5abde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:53.243987 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:53.254506 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7420cc-dbd2-49d5-9053-ce19d01a0ef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:53.257722 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7420cc-dbd2-49d5-9053-ce19d01a0ef3 service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:53.309534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 925/1837] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:53.372606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01624db-1062-4e56-94b4-309288edb8e3 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:53.373064 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01624db-1062-4e56-94b4-309288edb8e3 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:53.373529 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01624db-1062-4e56-94b4-309288edb8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:53.428985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafd4d2-bf76-4a6a-9bfa-7dbb1ba5abde None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:53.437603 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7103f-cc98-4c82-b53e-6fece4997e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:53.438733 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7103f-cc98-4c82-b53e-6fece4997e54 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:53.438733 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7103f-cc98-4c82-b53e-6fece4997e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:53.438972 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7103f-cc98-4c82-b53e-6fece4997e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:53.452306 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-c01624db-1062-4e56-94b4-309288edb8e3 None None] MFA Rules not processed for user `11fcec09efe946c085ee14eb5099fb4b`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:53.454234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c01624db-1062-4e56-94b4-309288edb8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:53.475827 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7103f-cc98-4c82-b53e-6fece4997e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:53.477711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7103f-cc98-4c82-b53e-6fece4997e54 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:53.491929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 913/1838] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:53.493721 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7103f-cc98-4c82-b53e-6fece4997e54 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:53.495288 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-07a7103f-cc98-4c82-b53e-6fece4997e54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:53.510637 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7103f-cc98-4c82-b53e-6fece4997e54 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:53.516727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9b411-9f98-4cc3-8a22-870f6934ef1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:53.517680 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9b411-9f98-4cc3-8a22-870f6934ef1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:53.518123 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9b411-9f98-4cc3-8a22-870f6934ef1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:53.518538 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9b411-9f98-4cc3-8a22-870f6934ef1a admin admin] PATH_INFO: `/v3/users/a71e51e6f6e74424a4e974b9e7dd5837` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:53.520001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9b411-9f98-4cc3-8a22-870f6934ef1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a71e51e6f6e74424a4e974b9e7dd5837)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:53.523266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9b411-9f98-4cc3-8a22-870f6934ef1a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:53.613582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-dfa9b411-9f98-4cc3-8a22-870f6934ef1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71e51e6f6e74424a4e974b9e7dd5837'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:53.614834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-dfa9b411-9f98-4cc3-8a22-870f6934ef1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71e51e6f6e74424a4e974b9e7dd5837'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:53.616320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-dfa9b411-9f98-4cc3-8a22-870f6934ef1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71e51e6f6e74424a4e974b9e7dd5837'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:53.630125 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 926/1839] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:53 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:53:53.635308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01624db-1062-4e56-94b4-309288edb8e3 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:53.638003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c01624db-1062-4e56-94b4-309288edb8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:53.652272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-dfa9b411-9f98-4cc3-8a22-870f6934ef1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71e51e6f6e74424a4e974b9e7dd5837'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:53.675653 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-dfa9b411-9f98-4cc3-8a22-870f6934ef1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71e51e6f6e74424a4e974b9e7dd5837'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:53.685503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01624db-1062-4e56-94b4-309288edb8e3 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:53.703309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 914/1840] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:53 2022] DELETE /identity/v3/users/a71e51e6f6e74424a4e974b9e7dd5837 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:53.710218 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433d927-82c8-4716-963b-3072e5cf20d8 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:53.710424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433d927-82c8-4716-963b-3072e5cf20d8 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:53.710724 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433d927-82c8-4716-963b-3072e5cf20d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:53.710951 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810cf81-df92-4442-85d2-9cc41d729f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:53.713830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810cf81-df92-4442-85d2-9cc41d729f92 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:53.714128 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810cf81-df92-4442-85d2-9cc41d729f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:53.714405 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810cf81-df92-4442-85d2-9cc41d729f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:53.717145 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810cf81-df92-4442-85d2-9cc41d729f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:53.722638 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810cf81-df92-4442-85d2-9cc41d729f92 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:53.729360 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:53.758994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-7433d927-82c8-4716-963b-3072e5cf20d8 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:53.763951 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7433d927-82c8-4716-963b-3072e5cf20d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:53.811144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 927/1841] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:53 2022] POST /identity/v3/projects => generated 403 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:53.829246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810cf81-df92-4442-85d2-9cc41d729f92 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:53.834162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6810cf81-df92-4442-85d2-9cc41d729f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:53.877439 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 915/1842] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:53.914873 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433d927-82c8-4716-963b-3072e5cf20d8 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:53.917847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7433d927-82c8-4716-963b-3072e5cf20d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:53.959763 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810cf81-df92-4442-85d2-9cc41d729f92 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:53.965375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4200a-97d6-4ab4-aba9-10ca48ddf127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:53.966025 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4200a-97d6-4ab4-aba9-10ca48ddf127 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:53.966304 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4200a-97d6-4ab4-aba9-10ca48ddf127 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:53.966574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4200a-97d6-4ab4-aba9-10ca48ddf127 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:53.967218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4200a-97d6-4ab4-aba9-10ca48ddf127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:53.969195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4200a-97d6-4ab4-aba9-10ca48ddf127 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:54.033700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 928/1843] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:53 2022] POST /identity/v3/users => generated 308 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:54.039126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4200a-97d6-4ab4-aba9-10ca48ddf127 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:54.062240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4200a-97d6-4ab4-aba9-10ca48ddf127 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:54.076876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7fb10-001c-4154-b5de-083485c56294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:54.082198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7fb10-001c-4154-b5de-083485c56294 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:54.082705 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7fb10-001c-4154-b5de-083485c56294 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:54.083156 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7fb10-001c-4154-b5de-083485c56294 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:54.084409 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7fb10-001c-4154-b5de-083485c56294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:54.091333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7fb10-001c-4154-b5de-083485c56294 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:54.122830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433d927-82c8-4716-963b-3072e5cf20d8 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:54.149267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 929/1844] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:54.151264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7fb10-001c-4154-b5de-083485c56294 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:54.184121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7fb10-001c-4154-b5de-083485c56294 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:54.203659 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c76193-a597-4c8c-8a09-93afba967370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:54.204375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76193-a597-4c8c-8a09-93afba967370 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:54.205737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76193-a597-4c8c-8a09-93afba967370 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:54.206066 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76193-a597-4c8c-8a09-93afba967370 admin admin] PATH_INFO: `/v3/projects/28e28440de3b4312b807c22947918578/users/0abf7deb9f764676a0d069d1927fdd2b/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:54.215754 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d2666-7111-4581-909b-caf80d2e6111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:54.216332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d2666-7111-4581-909b-caf80d2e6111 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:54.216616 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d2666-7111-4581-909b-caf80d2e6111 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:54.216882 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d2666-7111-4581-909b-caf80d2e6111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:54.240641 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d2666-7111-4581-909b-caf80d2e6111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:54.242567 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d2666-7111-4581-909b-caf80d2e6111 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:54.243786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c76193-a597-4c8c-8a09-93afba967370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e28440de3b4312b807c22947918578, user_id=0abf7deb9f764676a0d069d1927fdd2b, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:54.248298 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c76193-a597-4c8c-8a09-93afba967370 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:54.257427 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 916/1845] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:53:54.271741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 930/1846] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:54 2022] PUT /identity/v3/projects/28e28440de3b4312b807c22947918578/users/0abf7deb9f764676a0d069d1927fdd2b/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:54.275814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d2666-7111-4581-909b-caf80d2e6111 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:54.289104 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d2666-7111-4581-909b-caf80d2e6111 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:54.363776 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7192002-2ef9-4aff-8b41-fd9d7e25aa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:54.365439 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7192002-2ef9-4aff-8b41-fd9d7e25aa65 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:54.365932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7192002-2ef9-4aff-8b41-fd9d7e25aa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:54.366367 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7192002-2ef9-4aff-8b41-fd9d7e25aa65 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:54.367329 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7192002-2ef9-4aff-8b41-fd9d7e25aa65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:54.369723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7192002-2ef9-4aff-8b41-fd9d7e25aa65 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:54.372872 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:54.389737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 917/1847] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:54.391736 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c76193-a597-4c8c-8a09-93afba967370 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:54.417199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c76193-a597-4c8c-8a09-93afba967370 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:54.427363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ff552-d83a-4290-b007-7a1c79981418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:54.428468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff552-d83a-4290-b007-7a1c79981418 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:54.435867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff552-d83a-4290-b007-7a1c79981418 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:54.436538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ff552-d83a-4290-b007-7a1c79981418 admin admin] PATH_INFO: `/v3/projects/28e28440de3b4312b807c22947918578/users/0abf7deb9f764676a0d069d1927fdd2b/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:54.440127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ff552-d83a-4290-b007-7a1c79981418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e28440de3b4312b807c22947918578, user_id=0abf7deb9f764676a0d069d1927fdd2b, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:54.443577 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ff552-d83a-4290-b007-7a1c79981418 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:54.469467 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 931/1848] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:54 2022] PUT /identity/v3/projects/28e28440de3b4312b807c22947918578/users/0abf7deb9f764676a0d069d1927fdd2b/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:54.555996 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7192002-2ef9-4aff-8b41-fd9d7e25aa65 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:54.559042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c7192002-2ef9-4aff-8b41-fd9d7e25aa65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:54.620141 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7192002-2ef9-4aff-8b41-fd9d7e25aa65 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:54.738787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174f910-f0b9-45c5-8ac3-2ffa55605c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:54.739754 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174f910-f0b9-45c5-8ac3-2ffa55605c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:54.740101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174f910-f0b9-45c5-8ac3-2ffa55605c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:54.740467 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174f910-f0b9-45c5-8ac3-2ffa55605c93 admin admin] PATH_INFO: `/v3/projects/adf1efe012c540f0817a7d36215753a0` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:54.742326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174f910-f0b9-45c5-8ac3-2ffa55605c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf1efe012c540f0817a7d36215753a0)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:54.744867 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174f910-f0b9-45c5-8ac3-2ffa55605c93 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:54.821663 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5174f910-f0b9-45c5-8ac3-2ffa55605c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf1efe012c540f0817a7d36215753a0', 'request_id': 'req-5174f910-f0b9-45c5-8ac3-2ffa55605c93'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:54.829993 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5174f910-f0b9-45c5-8ac3-2ffa55605c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf1efe012c540f0817a7d36215753a0', 'request_id': 'req-5174f910-f0b9-45c5-8ac3-2ffa55605c93'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:54.840086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5174f910-f0b9-45c5-8ac3-2ffa55605c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf1efe012c540f0817a7d36215753a0', 'request_id': 'req-5174f910-f0b9-45c5-8ac3-2ffa55605c93'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:54.857771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5174f910-f0b9-45c5-8ac3-2ffa55605c93 admin admin] The token cache is being invalidate because project adf1efe012c540f0817a7d36215753a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:54.858079 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5174f910-f0b9-45c5-8ac3-2ffa55605c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:54.858824 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5174f910-f0b9-45c5-8ac3-2ffa55605c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:54.861383 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 918/1849] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:54 2022] DELETE /identity/v3/projects/adf1efe012c540f0817a7d36215753a0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:53:54.865544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ff552-d83a-4290-b007-7a1c79981418 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:54.867861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d69ff552-d83a-4290-b007-7a1c79981418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:54.883078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:54.891250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ff552-d83a-4290-b007-7a1c79981418 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:55.030575 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4038ce-61f4-4907-9a9f-6929caad79d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:55.032847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4038ce-61f4-4907-9a9f-6929caad79d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:55.032847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4038ce-61f4-4907-9a9f-6929caad79d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:55.033315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4038ce-61f4-4907-9a9f-6929caad79d2 admin admin] PATH_INFO: `/v3/users/ca8efefc522f49dc968bce36e53ab9e1` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:55.037167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4038ce-61f4-4907-9a9f-6929caad79d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca8efefc522f49dc968bce36e53ab9e1)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:55.079491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4038ce-61f4-4907-9a9f-6929caad79d2 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:55.121683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174f910-f0b9-45c5-8ac3-2ffa55605c93 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:55.124374 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5174f910-f0b9-45c5-8ac3-2ffa55605c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:55.189051 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174f910-f0b9-45c5-8ac3-2ffa55605c93 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:55.218100 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d104fc7-f958-44b7-9717-431debac80ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:55.218668 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d104fc7-f958-44b7-9717-431debac80ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:55.219166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d104fc7-f958-44b7-9717-431debac80ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:55.234345 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d104fc7-f958-44b7-9717-431debac80ab admin admin] PATH_INFO: `/v3/projects/77b5ecf4c3f04277a1c007d8e243338d` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:55.242510 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d104fc7-f958-44b7-9717-431debac80ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=77b5ecf4c3f04277a1c007d8e243338d)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:55.258701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d104fc7-f958-44b7-9717-431debac80ab admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:55.260992 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8f4038ce-61f4-4907-9a9f-6929caad79d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca8efefc522f49dc968bce36e53ab9e1'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.297947 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8f4038ce-61f4-4907-9a9f-6929caad79d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca8efefc522f49dc968bce36e53ab9e1'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.334321 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8f4038ce-61f4-4907-9a9f-6929caad79d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca8efefc522f49dc968bce36e53ab9e1'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.349823 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8f4038ce-61f4-4907-9a9f-6929caad79d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca8efefc522f49dc968bce36e53ab9e1'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.353430 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8f4038ce-61f4-4907-9a9f-6929caad79d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca8efefc522f49dc968bce36e53ab9e1'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.378150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 932/1850] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:54 2022] DELETE /identity/v3/users/ca8efefc522f49dc968bce36e53ab9e1 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:55.378150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4038ce-61f4-4907-9a9f-6929caad79d2 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:55.379453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-8f4038ce-61f4-4907-9a9f-6929caad79d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:55.399942 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0d104fc7-f958-44b7-9717-431debac80ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77b5ecf4c3f04277a1c007d8e243338d', 'request_id': 'req-0d104fc7-f958-44b7-9717-431debac80ab'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.421157 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0d104fc7-f958-44b7-9717-431debac80ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77b5ecf4c3f04277a1c007d8e243338d', 'request_id': 'req-0d104fc7-f958-44b7-9717-431debac80ab'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.447867 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0d104fc7-f958-44b7-9717-431debac80ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77b5ecf4c3f04277a1c007d8e243338d', 'request_id': 'req-0d104fc7-f958-44b7-9717-431debac80ab'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.473983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0d104fc7-f958-44b7-9717-431debac80ab admin admin] The token cache is being invalidate because project 77b5ecf4c3f04277a1c007d8e243338d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:55.474274 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0d104fc7-f958-44b7-9717-431debac80ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.475333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0d104fc7-f958-44b7-9717-431debac80ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.477265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 919/1851] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:55 2022] DELETE /identity/v3/projects/77b5ecf4c3f04277a1c007d8e243338d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:55.497928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d104fc7-f958-44b7-9717-431debac80ab admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:55.502628 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0d104fc7-f958-44b7-9717-431debac80ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:55.505308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4038ce-61f4-4907-9a9f-6929caad79d2 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:55.513183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af680b8e-3241-4e3f-8382-bed49e636f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:55.515940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af680b8e-3241-4e3f-8382-bed49e636f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:55.516482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af680b8e-3241-4e3f-8382-bed49e636f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:55.516822 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af680b8e-3241-4e3f-8382-bed49e636f40 admin admin] PATH_INFO: `/v3/projects/3749d166354a4e9a85ee47fb0d05055a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:55.518517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af680b8e-3241-4e3f-8382-bed49e636f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3749d166354a4e9a85ee47fb0d05055a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:55.520871 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af680b8e-3241-4e3f-8382-bed49e636f40 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:55.542491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:55.592687 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:55.626470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-af680b8e-3241-4e3f-8382-bed49e636f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3749d166354a4e9a85ee47fb0d05055a', 'request_id': 'req-af680b8e-3241-4e3f-8382-bed49e636f40'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.640055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-af680b8e-3241-4e3f-8382-bed49e636f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3749d166354a4e9a85ee47fb0d05055a', 'request_id': 'req-af680b8e-3241-4e3f-8382-bed49e636f40'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.649704 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d104fc7-f958-44b7-9717-431debac80ab admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:55.657632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-af680b8e-3241-4e3f-8382-bed49e636f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3749d166354a4e9a85ee47fb0d05055a', 'request_id': 'req-af680b8e-3241-4e3f-8382-bed49e636f40'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.678701 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-af680b8e-3241-4e3f-8382-bed49e636f40 admin admin] The token cache is being invalidate because project 3749d166354a4e9a85ee47fb0d05055a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:55.678992 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-af680b8e-3241-4e3f-8382-bed49e636f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.681145 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-af680b8e-3241-4e3f-8382-bed49e636f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.684283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 933/1852] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:55 2022] DELETE /identity/v3/projects/3749d166354a4e9a85ee47fb0d05055a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:55.702018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af680b8e-3241-4e3f-8382-bed49e636f40 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:55.706562 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-af680b8e-3241-4e3f-8382-bed49e636f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:55.837222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe5d0d-7e78-4c87-b5a2-f186c9a6d26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:55.838575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe5d0d-7e78-4c87-b5a2-f186c9a6d26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:55.839176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe5d0d-7e78-4c87-b5a2-f186c9a6d26e admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:55.840825 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe5d0d-7e78-4c87-b5a2-f186c9a6d26e admin admin] PATH_INFO: `/v3/users/88a7f8b4760e4d55bcde59320d8c3075` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:55.846785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe5d0d-7e78-4c87-b5a2-f186c9a6d26e admin admin] RBAC: Authorizing `identity:delete_user(user_id=88a7f8b4760e4d55bcde59320d8c3075)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:55.850910 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af680b8e-3241-4e3f-8382-bed49e636f40 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:55.857285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f073b-adda-4306-b09e-c1a88cc00639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:55.858112 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f073b-adda-4306-b09e-c1a88cc00639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:55.858392 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f073b-adda-4306-b09e-c1a88cc00639 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:55.858742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f073b-adda-4306-b09e-c1a88cc00639 admin admin] PATH_INFO: `/v3/users/a416f4b0ad7d48da9e342c0b36ebbeae` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:55.859326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe5d0d-7e78-4c87-b5a2-f186c9a6d26e admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:55.860409 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f073b-adda-4306-b09e-c1a88cc00639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a416f4b0ad7d48da9e342c0b36ebbeae)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:55.863176 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f073b-adda-4306-b09e-c1a88cc00639 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:55.975711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-152f073b-adda-4306-b09e-c1a88cc00639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a416f4b0ad7d48da9e342c0b36ebbeae'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.975711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-152f073b-adda-4306-b09e-c1a88cc00639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a416f4b0ad7d48da9e342c0b36ebbeae'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.986353 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-152f073b-adda-4306-b09e-c1a88cc00639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a416f4b0ad7d48da9e342c0b36ebbeae'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.989453 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e5fe5d0d-7e78-4c87-b5a2-f186c9a6d26e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88a7f8b4760e4d55bcde59320d8c3075'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.992075 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e5fe5d0d-7e78-4c87-b5a2-f186c9a6d26e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88a7f8b4760e4d55bcde59320d8c3075'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:55.994393 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e5fe5d0d-7e78-4c87-b5a2-f186c9a6d26e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88a7f8b4760e4d55bcde59320d8c3075'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:56.018869 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-152f073b-adda-4306-b09e-c1a88cc00639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a416f4b0ad7d48da9e342c0b36ebbeae'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:56.020372 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-152f073b-adda-4306-b09e-c1a88cc00639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a416f4b0ad7d48da9e342c0b36ebbeae'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:56.030425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e5fe5d0d-7e78-4c87-b5a2-f186c9a6d26e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88a7f8b4760e4d55bcde59320d8c3075'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:56.034290 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 934/1853] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:55 2022] DELETE /identity/v3/users/a416f4b0ad7d48da9e342c0b36ebbeae => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:56.043214 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e5fe5d0d-7e78-4c87-b5a2-f186c9a6d26e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88a7f8b4760e4d55bcde59320d8c3075'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:56.060106 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 920/1854] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:53:55 2022] DELETE /identity/v3/users/88a7f8b4760e4d55bcde59320d8c3075 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:56.765522 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f073b-adda-4306-b09e-c1a88cc00639 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:56.772399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-152f073b-adda-4306-b09e-c1a88cc00639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:56.849443 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:56.910402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f073b-adda-4306-b09e-c1a88cc00639 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:56.995450 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b36e6-d53e-47d3-b2b1-99a3a3ad8967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:56.996136 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b36e6-d53e-47d3-b2b1-99a3a3ad8967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:56.996418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b36e6-d53e-47d3-b2b1-99a3a3ad8967 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:56.996694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b36e6-d53e-47d3-b2b1-99a3a3ad8967 admin admin] PATH_INFO: `/v3/projects/6c774e77702e4dd991684be496243d9d` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:56.998657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b36e6-d53e-47d3-b2b1-99a3a3ad8967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c774e77702e4dd991684be496243d9d)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:57.001555 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b36e6-d53e-47d3-b2b1-99a3a3ad8967 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:57.101811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-142b36e6-d53e-47d3-b2b1-99a3a3ad8967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c774e77702e4dd991684be496243d9d', 'request_id': 'req-142b36e6-d53e-47d3-b2b1-99a3a3ad8967'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:57.116796 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-142b36e6-d53e-47d3-b2b1-99a3a3ad8967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c774e77702e4dd991684be496243d9d', 'request_id': 'req-142b36e6-d53e-47d3-b2b1-99a3a3ad8967'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:57.131299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-142b36e6-d53e-47d3-b2b1-99a3a3ad8967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c774e77702e4dd991684be496243d9d', 'request_id': 'req-142b36e6-d53e-47d3-b2b1-99a3a3ad8967'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:57.169421 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-142b36e6-d53e-47d3-b2b1-99a3a3ad8967 admin admin] The token cache is being invalidate because project 6c774e77702e4dd991684be496243d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:57.170600 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-142b36e6-d53e-47d3-b2b1-99a3a3ad8967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:57.170600 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-142b36e6-d53e-47d3-b2b1-99a3a3ad8967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:57.172730 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 935/1855] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:56 2022] DELETE /identity/v3/projects/6c774e77702e4dd991684be496243d9d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:57.179092 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce5386-ca32-4587-a328-e0e98eea8016 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:57.180033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce5386-ca32-4587-a328-e0e98eea8016 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:57.180033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce5386-ca32-4587-a328-e0e98eea8016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:57.206585 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-27ce5386-ca32-4587-a328-e0e98eea8016 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:57.208162 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-27ce5386-ca32-4587-a328-e0e98eea8016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:57.257900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:57.303946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 921/1856] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:53:57.313610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7cdfb-4735-4f65-a88f-cd3059180f0c None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:57.314454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7cdfb-4735-4f65-a88f-cd3059180f0c None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:57.315903 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7cdfb-4735-4f65-a88f-cd3059180f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:57.343713 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff950a1e-9433-446d-902d-9eba664d87ca None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:57.344801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff950a1e-9433-446d-902d-9eba664d87ca None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:57.345227 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff950a1e-9433-446d-902d-9eba664d87ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:57.366417 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-b3f7cdfb-4735-4f65-a88f-cd3059180f0c None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:57.369551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b3f7cdfb-4735-4f65-a88f-cd3059180f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:57.412546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-ff950a1e-9433-446d-902d-9eba664d87ca None None] MFA Rules not processed for user `0abf7deb9f764676a0d069d1927fdd2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:57.415079 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ff950a1e-9433-446d-902d-9eba664d87ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:57.446329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 936/1857] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:57.451542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7cdfb-4735-4f65-a88f-cd3059180f0c None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:57.480235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7cdfb-4735-4f65-a88f-cd3059180f0c None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:57.490517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefca83-d483-4a89-914d-d486ef9f3e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:57.491371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefca83-d483-4a89-914d-d486ef9f3e8f admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:57.491726 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefca83-d483-4a89-914d-d486ef9f3e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:57.492198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefca83-d483-4a89-914d-d486ef9f3e8f admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:57.493227 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefca83-d483-4a89-914d-d486ef9f3e8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:53:57.493984 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefca83-d483-4a89-914d-d486ef9f3e8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:57.510959 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefca83-d483-4a89-914d-d486ef9f3e8f admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:57.543219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 922/1858] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:57 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:57.562473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 937/1859] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:53:57.567278 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff950a1e-9433-446d-902d-9eba664d87ca None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:57.580862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff950a1e-9433-446d-902d-9eba664d87ca None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:57.587500 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021456f-c81e-40e7-a86b-b78a552eadd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:57.588147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021456f-c81e-40e7-a86b-b78a552eadd4 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:57.588976 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021456f-c81e-40e7-a86b-b78a552eadd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:57.589268 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021456f-c81e-40e7-a86b-b78a552eadd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:57.590048 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021456f-c81e-40e7-a86b-b78a552eadd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:57.592082 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021456f-c81e-40e7-a86b-b78a552eadd4 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:57.629502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 923/1860] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:57 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:57.632405 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefca83-d483-4a89-914d-d486ef9f3e8f admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:57.645466 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefca83-d483-4a89-914d-d486ef9f3e8f admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:57.716430 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:57.746782 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac44aa1-b29e-4a66-844f-aed0c4e1af6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:57.748283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac44aa1-b29e-4a66-844f-aed0c4e1af6d admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:57.748985 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac44aa1-b29e-4a66-844f-aed0c4e1af6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:57.750363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac44aa1-b29e-4a66-844f-aed0c4e1af6d admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:57.751948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac44aa1-b29e-4a66-844f-aed0c4e1af6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:57.756315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac44aa1-b29e-4a66-844f-aed0c4e1af6d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:57.803238 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 938/1861] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:57 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:57.804954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021456f-c81e-40e7-a86b-b78a552eadd4 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:57.820349 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021456f-c81e-40e7-a86b-b78a552eadd4 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:57.828775 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e302fb-c67f-4a40-a9da-b702c1948d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:57.829684 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e302fb-c67f-4a40-a9da-b702c1948d6f admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:57.830098 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e302fb-c67f-4a40-a9da-b702c1948d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:57.830496 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e302fb-c67f-4a40-a9da-b702c1948d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:57.831491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e302fb-c67f-4a40-a9da-b702c1948d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:57.834200 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e302fb-c67f-4a40-a9da-b702c1948d6f admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:57.853227 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 924/1862] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:53:57.857474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac44aa1-b29e-4a66-844f-aed0c4e1af6d admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:57.874408 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac44aa1-b29e-4a66-844f-aed0c4e1af6d admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:57.879986 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b77fcc-9b97-454a-9eab-badde9d9b727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:57.880534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b77fcc-9b97-454a-9eab-badde9d9b727 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:57.880809 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b77fcc-9b97-454a-9eab-badde9d9b727 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:57.881132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b77fcc-9b97-454a-9eab-badde9d9b727 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:57.882027 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b77fcc-9b97-454a-9eab-badde9d9b727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:57.883801 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b77fcc-9b97-454a-9eab-badde9d9b727 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:57.897255 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 939/1863] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:57.901982 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e302fb-c67f-4a40-a9da-b702c1948d6f admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:57.914114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e302fb-c67f-4a40-a9da-b702c1948d6f admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:57.920703 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c9334-8122-4168-a8b6-e207629962a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:57.921440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c9334-8122-4168-a8b6-e207629962a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:57.921722 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c9334-8122-4168-a8b6-e207629962a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:57.921988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c9334-8122-4168-a8b6-e207629962a0 admin admin] PATH_INFO: `/v3/projects/fb97eefeb534497c86d89963cb11d035/users/81fef50fe75f486e946974dc6a247e3c/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:57.952197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c9334-8122-4168-a8b6-e207629962a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb97eefeb534497c86d89963cb11d035, user_id=81fef50fe75f486e946974dc6a247e3c, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:57.955084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c9334-8122-4168-a8b6-e207629962a0 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:57.997393 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 925/1864] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:57 2022] PUT /identity/v3/projects/fb97eefeb534497c86d89963cb11d035/users/81fef50fe75f486e946974dc6a247e3c/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:58.017071 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d14ec-1729-41a9-8275-b11ae9938bd2 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:58.017443 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d14ec-1729-41a9-8275-b11ae9938bd2 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:58.017900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d14ec-1729-41a9-8275-b11ae9938bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:58.065206 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-103d14ec-1729-41a9-8275-b11ae9938bd2 None None] MFA Rules not processed for user `81fef50fe75f486e946974dc6a247e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:58.066946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-103d14ec-1729-41a9-8275-b11ae9938bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:58.227905 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c9334-8122-4168-a8b6-e207629962a0 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:58.239684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 940/1865] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:58.398233 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c9334-8122-4168-a8b6-e207629962a0 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:58.407513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0835e6b-8cd0-4fe4-a34a-d3a05afae0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:58.408833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0835e6b-8cd0-4fe4-a34a-d3a05afae0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:58.409519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0835e6b-8cd0-4fe4-a34a-d3a05afae0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:58.410132 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0835e6b-8cd0-4fe4-a34a-d3a05afae0c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:58.411623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0835e6b-8cd0-4fe4-a34a-d3a05afae0c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:58.417798 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0835e6b-8cd0-4fe4-a34a-d3a05afae0c5 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:58.444060 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:58.509518 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 926/1866] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:58 2022] POST /identity/v3/projects => generated 385 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:58.510348 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d14ec-1729-41a9-8275-b11ae9938bd2 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:58.548711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d14ec-1729-41a9-8275-b11ae9938bd2 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:58.712132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef5e30-2275-44ef-8c09-3650e6db6f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:58.712132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef5e30-2275-44ef-8c09-3650e6db6f3c admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:58.712543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef5e30-2275-44ef-8c09-3650e6db6f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:58.713081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef5e30-2275-44ef-8c09-3650e6db6f3c admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:58.713981 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef5e30-2275-44ef-8c09-3650e6db6f3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:58.718410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef5e30-2275-44ef-8c09-3650e6db6f3c admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:58.765329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 941/1867] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:58 2022] POST /identity/v3/users => generated 299 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:58.769026 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0835e6b-8cd0-4fe4-a34a-d3a05afae0c5 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:58.795910 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0835e6b-8cd0-4fe4-a34a-d3a05afae0c5 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:58.806386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbac0f-c431-435a-8e72-46b5085a1120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:58.807962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbac0f-c431-435a-8e72-46b5085a1120 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:58.810987 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbac0f-c431-435a-8e72-46b5085a1120 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:58.811924 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbac0f-c431-435a-8e72-46b5085a1120 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:58.814929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbac0f-c431-435a-8e72-46b5085a1120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:58.817296 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbac0f-c431-435a-8e72-46b5085a1120 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:58.839275 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 927/1868] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:58.839536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef5e30-2275-44ef-8c09-3650e6db6f3c admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:58.855955 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef5e30-2275-44ef-8c09-3650e6db6f3c admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:58.863471 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19aa88-83a0-4e8d-9027-d07bad2b1afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:58.867042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19aa88-83a0-4e8d-9027-d07bad2b1afd admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:58.867491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19aa88-83a0-4e8d-9027-d07bad2b1afd admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:58.868423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19aa88-83a0-4e8d-9027-d07bad2b1afd admin admin] PATH_INFO: `/v3/projects/c04d4aa44ea648e295166d8b060b7413/users/91ad70f3ebdc489d8a5bce67677132b0/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:58.902868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19aa88-83a0-4e8d-9027-d07bad2b1afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04d4aa44ea648e295166d8b060b7413, user_id=91ad70f3ebdc489d8a5bce67677132b0, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:58.907172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19aa88-83a0-4e8d-9027-d07bad2b1afd admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:58.930843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 942/1869] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:58 2022] PUT /identity/v3/projects/c04d4aa44ea648e295166d8b060b7413/users/91ad70f3ebdc489d8a5bce67677132b0/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:53:58.932381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbac0f-c431-435a-8e72-46b5085a1120 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:58.944425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19aa88-83a0-4e8d-9027-d07bad2b1afd admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:58.947247 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbac0f-c431-435a-8e72-46b5085a1120 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:58.950869 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0f19aa88-83a0-4e8d-9027-d07bad2b1afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:59.031632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:59.051219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011cfa3-6222-456f-b668-c0731ba56324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:59.052337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011cfa3-6222-456f-b668-c0731ba56324 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:59.054274 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011cfa3-6222-456f-b668-c0731ba56324 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:59.054549 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011cfa3-6222-456f-b668-c0731ba56324 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:59.055351 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011cfa3-6222-456f-b668-c0731ba56324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:59.057146 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011cfa3-6222-456f-b668-c0731ba56324 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:59.087765 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 928/1870] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:53:59.089425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011cfa3-6222-456f-b668-c0731ba56324 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:59.092443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f011cfa3-6222-456f-b668-c0731ba56324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:59.107956 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011cfa3-6222-456f-b668-c0731ba56324 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:59.128838 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da910a0e-1c84-4f71-b923-37396f48c627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:59.130666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da910a0e-1c84-4f71-b923-37396f48c627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:59.131026 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da910a0e-1c84-4f71-b923-37396f48c627 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:59.131298 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da910a0e-1c84-4f71-b923-37396f48c627 admin admin] PATH_INFO: `/v3/projects/6cd2c9cb8b834275b2bee585b618e037` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:59.132878 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da910a0e-1c84-4f71-b923-37396f48c627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd2c9cb8b834275b2bee585b618e037)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:59.135240 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da910a0e-1c84-4f71-b923-37396f48c627 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:59.141771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19aa88-83a0-4e8d-9027-d07bad2b1afd admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:59.154992 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b6ccb-78b2-4c9c-97d6-7d6e0927095a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:59.156392 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b6ccb-78b2-4c9c-97d6-7d6e0927095a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:59.157048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b6ccb-78b2-4c9c-97d6-7d6e0927095a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:59.158038 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b6ccb-78b2-4c9c-97d6-7d6e0927095a admin admin] PATH_INFO: `/v3/projects/07334ad52a0b40a983834c75d9f37225` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:59.160184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b6ccb-78b2-4c9c-97d6-7d6e0927095a admin admin] RBAC: Authorizing `identity:delete_project(project_id=07334ad52a0b40a983834c75d9f37225)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:59.168859 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b6ccb-78b2-4c9c-97d6-7d6e0927095a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:59.216322 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-da910a0e-1c84-4f71-b923-37396f48c627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd2c9cb8b834275b2bee585b618e037', 'request_id': 'req-da910a0e-1c84-4f71-b923-37396f48c627'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:59.223196 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-da910a0e-1c84-4f71-b923-37396f48c627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd2c9cb8b834275b2bee585b618e037', 'request_id': 'req-da910a0e-1c84-4f71-b923-37396f48c627'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:59.232283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e66b6ccb-78b2-4c9c-97d6-7d6e0927095a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07334ad52a0b40a983834c75d9f37225', 'request_id': 'req-e66b6ccb-78b2-4c9c-97d6-7d6e0927095a'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:59.233089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-da910a0e-1c84-4f71-b923-37396f48c627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd2c9cb8b834275b2bee585b618e037', 'request_id': 'req-da910a0e-1c84-4f71-b923-37396f48c627'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:59.245991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e66b6ccb-78b2-4c9c-97d6-7d6e0927095a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07334ad52a0b40a983834c75d9f37225', 'request_id': 'req-e66b6ccb-78b2-4c9c-97d6-7d6e0927095a'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:59.248006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-da910a0e-1c84-4f71-b923-37396f48c627 admin admin] The token cache is being invalidate because project 6cd2c9cb8b834275b2bee585b618e037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:59.248503 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-da910a0e-1c84-4f71-b923-37396f48c627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:59.251855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-da910a0e-1c84-4f71-b923-37396f48c627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:59.254066 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 929/1871] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:59 2022] DELETE /identity/v3/projects/6cd2c9cb8b834275b2bee585b618e037 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:59.254908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da910a0e-1c84-4f71-b923-37396f48c627 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:59.256528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-da910a0e-1c84-4f71-b923-37396f48c627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:59.262251 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e66b6ccb-78b2-4c9c-97d6-7d6e0927095a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07334ad52a0b40a983834c75d9f37225', 'request_id': 'req-e66b6ccb-78b2-4c9c-97d6-7d6e0927095a'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:59.284263 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e66b6ccb-78b2-4c9c-97d6-7d6e0927095a admin admin] The token cache is being invalidate because project 07334ad52a0b40a983834c75d9f37225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:53:59.284749 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e66b6ccb-78b2-4c9c-97d6-7d6e0927095a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:59.285917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e66b6ccb-78b2-4c9c-97d6-7d6e0927095a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:53:59.288575 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 943/1872] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:53:58 2022] DELETE /identity/v3/projects/07334ad52a0b40a983834c75d9f37225 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:59.291143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade32f7-0df1-4631-bc39-5d9f57b9969e None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:59.291515 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade32f7-0df1-4631-bc39-5d9f57b9969e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:59.292012 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade32f7-0df1-4631-bc39-5d9f57b9969e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:59.326703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-3ade32f7-0df1-4631-bc39-5d9f57b9969e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:59.328720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3ade32f7-0df1-4631-bc39-5d9f57b9969e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:59.351047 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da910a0e-1c84-4f71-b923-37396f48c627 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:59.357091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:59.490025 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 944/1873] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:59.491971 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcb6e2-d586-4fb9-b7a9-5e2db022553f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:59.492470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcb6e2-d586-4fb9-b7a9-5e2db022553f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:59.493987 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcb6e2-d586-4fb9-b7a9-5e2db022553f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:59.507300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f77344-5729-4813-9650-f19d6a5b8350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:59.509036 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f77344-5729-4813-9650-f19d6a5b8350 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:59.509886 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f77344-5729-4813-9650-f19d6a5b8350 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:59.510453 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f77344-5729-4813-9650-f19d6a5b8350 admin admin] PATH_INFO: `/v3/projects/c04d4aa44ea648e295166d8b060b7413/users/91ad70f3ebdc489d8a5bce67677132b0/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:59.515339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f77344-5729-4813-9650-f19d6a5b8350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04d4aa44ea648e295166d8b060b7413, user_id=91ad70f3ebdc489d8a5bce67677132b0, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:59.521673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f77344-5729-4813-9650-f19d6a5b8350 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:59.527395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-bfbcb6e2-d586-4fb9-b7a9-5e2db022553f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:59.529033 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-bfbcb6e2-d586-4fb9-b7a9-5e2db022553f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:59.545544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 930/1874] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:53:59 2022] PUT /identity/v3/projects/c04d4aa44ea648e295166d8b060b7413/users/91ad70f3ebdc489d8a5bce67677132b0/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:53:59.545544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340520f-325e-4182-9d7f-62e942c9f2ea None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:59.545544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340520f-325e-4182-9d7f-62e942c9f2ea None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:59.545544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340520f-325e-4182-9d7f-62e942c9f2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:59.547003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 945/1875] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:59.548481 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fd7b7-f973-4ec6-9c04-8c506dd89260 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:59.548848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fd7b7-f973-4ec6-9c04-8c506dd89260 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:59.549194 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fd7b7-f973-4ec6-9c04-8c506dd89260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:59.577820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-7340520f-325e-4182-9d7f-62e942c9f2ea None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:59.579347 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7340520f-325e-4182-9d7f-62e942c9f2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:59.592766 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-057fd7b7-f973-4ec6-9c04-8c506dd89260 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:59.595139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-057fd7b7-f973-4ec6-9c04-8c506dd89260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:59.661100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:59.683939 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 946/1876] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:59.685807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63c517-8b5d-4c36-8bfc-ed2448d97062 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:59.686144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63c517-8b5d-4c36-8bfc-ed2448d97062 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:59.686594 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63c517-8b5d-4c36-8bfc-ed2448d97062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:59.722801 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-af63c517-8b5d-4c36-8bfc-ed2448d97062 None None] MFA Rules not processed for user `91ad70f3ebdc489d8a5bce67677132b0`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:53:59.724405 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-af63c517-8b5d-4c36-8bfc-ed2448d97062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:59.737380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 931/1877] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:59.742449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340520f-325e-4182-9d7f-62e942c9f2ea None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:59.755954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340520f-325e-4182-9d7f-62e942c9f2ea None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:59.763583 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d6760-1e15-4e51-a571-bd476b611ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:59.764700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d6760-1e15-4e51-a571-bd476b611ead admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:59.764978 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d6760-1e15-4e51-a571-bd476b611ead admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:59.765245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d6760-1e15-4e51-a571-bd476b611ead admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:59.765979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d6760-1e15-4e51-a571-bd476b611ead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:53:59.766280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d6760-1e15-4e51-a571-bd476b611ead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:59.767948 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d6760-1e15-4e51-a571-bd476b611ead admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:59.790916 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 932/1878] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:53:59.793507 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d6760-1e15-4e51-a571-bd476b611ead admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:59.809661 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d6760-1e15-4e51-a571-bd476b611ead admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:59.817160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd98a9d-5e9b-41c0-bc74-4dd1539e8df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:59.818831 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd98a9d-5e9b-41c0-bc74-4dd1539e8df6 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:59.819179 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd98a9d-5e9b-41c0-bc74-4dd1539e8df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:59.819530 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd98a9d-5e9b-41c0-bc74-4dd1539e8df6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:59.820899 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd98a9d-5e9b-41c0-bc74-4dd1539e8df6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:53:59.821376 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd98a9d-5e9b-41c0-bc74-4dd1539e8df6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:59.824117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd98a9d-5e9b-41c0-bc74-4dd1539e8df6 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:59.848092 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 933/1879] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:53:59.849678 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd98a9d-5e9b-41c0-bc74-4dd1539e8df6 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:59.862465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd98a9d-5e9b-41c0-bc74-4dd1539e8df6 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:59.870279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179a726-cfc7-4cfd-ba44-641a02daa5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:59.870997 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179a726-cfc7-4cfd-ba44-641a02daa5bc admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:59.871381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179a726-cfc7-4cfd-ba44-641a02daa5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:59.871729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179a726-cfc7-4cfd-ba44-641a02daa5bc admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:59.873254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179a726-cfc7-4cfd-ba44-641a02daa5bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:59.874715 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179a726-cfc7-4cfd-ba44-641a02daa5bc admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:59.911846 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 947/1880] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:53:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:53:59.913602 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63c517-8b5d-4c36-8bfc-ed2448d97062 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:59.927995 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63c517-8b5d-4c36-8bfc-ed2448d97062 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:53:59.934398 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de631e75-6985-40b1-b887-325dac73da5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:53:59.935482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de631e75-6985-40b1-b887-325dac73da5d admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:53:59.935996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de631e75-6985-40b1-b887-325dac73da5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:53:59.936448 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de631e75-6985-40b1-b887-325dac73da5d admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:53:59.937304 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de631e75-6985-40b1-b887-325dac73da5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:53:59.939710 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de631e75-6985-40b1-b887-325dac73da5d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:53:59.949311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 934/1881] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:59 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:59.956124 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179a726-cfc7-4cfd-ba44-641a02daa5bc admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:53:59.959326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-3179a726-cfc7-4cfd-ba44-641a02daa5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:53:59.994791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 948/1882] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:53:59 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:53:59.996107 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de631e75-6985-40b1-b887-325dac73da5d admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:00.133026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de631e75-6985-40b1-b887-325dac73da5d admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:00.136456 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179a726-cfc7-4cfd-ba44-641a02daa5bc admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:00.146704 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38571c72-387b-4446-b1af-9bf9e36a3213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:00.147403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:00.148544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38571c72-387b-4446-b1af-9bf9e36a3213 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:00.149139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38571c72-387b-4446-b1af-9bf9e36a3213 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:00.149630 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38571c72-387b-4446-b1af-9bf9e36a3213 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:00.151069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38571c72-387b-4446-b1af-9bf9e36a3213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:00.167582 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38571c72-387b-4446-b1af-9bf9e36a3213 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:00.233706 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 949/1883] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:53:59 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:00.234888 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38571c72-387b-4446-b1af-9bf9e36a3213 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:00.250592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38571c72-387b-4446-b1af-9bf9e36a3213 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:00.256497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07523b-93cc-4494-abac-68a98f6d640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:00.257556 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07523b-93cc-4494-abac-68a98f6d640b admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:00.257996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07523b-93cc-4494-abac-68a98f6d640b admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:00.258319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07523b-93cc-4494-abac-68a98f6d640b admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:00.259003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07523b-93cc-4494-abac-68a98f6d640b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:00.261113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07523b-93cc-4494-abac-68a98f6d640b admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:00.307098 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bceda-f76d-46de-8b7a-7bf48626f80b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:00.308255 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bceda-f76d-46de-8b7a-7bf48626f80b service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:00.308595 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bceda-f76d-46de-8b7a-7bf48626f80b service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:00.308949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bceda-f76d-46de-8b7a-7bf48626f80b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:00.319949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-626bceda-f76d-46de-8b7a-7bf48626f80b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:00.341225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 950/1884] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:00 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:00.346094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f36f6-1fbc-4850-b091-29b10e83d9e5 None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:00.346387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f36f6-1fbc-4850-b091-29b10e83d9e5 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:00.346748 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f36f6-1fbc-4850-b091-29b10e83d9e5 None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:00.354567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 951/1885] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 23:54:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:54:00.359772 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f36f6-1fbc-4850-b091-29b10e83d9e5 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:00.423351 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f36f6-1fbc-4850-b091-29b10e83d9e5 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:00.451271 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45b191-c590-49fc-b70b-615e670dcee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:00.451933 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45b191-c590-49fc-b70b-615e670dcee6 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:00.452213 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45b191-c590-49fc-b70b-615e670dcee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:00.452482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45b191-c590-49fc-b70b-615e670dcee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:00.453169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45b191-c590-49fc-b70b-615e670dcee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:00.454965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45b191-c590-49fc-b70b-615e670dcee6 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:00.479677 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 952/1886] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:00.479677 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45b191-c590-49fc-b70b-615e670dcee6 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:00.534778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45b191-c590-49fc-b70b-615e670dcee6 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:00.546698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1352d9b-1f6d-4e24-9c30-e6f958cf8d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:00.547762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1352d9b-1f6d-4e24-9c30-e6f958cf8d23 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:00.548262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1352d9b-1f6d-4e24-9c30-e6f958cf8d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:00.548785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1352d9b-1f6d-4e24-9c30-e6f958cf8d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:00.549979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bceda-f76d-46de-8b7a-7bf48626f80b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:00.550188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1352d9b-1f6d-4e24-9c30-e6f958cf8d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:00.551495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bceda-f76d-46de-8b7a-7bf48626f80b service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:00.553284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1352d9b-1f6d-4e24-9c30-e6f958cf8d23 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:00.574385 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 935/1887] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:53:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:00.575364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bceda-f76d-46de-8b7a-7bf48626f80b service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:00.582108 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 953/1888] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:00.585171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52b703-358c-48ff-b612-879f66dfc0f1 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:00.588047 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52b703-358c-48ff-b612-879f66dfc0f1 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:00.588047 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52b703-358c-48ff-b612-879f66dfc0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:00.599614 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bceda-f76d-46de-8b7a-7bf48626f80b service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:00.605782 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:00.612101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aab0fc-9253-43b0-9688-8aa0af9bc2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:00.612741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aab0fc-9253-43b0-9688-8aa0af9bc2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:00.613130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aab0fc-9253-43b0-9688-8aa0af9bc2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:00.613465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aab0fc-9253-43b0-9688-8aa0af9bc2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:00.614167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aab0fc-9253-43b0-9688-8aa0af9bc2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:00.615871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aab0fc-9253-43b0-9688-8aa0af9bc2f3 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:00.634172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-6c52b703-358c-48ff-b612-879f66dfc0f1 None None] MFA Rules not processed for user `4395ee0a00df41adacb55b4a8684786b`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:00.639113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6c52b703-358c-48ff-b612-879f66dfc0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:00.649604 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 936/1889] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:00.649604 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aab0fc-9253-43b0-9688-8aa0af9bc2f3 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:00.673282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aab0fc-9253-43b0-9688-8aa0af9bc2f3 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:00.683220 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29c7cb-778b-423b-8302-7b13e0b925ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:00.683855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29c7cb-778b-423b-8302-7b13e0b925ac admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:00.684131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29c7cb-778b-423b-8302-7b13e0b925ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:00.685089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29c7cb-778b-423b-8302-7b13e0b925ac admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:00.685845 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29c7cb-778b-423b-8302-7b13e0b925ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:00.687515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29c7cb-778b-423b-8302-7b13e0b925ac admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:00.702009 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 937/1890] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:00.703007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29c7cb-778b-423b-8302-7b13e0b925ac admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:00.728685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29c7cb-778b-423b-8302-7b13e0b925ac admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:00.766259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828573f6-7a64-46cc-be40-fdb10c47bb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:00.766875 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828573f6-7a64-46cc-be40-fdb10c47bb05 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:00.767152 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828573f6-7a64-46cc-be40-fdb10c47bb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:00.767418 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828573f6-7a64-46cc-be40-fdb10c47bb05 admin admin] PATH_INFO: `/v3/projects/c6d19af7016f4171b7bec612fa951a94/users/003c2c7f573c41dc9aad33e4e94e59ab/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:00.844686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828573f6-7a64-46cc-be40-fdb10c47bb05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d19af7016f4171b7bec612fa951a94, user_id=003c2c7f573c41dc9aad33e4e94e59ab, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:00.848380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828573f6-7a64-46cc-be40-fdb10c47bb05 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:00.914393 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 938/1891] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:00 2022] PUT /identity/v3/projects/c6d19af7016f4171b7bec612fa951a94/users/003c2c7f573c41dc9aad33e4e94e59ab/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:00.917721 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828573f6-7a64-46cc-be40-fdb10c47bb05 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:00.925413 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 954/1892] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 23:54:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:00.930233 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fcbb0-1d2a-47dd-b7bb-fee0aeede343 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:00.933646 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fcbb0-1d2a-47dd-b7bb-fee0aeede343 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:00.934043 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fcbb0-1d2a-47dd-b7bb-fee0aeede343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:01.023955 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-8d8fcbb0-1d2a-47dd-b7bb-fee0aeede343 None None] MFA Rules not processed for user `003c2c7f573c41dc9aad33e4e94e59ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:01.025501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-8d8fcbb0-1d2a-47dd-b7bb-fee0aeede343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:01.177402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828573f6-7a64-46cc-be40-fdb10c47bb05 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:01.199925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceeb97e-a2ca-4c80-beb9-c428a607c949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:01.201209 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeb97e-a2ca-4c80-beb9-c428a607c949 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:01.203181 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeb97e-a2ca-4c80-beb9-c428a607c949 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:01.204451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeb97e-a2ca-4c80-beb9-c428a607c949 admin admin] PATH_INFO: `/v3/projects/a9f46535fb8a4a0f871ccc7f032eb7fc/users/458bd8b638f249cb9615711408879307/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:01.255799 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceeb97e-a2ca-4c80-beb9-c428a607c949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f46535fb8a4a0f871ccc7f032eb7fc, user_id=458bd8b638f249cb9615711408879307, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:01.259937 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 955/1893] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:01.263449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fcbb0-1d2a-47dd-b7bb-fee0aeede343 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:01.263803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceeb97e-a2ca-4c80-beb9-c428a607c949 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:01.268946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-8d8fcbb0-1d2a-47dd-b7bb-fee0aeede343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:01.285877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:01.306054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 939/1894] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:00 2022] PUT /identity/v3/projects/a9f46535fb8a4a0f871ccc7f032eb7fc/users/458bd8b638f249cb9615711408879307/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:01.307350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceeb97e-a2ca-4c80-beb9-c428a607c949 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:01.314130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-aceeb97e-a2ca-4c80-beb9-c428a607c949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:01.433522 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fcbb0-1d2a-47dd-b7bb-fee0aeede343 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:01.492956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:01.512922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceeb97e-a2ca-4c80-beb9-c428a607c949 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:01.530762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f547a-ffb1-4806-b326-7e87e2e52430 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21a0c72223417d92e3d8b30ef6bc3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:01.534722 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f547a-ffb1-4806-b326-7e87e2e52430 service glance] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:01.537682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f547a-ffb1-4806-b326-7e87e2e52430 service glance] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:01.537682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f547a-ffb1-4806-b326-7e87e2e52430 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:01.629799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163585a6-978a-40c0-9425-cb487751865b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4395ee0a00df41adacb55b4a8684786b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:01.631861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163585a6-978a-40c0-9425-cb487751865b service placement] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:01.632347 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163585a6-978a-40c0-9425-cb487751865b service placement] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:01.633666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163585a6-978a-40c0-9425-cb487751865b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:01.662194 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f547a-ffb1-4806-b326-7e87e2e52430 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:01.664393 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f547a-ffb1-4806-b326-7e87e2e52430 service glance] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:01.665729 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163585a6-978a-40c0-9425-cb487751865b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:01.668983 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163585a6-978a-40c0-9425-cb487751865b service placement] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:01.687604 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 940/1895] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:01.691529 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a298ba7-7530-4b41-b8ed-176756b7c0f6 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:01.691788 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a298ba7-7530-4b41-b8ed-176756b7c0f6 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:01.693829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a298ba7-7530-4b41-b8ed-176756b7c0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:01.701389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 956/1896] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:01.737369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-5a298ba7-7530-4b41-b8ed-176756b7c0f6 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:01.752328 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5a298ba7-7530-4b41-b8ed-176756b7c0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:01.977935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 941/1897] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:01.992222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163585a6-978a-40c0-9425-cb487751865b service placement] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:01.994401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-163585a6-978a-40c0-9425-cb487751865b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:02.214822 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163585a6-978a-40c0-9425-cb487751865b service placement] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:02.249975 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c99bd-abcd-4cec-b4ee-f4b4590e1d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:02.251017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c99bd-abcd-4cec-b4ee-f4b4590e1d2f service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:02.251496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c99bd-abcd-4cec-b4ee-f4b4590e1d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:02.252788 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c99bd-abcd-4cec-b4ee-f4b4590e1d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:02.298559 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c99bd-abcd-4cec-b4ee-f4b4590e1d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:02.302191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c99bd-abcd-4cec-b4ee-f4b4590e1d2f service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:02.353089 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 957/1898] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:02.695114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc34c78-f34e-49b2-a05e-b77c8d02c590 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:02.695670 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc34c78-f34e-49b2-a05e-b77c8d02c590 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:02.696303 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc34c78-f34e-49b2-a05e-b77c8d02c590 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:02.699530 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 942/1899] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 23:54:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:54:02.879769 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f5720-1c54-46c8-942e-31af69e4fd87 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:02.880228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f5720-1c54-46c8-942e-31af69e4fd87 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:02.880667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f5720-1c54-46c8-942e-31af69e4fd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:02.989780 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-754f5720-1c54-46c8-942e-31af69e4fd87 None None] MFA Rules not processed for user `4395ee0a00df41adacb55b4a8684786b`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:02.994704 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-754f5720-1c54-46c8-942e-31af69e4fd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:03.038762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 958/1900] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 23:54:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:03.072476 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc34c78-f34e-49b2-a05e-b77c8d02c590 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:03.103120 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f5720-1c54-46c8-942e-31af69e4fd87 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:03.106388 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-754f5720-1c54-46c8-942e-31af69e4fd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:03.152092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f5720-1c54-46c8-942e-31af69e4fd87 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:03.167566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc34c78-f34e-49b2-a05e-b77c8d02c590 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:03.211678 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f25dd-1b07-4e39-b572-2c3230c3fe0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4395ee0a00df41adacb55b4a8684786b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:03.219073 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f25dd-1b07-4e39-b572-2c3230c3fe0e service placement] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:03.219470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35db786-6922-4e3a-a540-de2e66890a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:03.222669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f25dd-1b07-4e39-b572-2c3230c3fe0e service placement] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:03.225746 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35db786-6922-4e3a-a540-de2e66890a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:03.225993 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f25dd-1b07-4e39-b572-2c3230c3fe0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:03.226598 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35db786-6922-4e3a-a540-de2e66890a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:03.229238 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35db786-6922-4e3a-a540-de2e66890a56 admin admin] PATH_INFO: `/v3/users/11fcec09efe946c085ee14eb5099fb4b` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:03.241040 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35db786-6922-4e3a-a540-de2e66890a56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11fcec09efe946c085ee14eb5099fb4b)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:03.261151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35db786-6922-4e3a-a540-de2e66890a56 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:03.292994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f25dd-1b07-4e39-b572-2c3230c3fe0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:03.302972 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f25dd-1b07-4e39-b572-2c3230c3fe0e service placement] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:03.377086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 943/1901] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:03.517847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d35db786-6922-4e3a-a540-de2e66890a56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11fcec09efe946c085ee14eb5099fb4b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:03.540083 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d35db786-6922-4e3a-a540-de2e66890a56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11fcec09efe946c085ee14eb5099fb4b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:03.617210 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d35db786-6922-4e3a-a540-de2e66890a56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11fcec09efe946c085ee14eb5099fb4b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:03.642533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d35db786-6922-4e3a-a540-de2e66890a56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11fcec09efe946c085ee14eb5099fb4b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:03.646830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d35db786-6922-4e3a-a540-de2e66890a56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11fcec09efe946c085ee14eb5099fb4b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:03.670975 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 959/1902] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:03 2022] DELETE /identity/v3/users/11fcec09efe946c085ee14eb5099fb4b => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:03.874256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88067c69-4149-40c1-9359-6dec698e47e2 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:03.875934 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88067c69-4149-40c1-9359-6dec698e47e2 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:03.876700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88067c69-4149-40c1-9359-6dec698e47e2 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:03.880033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 944/1903] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 23:54:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:54:03.936064 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479c0f4-4e7d-462f-a048-e0aeabc201f7 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:03.936698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479c0f4-4e7d-462f-a048-e0aeabc201f7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:03.937283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479c0f4-4e7d-462f-a048-e0aeabc201f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:03.998879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-6479c0f4-4e7d-462f-a048-e0aeabc201f7 None None] MFA Rules not processed for user `4a87e18c89ff419f8e428e376d33462c`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:04.000149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6479c0f4-4e7d-462f-a048-e0aeabc201f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:04.168365 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:04.397920 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 960/1904] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 23:54:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:04.756133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88067c69-4149-40c1-9359-6dec698e47e2 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:04.758427 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-88067c69-4149-40c1-9359-6dec698e47e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:04.765837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479c0f4-4e7d-462f-a048-e0aeabc201f7 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:04.767437 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6479c0f4-4e7d-462f-a048-e0aeabc201f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:04.797167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479c0f4-4e7d-462f-a048-e0aeabc201f7 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:04.809011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f5873-6a33-4d21-9e2a-c416b681182e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:04.810497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f5873-6a33-4d21-9e2a-c416b681182e service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:04.810497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f5873-6a33-4d21-9e2a-c416b681182e service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:04.813387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f5873-6a33-4d21-9e2a-c416b681182e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:04.834848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f5873-6a33-4d21-9e2a-c416b681182e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:04.839281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:04.841999 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f5873-6a33-4d21-9e2a-c416b681182e service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:04.869438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 961/1905] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:04.938675 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88067c69-4149-40c1-9359-6dec698e47e2 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:04.949008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89aabab-fc97-4aea-981e-bdec601cca19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:04.952714 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89aabab-fc97-4aea-981e-bdec601cca19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:04.953387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89aabab-fc97-4aea-981e-bdec601cca19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:04.953387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89aabab-fc97-4aea-981e-bdec601cca19 admin admin] PATH_INFO: `/v3/projects/0f2017d8f06c4fa687a07db5817ecd15` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:04.957965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89aabab-fc97-4aea-981e-bdec601cca19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f2017d8f06c4fa687a07db5817ecd15)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:04.963220 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89aabab-fc97-4aea-981e-bdec601cca19 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:05.093696 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e89aabab-fc97-4aea-981e-bdec601cca19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f2017d8f06c4fa687a07db5817ecd15', 'request_id': 'req-e89aabab-fc97-4aea-981e-bdec601cca19'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:05.157494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e89aabab-fc97-4aea-981e-bdec601cca19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f2017d8f06c4fa687a07db5817ecd15', 'request_id': 'req-e89aabab-fc97-4aea-981e-bdec601cca19'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:05.183049 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e89aabab-fc97-4aea-981e-bdec601cca19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f2017d8f06c4fa687a07db5817ecd15', 'request_id': 'req-e89aabab-fc97-4aea-981e-bdec601cca19'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:05.209636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e89aabab-fc97-4aea-981e-bdec601cca19 admin admin] The token cache is being invalidate because project 0f2017d8f06c4fa687a07db5817ecd15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:05.210239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e89aabab-fc97-4aea-981e-bdec601cca19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:05.213263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e89aabab-fc97-4aea-981e-bdec601cca19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:05.217599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 945/1906] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:04 2022] DELETE /identity/v3/projects/0f2017d8f06c4fa687a07db5817ecd15 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:05.226375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f5873-6a33-4d21-9e2a-c416b681182e service nova] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:05.239073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f5873-6a33-4d21-9e2a-c416b681182e service nova] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:05.388167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb15952-02a9-4f5a-89c9-37e7725b7189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:05.390095 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb15952-02a9-4f5a-89c9-37e7725b7189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:05.390858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb15952-02a9-4f5a-89c9-37e7725b7189 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:05.391693 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb15952-02a9-4f5a-89c9-37e7725b7189 admin admin] PATH_INFO: `/v3/users/0abf7deb9f764676a0d069d1927fdd2b` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:05.393798 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb15952-02a9-4f5a-89c9-37e7725b7189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0abf7deb9f764676a0d069d1927fdd2b)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:05.405518 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb15952-02a9-4f5a-89c9-37e7725b7189 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:05.505175 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-edb15952-02a9-4f5a-89c9-37e7725b7189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0abf7deb9f764676a0d069d1927fdd2b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:05.522953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-edb15952-02a9-4f5a-89c9-37e7725b7189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0abf7deb9f764676a0d069d1927fdd2b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:05.556598 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-edb15952-02a9-4f5a-89c9-37e7725b7189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0abf7deb9f764676a0d069d1927fdd2b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:05.573775 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-edb15952-02a9-4f5a-89c9-37e7725b7189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0abf7deb9f764676a0d069d1927fdd2b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:05.574841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-edb15952-02a9-4f5a-89c9-37e7725b7189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0abf7deb9f764676a0d069d1927fdd2b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:05.589561 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 962/1907] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:05 2022] DELETE /identity/v3/users/0abf7deb9f764676a0d069d1927fdd2b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:05.739545 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907d648-8954-4361-87a6-80c795956ae0 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:05.740148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907d648-8954-4361-87a6-80c795956ae0 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:05.740624 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907d648-8954-4361-87a6-80c795956ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:05.794039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-d907d648-8954-4361-87a6-80c795956ae0 None None] MFA Rules not processed for user `458bd8b638f249cb9615711408879307`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:05.795868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-d907d648-8954-4361-87a6-80c795956ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:05.996591 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 946/1908] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:06.009307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb15952-02a9-4f5a-89c9-37e7725b7189 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:06.012765 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-edb15952-02a9-4f5a-89c9-37e7725b7189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:06.072129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:06.097356 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907d648-8954-4361-87a6-80c795956ae0 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:06.098826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-d907d648-8954-4361-87a6-80c795956ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:06.131755 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb15952-02a9-4f5a-89c9-37e7725b7189 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:06.136384 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922e65d-ba3f-4b40-800f-2bfb60a46f84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:06.137157 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922e65d-ba3f-4b40-800f-2bfb60a46f84 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:06.137455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922e65d-ba3f-4b40-800f-2bfb60a46f84 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:06.137707 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922e65d-ba3f-4b40-800f-2bfb60a46f84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:06.157419 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922e65d-ba3f-4b40-800f-2bfb60a46f84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:06.162335 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922e65d-ba3f-4b40-800f-2bfb60a46f84 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:06.184359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 963/1909] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:54:06.243359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:06.326628 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907d648-8954-4361-87a6-80c795956ae0 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:06.356568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1ec63-6ab9-4511-bcaa-3011dc83f5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:06.356568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1ec63-6ab9-4511-bcaa-3011dc83f5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:06.356568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1ec63-6ab9-4511-bcaa-3011dc83f5de admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:06.356568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1ec63-6ab9-4511-bcaa-3011dc83f5de admin admin] PATH_INFO: `/v3/projects/28e28440de3b4312b807c22947918578` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:06.357164 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1ec63-6ab9-4511-bcaa-3011dc83f5de admin admin] RBAC: Authorizing `identity:delete_project(project_id=28e28440de3b4312b807c22947918578)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:06.362707 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1ec63-6ab9-4511-bcaa-3011dc83f5de admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:06.479513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-edb1ec63-6ab9-4511-bcaa-3011dc83f5de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e28440de3b4312b807c22947918578', 'request_id': 'req-edb1ec63-6ab9-4511-bcaa-3011dc83f5de'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:06.497093 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-edb1ec63-6ab9-4511-bcaa-3011dc83f5de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e28440de3b4312b807c22947918578', 'request_id': 'req-edb1ec63-6ab9-4511-bcaa-3011dc83f5de'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:06.516083 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-edb1ec63-6ab9-4511-bcaa-3011dc83f5de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e28440de3b4312b807c22947918578', 'request_id': 'req-edb1ec63-6ab9-4511-bcaa-3011dc83f5de'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:06.548730 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-edb1ec63-6ab9-4511-bcaa-3011dc83f5de admin admin] The token cache is being invalidate because project 28e28440de3b4312b807c22947918578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:06.548730 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-edb1ec63-6ab9-4511-bcaa-3011dc83f5de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:06.550924 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-edb1ec63-6ab9-4511-bcaa-3011dc83f5de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:06.553449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 947/1910] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:06 2022] DELETE /identity/v3/projects/28e28440de3b4312b807c22947918578 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:54:06.561733 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235548b-549e-4af2-abd3-566faca52fc6 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:06.562690 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235548b-549e-4af2-abd3-566faca52fc6 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:06.562690 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235548b-549e-4af2-abd3-566faca52fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:06.655314 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-0235548b-549e-4af2-abd3-566faca52fc6 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:06.662004 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0235548b-549e-4af2-abd3-566faca52fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:06.790464 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 964/1911] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:06.792470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb8e7a-b6a1-4a6a-b57f-8c6b357fb4c0 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:06.792747 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb8e7a-b6a1-4a6a-b57f-8c6b357fb4c0 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:06.793017 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb8e7a-b6a1-4a6a-b57f-8c6b357fb4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:06.879636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-5fdb8e7a-b6a1-4a6a-b57f-8c6b357fb4c0 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:06.881549 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5fdb8e7a-b6a1-4a6a-b57f-8c6b357fb4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:06.915034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 948/1912] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:06.921472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235548b-549e-4af2-abd3-566faca52fc6 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:06.940689 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235548b-549e-4af2-abd3-566faca52fc6 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:06.951101 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd0310-5747-4ee1-bfe0-2d744e90df92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:06.951975 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd0310-5747-4ee1-bfe0-2d744e90df92 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:06.952402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd0310-5747-4ee1-bfe0-2d744e90df92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:06.952681 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd0310-5747-4ee1-bfe0-2d744e90df92 admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:06.953370 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd0310-5747-4ee1-bfe0-2d744e90df92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:54:06.953766 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd0310-5747-4ee1-bfe0-2d744e90df92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:06.964374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd0310-5747-4ee1-bfe0-2d744e90df92 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:07.009525 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 965/1913] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:54:07.015805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb8e7a-b6a1-4a6a-b57f-8c6b357fb4c0 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:07.041711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb8e7a-b6a1-4a6a-b57f-8c6b357fb4c0 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:07.062707 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1024798-698c-4f65-b4d8-4a953b97d142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:07.063574 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1024798-698c-4f65-b4d8-4a953b97d142 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:07.063935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1024798-698c-4f65-b4d8-4a953b97d142 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:07.064209 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1024798-698c-4f65-b4d8-4a953b97d142 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:07.065212 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1024798-698c-4f65-b4d8-4a953b97d142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:07.068072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1024798-698c-4f65-b4d8-4a953b97d142 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:07.144610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 949/1914] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:07 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:54:07.148568 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd0310-5747-4ee1-bfe0-2d744e90df92 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:07.172267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd0310-5747-4ee1-bfe0-2d744e90df92 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:07.202228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1024798-698c-4f65-b4d8-4a953b97d142 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:07.206145 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a1024798-698c-4f65-b4d8-4a953b97d142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:07.300044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931f14e-612c-47de-9088-493cfcf009d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:07.300707 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931f14e-612c-47de-9088-493cfcf009d2 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:07.300995 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931f14e-612c-47de-9088-493cfcf009d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:07.301284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931f14e-612c-47de-9088-493cfcf009d2 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:07.301997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931f14e-612c-47de-9088-493cfcf009d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:07.306690 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931f14e-612c-47de-9088-493cfcf009d2 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:07.345776 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 966/1915] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:07 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:54:07.349643 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931f14e-612c-47de-9088-493cfcf009d2 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:07.357275 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1024798-698c-4f65-b4d8-4a953b97d142 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:07.362040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b9c50-2c20-4a57-a185-a1f671a59f1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:07.362845 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b9c50-2c20-4a57-a185-a1f671a59f1e service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:07.363214 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b9c50-2c20-4a57-a185-a1f671a59f1e service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:07.363577 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b9c50-2c20-4a57-a185-a1f671a59f1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:07.366100 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-915b9c50-2c20-4a57-a185-a1f671a59f1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:07.372937 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931f14e-612c-47de-9088-493cfcf009d2 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:07.390204 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f4302-fdec-4b32-8f7c-0a6a41fe063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:07.391053 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f4302-fdec-4b32-8f7c-0a6a41fe063a admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:07.391329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f4302-fdec-4b32-8f7c-0a6a41fe063a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:07.394076 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f4302-fdec-4b32-8f7c-0a6a41fe063a admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:07.408960 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f4302-fdec-4b32-8f7c-0a6a41fe063a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:07.413590 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f4302-fdec-4b32-8f7c-0a6a41fe063a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:07.446782 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 967/1916] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:07.453399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f4302-fdec-4b32-8f7c-0a6a41fe063a admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:07.500983 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f4302-fdec-4b32-8f7c-0a6a41fe063a admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:07.524598 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37c74f-02d5-48ee-91cd-0fc151ea30e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:07.525751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37c74f-02d5-48ee-91cd-0fc151ea30e0 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:07.526249 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37c74f-02d5-48ee-91cd-0fc151ea30e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:07.526736 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37c74f-02d5-48ee-91cd-0fc151ea30e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:07.530243 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37c74f-02d5-48ee-91cd-0fc151ea30e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:07.533413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:07.543716 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b9c50-2c20-4a57-a185-a1f671a59f1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:07.546579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b9c50-2c20-4a57-a185-a1f671a59f1e service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:07.551878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37c74f-02d5-48ee-91cd-0fc151ea30e0 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:07.585067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 950/1917] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:54:07.593009 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 968/1918] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:54:07.603484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b9c50-2c20-4a57-a185-a1f671a59f1e service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:07.627957 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b9c50-2c20-4a57-a185-a1f671a59f1e service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:07.637765 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce96dc-3066-423d-b41b-59cc607661b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:07.639283 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce96dc-3066-423d-b41b-59cc607661b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:07.641147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce96dc-3066-423d-b41b-59cc607661b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:07.641651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce96dc-3066-423d-b41b-59cc607661b3 admin admin] PATH_INFO: `/v3/projects/d7ebd1fe98ec44cb929c36385678328b/users/5b2fbc8918e84af793e01331dfec2be6/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:07.673478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce96dc-3066-423d-b41b-59cc607661b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ebd1fe98ec44cb929c36385678328b, user_id=5b2fbc8918e84af793e01331dfec2be6, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:07.680170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce96dc-3066-423d-b41b-59cc607661b3 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:07.717507 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 951/1919] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:07 2022] PUT /identity/v3/projects/d7ebd1fe98ec44cb929c36385678328b/users/5b2fbc8918e84af793e01331dfec2be6/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:07.742084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e7a86-e9c7-4136-aaa8-0505ae92ab63 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:07.742614 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e7a86-e9c7-4136-aaa8-0505ae92ab63 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:07.743081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e7a86-e9c7-4136-aaa8-0505ae92ab63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:07.844929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-480e7a86-e9c7-4136-aaa8-0505ae92ab63 None None] MFA Rules not processed for user `5b2fbc8918e84af793e01331dfec2be6`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:07.848689 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-480e7a86-e9c7-4136-aaa8-0505ae92ab63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:07.889641 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:08.047005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 969/1920] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:54:08.053427 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce96dc-3066-423d-b41b-59cc607661b3 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:08.137689 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8b482-3a17-428b-95ae-4940eda099ec None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:08.143531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8b482-3a17-428b-95ae-4940eda099ec None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:08.144187 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8b482-3a17-428b-95ae-4940eda099ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:08.234106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-9df8b482-3a17-428b-95ae-4940eda099ec None None] MFA Rules not processed for user `458bd8b638f249cb9615711408879307`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:08.243904 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9df8b482-3a17-428b-95ae-4940eda099ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:08.247979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce96dc-3066-423d-b41b-59cc607661b3 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:08.275183 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14735ea1-c71a-4ca2-af08-ae47fa71fa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:08.276310 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14735ea1-c71a-4ca2-af08-ae47fa71fa73 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:08.276801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14735ea1-c71a-4ca2-af08-ae47fa71fa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:08.277283 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14735ea1-c71a-4ca2-af08-ae47fa71fa73 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:08.278554 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14735ea1-c71a-4ca2-af08-ae47fa71fa73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:08.283287 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14735ea1-c71a-4ca2-af08-ae47fa71fa73 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:08.403979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 952/1921] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:08 2022] POST /identity/v3/projects => generated 375 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:08.410143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14735ea1-c71a-4ca2-af08-ae47fa71fa73 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:08.431682 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 970/1922] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:08.541775 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14735ea1-c71a-4ca2-af08-ae47fa71fa73 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:08.556179 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85823a-8322-4b1c-aab0-582374cbc158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:08.556705 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85823a-8322-4b1c-aab0-582374cbc158 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:08.556984 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85823a-8322-4b1c-aab0-582374cbc158 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:08.557246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85823a-8322-4b1c-aab0-582374cbc158 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:08.561211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85823a-8322-4b1c-aab0-582374cbc158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:08.566712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85823a-8322-4b1c-aab0-582374cbc158 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:08.646285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 953/1923] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:08 2022] POST /identity/v3/users => generated 294 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:08.652484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8b482-3a17-428b-95ae-4940eda099ec None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:08.666662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8b482-3a17-428b-95ae-4940eda099ec None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:08.672920 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde3b27-3c0c-4710-99b2-7f42860fe8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:08.673960 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde3b27-3c0c-4710-99b2-7f42860fe8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:08.675143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde3b27-3c0c-4710-99b2-7f42860fe8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:08.675143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde3b27-3c0c-4710-99b2-7f42860fe8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:08.680625 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde3b27-3c0c-4710-99b2-7f42860fe8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:08.680625 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde3b27-3c0c-4710-99b2-7f42860fe8f4 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:08.693938 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 971/1924] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:08.699970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85823a-8322-4b1c-aab0-582374cbc158 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:08.718264 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85823a-8322-4b1c-aab0-582374cbc158 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:08.728321 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5eb4a-2679-482b-bff6-6ffb960d52ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:08.729053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5eb4a-2679-482b-bff6-6ffb960d52ce admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:08.729379 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5eb4a-2679-482b-bff6-6ffb960d52ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:08.729679 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5eb4a-2679-482b-bff6-6ffb960d52ce admin admin] PATH_INFO: `/v3/projects/97da1459d223467e9755d99a20560054/users/21eab6edf6884ceea0fe5b0fd52d6d4f/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:08.753042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5eb4a-2679-482b-bff6-6ffb960d52ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=97da1459d223467e9755d99a20560054, user_id=21eab6edf6884ceea0fe5b0fd52d6d4f, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:08.759143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5eb4a-2679-482b-bff6-6ffb960d52ce admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:08.780918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 954/1925] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:08 2022] PUT /identity/v3/projects/97da1459d223467e9755d99a20560054/users/21eab6edf6884ceea0fe5b0fd52d6d4f/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:54:08.782241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde3b27-3c0c-4710-99b2-7f42860fe8f4 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:08.798372 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde3b27-3c0c-4710-99b2-7f42860fe8f4 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:08.896983 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edea082-4a31-404c-9b9a-72ad0e5085ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:08.898034 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edea082-4a31-404c-9b9a-72ad0e5085ad admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:08.900049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edea082-4a31-404c-9b9a-72ad0e5085ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:08.900760 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edea082-4a31-404c-9b9a-72ad0e5085ad admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:08.902102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edea082-4a31-404c-9b9a-72ad0e5085ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:08.904092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edea082-4a31-404c-9b9a-72ad0e5085ad admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:08.931271 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 972/1926] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:08.937659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5eb4a-2679-482b-bff6-6ffb960d52ce admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:08.953091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5eb4a-2679-482b-bff6-6ffb960d52ce admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:08.958998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a836e-5bc0-44dc-8abe-4591cfebe93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:08.959692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a836e-5bc0-44dc-8abe-4591cfebe93a admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:08.959968 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a836e-5bc0-44dc-8abe-4591cfebe93a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:08.960241 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a836e-5bc0-44dc-8abe-4591cfebe93a admin admin] PATH_INFO: `/v3/projects/97da1459d223467e9755d99a20560054/users/21eab6edf6884ceea0fe5b0fd52d6d4f/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:08.967917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a836e-5bc0-44dc-8abe-4591cfebe93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97da1459d223467e9755d99a20560054, user_id=21eab6edf6884ceea0fe5b0fd52d6d4f, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:08.973988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a836e-5bc0-44dc-8abe-4591cfebe93a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:09.001174 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 955/1927] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:08 2022] PUT /identity/v3/projects/97da1459d223467e9755d99a20560054/users/21eab6edf6884ceea0fe5b0fd52d6d4f/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:09.020949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaf51b-d138-4f19-a1a5-264ab804b468 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:09.021403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaf51b-d138-4f19-a1a5-264ab804b468 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:09.021812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaf51b-d138-4f19-a1a5-264ab804b468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:09.087758 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-1adaf51b-d138-4f19-a1a5-264ab804b468 None None] MFA Rules not processed for user `21eab6edf6884ceea0fe5b0fd52d6d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:09.090170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1adaf51b-d138-4f19-a1a5-264ab804b468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:09.179440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:09.293844 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 973/1928] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:54:09.318180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a836e-5bc0-44dc-8abe-4591cfebe93a admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:09.340262 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:09.529944 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a836e-5bc0-44dc-8abe-4591cfebe93a admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:09.557660 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28f932-9cf2-4fa3-80e9-a132233c4293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:09.558757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28f932-9cf2-4fa3-80e9-a132233c4293 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:09.559233 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28f932-9cf2-4fa3-80e9-a132233c4293 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:09.559726 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28f932-9cf2-4fa3-80e9-a132233c4293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:09.794775 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28f932-9cf2-4fa3-80e9-a132233c4293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:09.796622 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28f932-9cf2-4fa3-80e9-a132233c4293 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:09.818668 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 956/1929] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:54:12.982475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaf51b-d138-4f19-a1a5-264ab804b468 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:12.985186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1adaf51b-d138-4f19-a1a5-264ab804b468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:13.017877 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaf51b-d138-4f19-a1a5-264ab804b468 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:13.025893 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be207ec3-b2f3-45c5-9487-7e6340879297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:13.027197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be207ec3-b2f3-45c5-9487-7e6340879297 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:13.027819 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be207ec3-b2f3-45c5-9487-7e6340879297 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:13.028796 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be207ec3-b2f3-45c5-9487-7e6340879297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:13.049264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be207ec3-b2f3-45c5-9487-7e6340879297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:13.053377 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be207ec3-b2f3-45c5-9487-7e6340879297 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:13.096861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 974/1930] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:14.577829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28f932-9cf2-4fa3-80e9-a132233c4293 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:14.581619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-db28f932-9cf2-4fa3-80e9-a132233c4293 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:14.804315 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28f932-9cf2-4fa3-80e9-a132233c4293 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:14.835910 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3d360-82b4-4038-b3cf-b3faf03548c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:14.837614 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d360-82b4-4038-b3cf-b3faf03548c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:14.838325 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d360-82b4-4038-b3cf-b3faf03548c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:14.838998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d360-82b4-4038-b3cf-b3faf03548c9 admin admin] PATH_INFO: `/v3/users/81fef50fe75f486e946974dc6a247e3c` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:14.841580 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3d360-82b4-4038-b3cf-b3faf03548c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81fef50fe75f486e946974dc6a247e3c)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:14.851788 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3d360-82b4-4038-b3cf-b3faf03548c9 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:14.962927 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-57c3d360-82b4-4038-b3cf-b3faf03548c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81fef50fe75f486e946974dc6a247e3c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:14.964594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-57c3d360-82b4-4038-b3cf-b3faf03548c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81fef50fe75f486e946974dc6a247e3c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:14.965751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-57c3d360-82b4-4038-b3cf-b3faf03548c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81fef50fe75f486e946974dc6a247e3c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:15.004065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:15.007111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-57c3d360-82b4-4038-b3cf-b3faf03548c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81fef50fe75f486e946974dc6a247e3c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:15.046298 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-57c3d360-82b4-4038-b3cf-b3faf03548c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81fef50fe75f486e946974dc6a247e3c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:15.103232 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 957/1931] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:14 2022] DELETE /identity/v3/users/81fef50fe75f486e946974dc6a247e3c => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:15.109621 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d95529-5bd2-49f6-b94a-4bb49640c3ff None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:15.120539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d95529-5bd2-49f6-b94a-4bb49640c3ff None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:15.126682 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d95529-5bd2-49f6-b94a-4bb49640c3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:15.158809 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-15d95529-5bd2-49f6-b94a-4bb49640c3ff None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:15.160124 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-15d95529-5bd2-49f6-b94a-4bb49640c3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:15.250194 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 975/1932] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:15.257852 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3d360-82b4-4038-b3cf-b3faf03548c9 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:15.260141 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-57c3d360-82b4-4038-b3cf-b3faf03548c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:15.454332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3d360-82b4-4038-b3cf-b3faf03548c9 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:15.458486 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ddc45-88e8-423f-aed8-b12e2011ca5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:15.459141 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ddc45-88e8-423f-aed8-b12e2011ca5e service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:15.459422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ddc45-88e8-423f-aed8-b12e2011ca5e service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:15.459693 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ddc45-88e8-423f-aed8-b12e2011ca5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:15.472265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ddc45-88e8-423f-aed8-b12e2011ca5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:15.473981 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ddc45-88e8-423f-aed8-b12e2011ca5e service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:15.512843 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 958/1933] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:54:16.337814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d95529-5bd2-49f6-b94a-4bb49640c3ff None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:16.347194 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-15d95529-5bd2-49f6-b94a-4bb49640c3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:16.381979 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d95529-5bd2-49f6-b94a-4bb49640c3ff None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:16.406014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab215d-62d5-4da4-b605-f1dc022d97d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:16.406715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab215d-62d5-4da4-b605-f1dc022d97d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:16.407163 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab215d-62d5-4da4-b605-f1dc022d97d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:16.407642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab215d-62d5-4da4-b605-f1dc022d97d0 admin admin] PATH_INFO: `/v3/projects/fb97eefeb534497c86d89963cb11d035` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:16.412721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab215d-62d5-4da4-b605-f1dc022d97d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb97eefeb534497c86d89963cb11d035)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:16.421267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab215d-62d5-4da4-b605-f1dc022d97d0 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:16.569919 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2bab215d-62d5-4da4-b605-f1dc022d97d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb97eefeb534497c86d89963cb11d035', 'request_id': 'req-2bab215d-62d5-4da4-b605-f1dc022d97d0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:16.615209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2bab215d-62d5-4da4-b605-f1dc022d97d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb97eefeb534497c86d89963cb11d035', 'request_id': 'req-2bab215d-62d5-4da4-b605-f1dc022d97d0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:16.636218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2bab215d-62d5-4da4-b605-f1dc022d97d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb97eefeb534497c86d89963cb11d035', 'request_id': 'req-2bab215d-62d5-4da4-b605-f1dc022d97d0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:16.684482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2bab215d-62d5-4da4-b605-f1dc022d97d0 admin admin] The token cache is being invalidate because project fb97eefeb534497c86d89963cb11d035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:16.685749 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2bab215d-62d5-4da4-b605-f1dc022d97d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:16.687234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2bab215d-62d5-4da4-b605-f1dc022d97d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:16.691027 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 976/1934] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:16 2022] DELETE /identity/v3/projects/fb97eefeb534497c86d89963cb11d035 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:54:16.697989 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ddc45-88e8-423f-aed8-b12e2011ca5e service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:16.746346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ddc45-88e8-423f-aed8-b12e2011ca5e service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:16.934030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5d3b5-685f-463b-a2fa-0deac32769ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:16.937245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5d3b5-685f-463b-a2fa-0deac32769ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:16.937936 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5d3b5-685f-463b-a2fa-0deac32769ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:16.938446 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5d3b5-685f-463b-a2fa-0deac32769ef admin admin] PATH_INFO: `/v3/users/91ad70f3ebdc489d8a5bce67677132b0` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:16.941840 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5d3b5-685f-463b-a2fa-0deac32769ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=91ad70f3ebdc489d8a5bce67677132b0)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:16.946670 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5d3b5-685f-463b-a2fa-0deac32769ef admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:17.087049 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3dc5d3b5-685f-463b-a2fa-0deac32769ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91ad70f3ebdc489d8a5bce67677132b0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:17.088739 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3dc5d3b5-685f-463b-a2fa-0deac32769ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91ad70f3ebdc489d8a5bce67677132b0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:17.089444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3dc5d3b5-685f-463b-a2fa-0deac32769ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91ad70f3ebdc489d8a5bce67677132b0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:17.209040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3dc5d3b5-685f-463b-a2fa-0deac32769ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91ad70f3ebdc489d8a5bce67677132b0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:17.292579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3dc5d3b5-685f-463b-a2fa-0deac32769ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91ad70f3ebdc489d8a5bce67677132b0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:17.372115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 959/1935] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:16 2022] DELETE /identity/v3/users/91ad70f3ebdc489d8a5bce67677132b0 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:18.354769 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab215d-62d5-4da4-b605-f1dc022d97d0 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:18.357382 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2bab215d-62d5-4da4-b605-f1dc022d97d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:18.394165 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab215d-62d5-4da4-b605-f1dc022d97d0 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:18.488826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:18.508875 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23009f-34b3-49fb-ba70-d694d5a832f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:18.509682 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23009f-34b3-49fb-ba70-d694d5a832f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:18.510025 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23009f-34b3-49fb-ba70-d694d5a832f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:18.510358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23009f-34b3-49fb-ba70-d694d5a832f8 admin admin] PATH_INFO: `/v3/projects/c04d4aa44ea648e295166d8b060b7413` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:18.511776 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23009f-34b3-49fb-ba70-d694d5a832f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04d4aa44ea648e295166d8b060b7413)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:18.514039 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23009f-34b3-49fb-ba70-d694d5a832f8 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:18.627841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-ab23009f-34b3-49fb-ba70-d694d5a832f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04d4aa44ea648e295166d8b060b7413', 'request_id': 'req-ab23009f-34b3-49fb-ba70-d694d5a832f8'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:18.645772 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-ab23009f-34b3-49fb-ba70-d694d5a832f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04d4aa44ea648e295166d8b060b7413', 'request_id': 'req-ab23009f-34b3-49fb-ba70-d694d5a832f8'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:18.657046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-ab23009f-34b3-49fb-ba70-d694d5a832f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04d4aa44ea648e295166d8b060b7413', 'request_id': 'req-ab23009f-34b3-49fb-ba70-d694d5a832f8'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:18.684387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-ab23009f-34b3-49fb-ba70-d694d5a832f8 admin admin] The token cache is being invalidate because project c04d4aa44ea648e295166d8b060b7413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:18.685012 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-ab23009f-34b3-49fb-ba70-d694d5a832f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:18.686493 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-ab23009f-34b3-49fb-ba70-d694d5a832f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:18.689436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 977/1936] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:18 2022] DELETE /identity/v3/projects/c04d4aa44ea648e295166d8b060b7413 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:18.698621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f219554-387c-4bf3-b099-9fa09f0ccba7 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:18.699444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f219554-387c-4bf3-b099-9fa09f0ccba7 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:18.699752 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f219554-387c-4bf3-b099-9fa09f0ccba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:18.712816 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:18.738111 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-8f219554-387c-4bf3-b099-9fa09f0ccba7 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:18.740413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-8f219554-387c-4bf3-b099-9fa09f0ccba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:18.872415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 960/1937] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:18.876018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001ce6f-a59e-43f4-b5be-409abc4e9a4f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:18.876501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001ce6f-a59e-43f4-b5be-409abc4e9a4f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:18.877003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001ce6f-a59e-43f4-b5be-409abc4e9a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:18.911410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-4001ce6f-a59e-43f4-b5be-409abc4e9a4f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:18.912678 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4001ce6f-a59e-43f4-b5be-409abc4e9a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:18.921745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 978/1938] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:18.928945 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f219554-387c-4bf3-b099-9fa09f0ccba7 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:18.947265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f219554-387c-4bf3-b099-9fa09f0ccba7 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:18.955266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e3df5-6930-4a14-8d5b-aa10cef0d9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:18.956545 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e3df5-6930-4a14-8d5b-aa10cef0d9ba admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:18.956908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e3df5-6930-4a14-8d5b-aa10cef0d9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:18.958238 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e3df5-6930-4a14-8d5b-aa10cef0d9ba admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:18.958517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e3df5-6930-4a14-8d5b-aa10cef0d9ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:54:18.959077 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e3df5-6930-4a14-8d5b-aa10cef0d9ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:18.962226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e3df5-6930-4a14-8d5b-aa10cef0d9ba admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:18.984772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 961/1939] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:54:18.991233 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001ce6f-a59e-43f4-b5be-409abc4e9a4f None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:19.002763 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001ce6f-a59e-43f4-b5be-409abc4e9a4f None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:19.010415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd05f3-0aef-4e93-972d-41aa0cd02de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:19.011246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd05f3-0aef-4e93-972d-41aa0cd02de2 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:19.011458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd05f3-0aef-4e93-972d-41aa0cd02de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:19.011624 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd05f3-0aef-4e93-972d-41aa0cd02de2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:19.012629 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd05f3-0aef-4e93-972d-41aa0cd02de2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:19.014991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd05f3-0aef-4e93-972d-41aa0cd02de2 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:19.051984 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 979/1940] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:18 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:54:19.056559 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e3df5-6930-4a14-8d5b-aa10cef0d9ba admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:19.069514 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e3df5-6930-4a14-8d5b-aa10cef0d9ba admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:19.152349 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811aa0af-6959-419d-abb8-4c8bcf536b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:19.153163 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811aa0af-6959-419d-abb8-4c8bcf536b5f admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:19.153611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811aa0af-6959-419d-abb8-4c8bcf536b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:19.153996 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811aa0af-6959-419d-abb8-4c8bcf536b5f admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:19.154993 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811aa0af-6959-419d-abb8-4c8bcf536b5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:19.157709 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811aa0af-6959-419d-abb8-4c8bcf536b5f admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:19.185375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 962/1941] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:19 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:54:19.190221 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd05f3-0aef-4e93-972d-41aa0cd02de2 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:19.201076 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd05f3-0aef-4e93-972d-41aa0cd02de2 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:19.208408 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa52af-be6a-4ca2-9a20-31e749b4c2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:19.209068 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa52af-be6a-4ca2-9a20-31e749b4c2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:19.209363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa52af-be6a-4ca2-9a20-31e749b4c2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:19.209644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa52af-be6a-4ca2-9a20-31e749b4c2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:19.210644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa52af-be6a-4ca2-9a20-31e749b4c2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:19.212651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa52af-be6a-4ca2-9a20-31e749b4c2e1 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:19.225611 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 980/1942] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:54:19.230445 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811aa0af-6959-419d-abb8-4c8bcf536b5f admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:19.241935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811aa0af-6959-419d-abb8-4c8bcf536b5f admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:19.247819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16de223-24cd-4f18-9afe-85a792394f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:19.248501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de223-24cd-4f18-9afe-85a792394f24 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:19.248813 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de223-24cd-4f18-9afe-85a792394f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:19.249117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16de223-24cd-4f18-9afe-85a792394f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:19.249977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16de223-24cd-4f18-9afe-85a792394f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:19.251783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16de223-24cd-4f18-9afe-85a792394f24 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:19.264945 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 963/1943] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:54:19.270956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa52af-be6a-4ca2-9a20-31e749b4c2e1 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:19.284144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa52af-be6a-4ca2-9a20-31e749b4c2e1 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:19.291686 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950bc80-316d-43a2-960a-648316f44973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:19.292591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950bc80-316d-43a2-960a-648316f44973 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:19.292876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950bc80-316d-43a2-960a-648316f44973 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:19.293306 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950bc80-316d-43a2-960a-648316f44973 admin admin] PATH_INFO: `/v3/projects/2287180187c648dea6f40853f0f3c4fb/users/0736013d56fe4ba98e4a3a3d969eb554/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:19.315901 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950bc80-316d-43a2-960a-648316f44973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2287180187c648dea6f40853f0f3c4fb, user_id=0736013d56fe4ba98e4a3a3d969eb554, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:19.319657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950bc80-316d-43a2-960a-648316f44973 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:19.339375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 981/1944] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:19 2022] PUT /identity/v3/projects/2287180187c648dea6f40853f0f3c4fb/users/0736013d56fe4ba98e4a3a3d969eb554/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:19.353070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8d693-b82e-414a-9a0b-fb460a976ef8 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:19.353602 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8d693-b82e-414a-9a0b-fb460a976ef8 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:19.354045 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8d693-b82e-414a-9a0b-fb460a976ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:19.402923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-f5b8d693-b82e-414a-9a0b-fb460a976ef8 None None] MFA Rules not processed for user `0736013d56fe4ba98e4a3a3d969eb554`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:19.404995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f5b8d693-b82e-414a-9a0b-fb460a976ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:19.523616 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:19.537501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 964/1945] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:19.546741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950bc80-316d-43a2-960a-648316f44973 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:19.662291 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950bc80-316d-43a2-960a-648316f44973 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:19.667629 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad5f73-5238-452f-b089-473e8b7cc4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:19.668699 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad5f73-5238-452f-b089-473e8b7cc4dd admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:19.668981 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad5f73-5238-452f-b089-473e8b7cc4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:19.669289 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad5f73-5238-452f-b089-473e8b7cc4dd admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:19.670016 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad5f73-5238-452f-b089-473e8b7cc4dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:19.672412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad5f73-5238-452f-b089-473e8b7cc4dd admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:19.687853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:19.716539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 982/1946] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:19 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:19.722161 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8d693-b82e-414a-9a0b-fb460a976ef8 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:19.737997 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8d693-b82e-414a-9a0b-fb460a976ef8 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:19.886215 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a7ee4-a805-4083-acb5-181663e08a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:19.887382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a7ee4-a805-4083-acb5-181663e08a08 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:19.889655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a7ee4-a805-4083-acb5-181663e08a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:19.890007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a7ee4-a805-4083-acb5-181663e08a08 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:19.890796 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a7ee4-a805-4083-acb5-181663e08a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:19.893212 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a7ee4-a805-4083-acb5-181663e08a08 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:20.004515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 965/1947] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:19 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:54:20.008145 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad5f73-5238-452f-b089-473e8b7cc4dd admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:20.026691 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad5f73-5238-452f-b089-473e8b7cc4dd admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:20.044136 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40fcc1-ef98-4818-a406-01eebfa8bccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:20.044784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40fcc1-ef98-4818-a406-01eebfa8bccf admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:20.045058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40fcc1-ef98-4818-a406-01eebfa8bccf admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:20.045323 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40fcc1-ef98-4818-a406-01eebfa8bccf admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:20.046031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40fcc1-ef98-4818-a406-01eebfa8bccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:20.047666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40fcc1-ef98-4818-a406-01eebfa8bccf admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:20.071116 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 983/1948] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:20.076991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a7ee4-a805-4083-acb5-181663e08a08 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:20.091833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a7ee4-a805-4083-acb5-181663e08a08 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:20.103003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20148fd4-17b2-4dbd-8019-29134b931926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:20.104791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20148fd4-17b2-4dbd-8019-29134b931926 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:20.104791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20148fd4-17b2-4dbd-8019-29134b931926 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:20.104791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20148fd4-17b2-4dbd-8019-29134b931926 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:20.106666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20148fd4-17b2-4dbd-8019-29134b931926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:20.113023 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20148fd4-17b2-4dbd-8019-29134b931926 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:20.136967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 966/1949] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:20.141236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40fcc1-ef98-4818-a406-01eebfa8bccf admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:20.155633 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40fcc1-ef98-4818-a406-01eebfa8bccf admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:20.179294 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e1674-2465-4083-8c6f-2ce5cb54e037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:20.181189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e1674-2465-4083-8c6f-2ce5cb54e037 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:20.181504 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e1674-2465-4083-8c6f-2ce5cb54e037 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:20.183321 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e1674-2465-4083-8c6f-2ce5cb54e037 admin admin] PATH_INFO: `/v3/projects/6e30cde5b0ad4b968f336c3aec28f577/users/dbc9e410089849f7ac7d6b0edc311203/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:20.241731 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e1674-2465-4083-8c6f-2ce5cb54e037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e30cde5b0ad4b968f336c3aec28f577, user_id=dbc9e410089849f7ac7d6b0edc311203, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:20.244550 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e1674-2465-4083-8c6f-2ce5cb54e037 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:20.272561 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 984/1950] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:20 2022] PUT /identity/v3/projects/6e30cde5b0ad4b968f336c3aec28f577/users/dbc9e410089849f7ac7d6b0edc311203/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:20.283065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915890bc-b885-4277-a841-9b9c09851d98 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:20.283384 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915890bc-b885-4277-a841-9b9c09851d98 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:20.283651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915890bc-b885-4277-a841-9b9c09851d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:20.330662 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-915890bc-b885-4277-a841-9b9c09851d98 None None] MFA Rules not processed for user `dbc9e410089849f7ac7d6b0edc311203`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:20.332052 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-915890bc-b885-4277-a841-9b9c09851d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:20.436398 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 967/1951] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:20.441713 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e1674-2465-4083-8c6f-2ce5cb54e037 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:20.526126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e1674-2465-4083-8c6f-2ce5cb54e037 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:20.530967 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de46c3-1e3b-4c83-b4a2-4122e6987c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:20.531620 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de46c3-1e3b-4c83-b4a2-4122e6987c16 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:20.531900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de46c3-1e3b-4c83-b4a2-4122e6987c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:20.532176 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de46c3-1e3b-4c83-b4a2-4122e6987c16 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:20.532835 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de46c3-1e3b-4c83-b4a2-4122e6987c16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:20.534918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de46c3-1e3b-4c83-b4a2-4122e6987c16 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:20.573719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 985/1952] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:20 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:20.578616 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915890bc-b885-4277-a841-9b9c09851d98 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:20.593299 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915890bc-b885-4277-a841-9b9c09851d98 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:20.661914 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec70cb-f42a-41e9-b6e4-74df04b28fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:20.662706 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec70cb-f42a-41e9-b6e4-74df04b28fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:20.662991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec70cb-f42a-41e9-b6e4-74df04b28fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:20.663402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec70cb-f42a-41e9-b6e4-74df04b28fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:20.663942 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec70cb-f42a-41e9-b6e4-74df04b28fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:20.666423 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec70cb-f42a-41e9-b6e4-74df04b28fe8 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:20.679553 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:20.692636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 968/1953] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:20 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:54:20.698761 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de46c3-1e3b-4c83-b4a2-4122e6987c16 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:20.719561 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de46c3-1e3b-4c83-b4a2-4122e6987c16 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:20.725102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d88f97-22aa-437d-9d24-f903197f169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:20.725916 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d88f97-22aa-437d-9d24-f903197f169d admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:20.726515 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d88f97-22aa-437d-9d24-f903197f169d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:20.727105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d88f97-22aa-437d-9d24-f903197f169d admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:20.728030 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d88f97-22aa-437d-9d24-f903197f169d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:20.730084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d88f97-22aa-437d-9d24-f903197f169d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:20.742739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 986/1954] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:20.747989 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec70cb-f42a-41e9-b6e4-74df04b28fe8 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:20.758913 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec70cb-f42a-41e9-b6e4-74df04b28fe8 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:20.773137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c84b8-f6bd-41ab-8992-b668f80e225d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:20.773968 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c84b8-f6bd-41ab-8992-b668f80e225d admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:20.774246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c84b8-f6bd-41ab-8992-b668f80e225d admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:20.774525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c84b8-f6bd-41ab-8992-b668f80e225d admin admin] PATH_INFO: `/v3/projects/935fa0134f9e4fc2950abeb775a47233/users/3cea8b69e20649a09c8e3b76e87d5941/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:20.805092 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c84b8-f6bd-41ab-8992-b668f80e225d admin admin] RBAC: Authorizing `identity:create_grant(project_id=935fa0134f9e4fc2950abeb775a47233, user_id=3cea8b69e20649a09c8e3b76e87d5941, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:20.810268 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c84b8-f6bd-41ab-8992-b668f80e225d admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:20.831171 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 969/1955] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:20 2022] PUT /identity/v3/projects/935fa0134f9e4fc2950abeb775a47233/users/3cea8b69e20649a09c8e3b76e87d5941/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:20.836488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d88f97-22aa-437d-9d24-f903197f169d admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:20.848764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d88f97-22aa-437d-9d24-f903197f169d admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:20.929727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e278b-5f25-4b04-aa0a-5c873a0e641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:20.930770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e278b-5f25-4b04-aa0a-5c873a0e641a admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:20.931232 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e278b-5f25-4b04-aa0a-5c873a0e641a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:20.931696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e278b-5f25-4b04-aa0a-5c873a0e641a admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:20.932465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e278b-5f25-4b04-aa0a-5c873a0e641a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:20.934379 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e278b-5f25-4b04-aa0a-5c873a0e641a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:20.950146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 987/1956] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:20.956153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c84b8-f6bd-41ab-8992-b668f80e225d admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:20.987607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c84b8-f6bd-41ab-8992-b668f80e225d admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:20.995144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd924f2-5934-4ac8-817d-dd869e6dbf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:20.996543 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd924f2-5934-4ac8-817d-dd869e6dbf08 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:20.996992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd924f2-5934-4ac8-817d-dd869e6dbf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:20.997704 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd924f2-5934-4ac8-817d-dd869e6dbf08 admin admin] PATH_INFO: `/v3/projects/935fa0134f9e4fc2950abeb775a47233/users/3cea8b69e20649a09c8e3b76e87d5941/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:21.001489 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd924f2-5934-4ac8-817d-dd869e6dbf08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935fa0134f9e4fc2950abeb775a47233, user_id=3cea8b69e20649a09c8e3b76e87d5941, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:21.007458 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd924f2-5934-4ac8-817d-dd869e6dbf08 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:21.030841 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 970/1957] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:20 2022] PUT /identity/v3/projects/935fa0134f9e4fc2950abeb775a47233/users/3cea8b69e20649a09c8e3b76e87d5941/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:21.041855 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d084182-2305-473a-9280-1547986f3a37 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:21.042308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d084182-2305-473a-9280-1547986f3a37 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:21.042727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d084182-2305-473a-9280-1547986f3a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:21.078387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-1d084182-2305-473a-9280-1547986f3a37 None None] MFA Rules not processed for user `3cea8b69e20649a09c8e3b76e87d5941`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:21.079745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1d084182-2305-473a-9280-1547986f3a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:21.100333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:21.254985 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 988/1958] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:21.267221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd924f2-5934-4ac8-817d-dd869e6dbf08 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:21.271064 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ccd924f2-5934-4ac8-817d-dd869e6dbf08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:21.518494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d084182-2305-473a-9280-1547986f3a37 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:21.520645 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1d084182-2305-473a-9280-1547986f3a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:21.530417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd924f2-5934-4ac8-817d-dd869e6dbf08 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:21.537371 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ad564-17c0-4ac6-b706-15c89a7cf3b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:21.538597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ad564-17c0-4ac6-b706-15c89a7cf3b9 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:21.539935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ad564-17c0-4ac6-b706-15c89a7cf3b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:21.540589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ad564-17c0-4ac6-b706-15c89a7cf3b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:21.716930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d084182-2305-473a-9280-1547986f3a37 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:21.738836 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54db384-a7f2-4e1f-995c-28eb31427641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:21.745812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54db384-a7f2-4e1f-995c-28eb31427641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:21.748617 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54db384-a7f2-4e1f-995c-28eb31427641 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:21.749006 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54db384-a7f2-4e1f-995c-28eb31427641 admin admin] PATH_INFO: `/v3/users/003c2c7f573c41dc9aad33e4e94e59ab` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:21.753268 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54db384-a7f2-4e1f-995c-28eb31427641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=003c2c7f573c41dc9aad33e4e94e59ab)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:21.759508 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54db384-a7f2-4e1f-995c-28eb31427641 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:21.766277 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ad564-17c0-4ac6-b706-15c89a7cf3b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:21.775015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ad564-17c0-4ac6-b706-15c89a7cf3b9 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:21.804805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 971/1959] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:21.947438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b54db384-a7f2-4e1f-995c-28eb31427641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003c2c7f573c41dc9aad33e4e94e59ab'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:21.970381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b54db384-a7f2-4e1f-995c-28eb31427641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003c2c7f573c41dc9aad33e4e94e59ab'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:22.013705 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b54db384-a7f2-4e1f-995c-28eb31427641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003c2c7f573c41dc9aad33e4e94e59ab'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:22.040669 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b54db384-a7f2-4e1f-995c-28eb31427641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003c2c7f573c41dc9aad33e4e94e59ab'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:22.042376 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b54db384-a7f2-4e1f-995c-28eb31427641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003c2c7f573c41dc9aad33e4e94e59ab'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:22.071838 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9cc84-f720-4821-925f-8b55336ea5bf None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:22.072087 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9cc84-f720-4821-925f-8b55336ea5bf None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:22.072277 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9cc84-f720-4821-925f-8b55336ea5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:22.072832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 989/1960] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:21 2022] DELETE /identity/v3/users/003c2c7f573c41dc9aad33e4e94e59ab => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:54:22.109991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-fea9cc84-f720-4821-925f-8b55336ea5bf None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:22.111884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-fea9cc84-f720-4821-925f-8b55336ea5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:22.294626 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 972/1961] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:22.320428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54db384-a7f2-4e1f-995c-28eb31427641 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:22.324189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b54db384-a7f2-4e1f-995c-28eb31427641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:22.425044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:22.523518 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54db384-a7f2-4e1f-995c-28eb31427641 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:22.530387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a60c1-a670-411a-ab6f-2860b1f731fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:22.531570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a60c1-a670-411a-ab6f-2860b1f731fd service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:22.532127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a60c1-a670-411a-ab6f-2860b1f731fd service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:22.532570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a60c1-a670-411a-ab6f-2860b1f731fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:22.549796 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a60c1-a670-411a-ab6f-2860b1f731fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:22.551909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a60c1-a670-411a-ab6f-2860b1f731fd service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:22.572588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 990/1962] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:23.890675 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9cc84-f720-4821-925f-8b55336ea5bf None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:23.892303 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-fea9cc84-f720-4821-925f-8b55336ea5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:23.910484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a60c1-a670-411a-ab6f-2860b1f731fd service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:23.912714 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ac8a60c1-a670-411a-ab6f-2860b1f731fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:23.949814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a60c1-a670-411a-ab6f-2860b1f731fd service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:23.955897 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c6b58-fedc-4ba6-b13a-ed28e4c2ca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:23.957293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6b58-fedc-4ba6-b13a-ed28e4c2ca22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:23.959219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6b58-fedc-4ba6-b13a-ed28e4c2ca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:23.959907 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:23.960240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6b58-fedc-4ba6-b13a-ed28e4c2ca22 admin admin] PATH_INFO: `/v3/projects/c6d19af7016f4171b7bec612fa951a94` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:23.962577 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c6b58-fedc-4ba6-b13a-ed28e4c2ca22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d19af7016f4171b7bec612fa951a94)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:23.966854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c6b58-fedc-4ba6-b13a-ed28e4c2ca22 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:24.080388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9cc84-f720-4821-925f-8b55336ea5bf None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:24.084349 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-413c6b58-fedc-4ba6-b13a-ed28e4c2ca22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d19af7016f4171b7bec612fa951a94', 'request_id': 'req-413c6b58-fedc-4ba6-b13a-ed28e4c2ca22'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:24.096277 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-413c6b58-fedc-4ba6-b13a-ed28e4c2ca22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d19af7016f4171b7bec612fa951a94', 'request_id': 'req-413c6b58-fedc-4ba6-b13a-ed28e4c2ca22'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:24.105247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-413c6b58-fedc-4ba6-b13a-ed28e4c2ca22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d19af7016f4171b7bec612fa951a94', 'request_id': 'req-413c6b58-fedc-4ba6-b13a-ed28e4c2ca22'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:24.122186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-413c6b58-fedc-4ba6-b13a-ed28e4c2ca22 admin admin] The token cache is being invalidate because project c6d19af7016f4171b7bec612fa951a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:24.122758 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-413c6b58-fedc-4ba6-b13a-ed28e4c2ca22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:24.124795 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-413c6b58-fedc-4ba6-b13a-ed28e4c2ca22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:24.126732 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 991/1963] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:23 2022] DELETE /identity/v3/projects/c6d19af7016f4171b7bec612fa951a94 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:24.133670 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b140-2464-4415-9de5-c29b3c387f46 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:24.134159 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b140-2464-4415-9de5-c29b3c387f46 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:24.134823 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9b140-2464-4415-9de5-c29b3c387f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:24.161400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-b2a9b140-2464-4415-9de5-c29b3c387f46 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:24.163142 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b2a9b140-2464-4415-9de5-c29b3c387f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:24.175069 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6132ae4-e425-4134-a629-04b2195b2cfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:24.176123 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6132ae4-e425-4134-a629-04b2195b2cfb service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:24.176603 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6132ae4-e425-4134-a629-04b2195b2cfb service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:24.177069 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6132ae4-e425-4134-a629-04b2195b2cfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:24.180419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c6132ae4-e425-4134-a629-04b2195b2cfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:24.261224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 992/1964] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:24.271052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00fef2-1527-486e-b4a3-49f8d99c761f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:24.271052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00fef2-1527-486e-b4a3-49f8d99c761f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:24.271817 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00fef2-1527-486e-b4a3-49f8d99c761f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:24.281481 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6132ae4-e425-4134-a629-04b2195b2cfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:24.283200 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6132ae4-e425-4134-a629-04b2195b2cfb service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:24.295245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 973/1965] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:54:24.299168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-1f00fef2-1527-486e-b4a3-49f8d99c761f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:24.300810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1f00fef2-1527-486e-b4a3-49f8d99c761f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:24.309939 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 993/1966] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:24.314199 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6132ae4-e425-4134-a629-04b2195b2cfb service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:24.326835 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6132ae4-e425-4134-a629-04b2195b2cfb service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:24.332636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36edaff-f49e-41dc-b649-6c17c83bf115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:24.333279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36edaff-f49e-41dc-b649-6c17c83bf115 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:24.333601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36edaff-f49e-41dc-b649-6c17c83bf115 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:24.333870 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36edaff-f49e-41dc-b649-6c17c83bf115 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:24.334578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36edaff-f49e-41dc-b649-6c17c83bf115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:54:24.334880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36edaff-f49e-41dc-b649-6c17c83bf115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:24.336800 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36edaff-f49e-41dc-b649-6c17c83bf115 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:24.358315 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 974/1967] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:54:24.360138 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00fef2-1527-486e-b4a3-49f8d99c761f None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:24.378516 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00fef2-1527-486e-b4a3-49f8d99c761f None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:24.385462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0e0dd-cbf9-491c-b705-0a9dfb03e9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:24.385462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0e0dd-cbf9-491c-b705-0a9dfb03e9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:24.385891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0e0dd-cbf9-491c-b705-0a9dfb03e9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:24.386231 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0e0dd-cbf9-491c-b705-0a9dfb03e9b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:24.387207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0e0dd-cbf9-491c-b705-0a9dfb03e9b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:24.390272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0e0dd-cbf9-491c-b705-0a9dfb03e9b2 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:24.456056 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 994/1968] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:24 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:24.460510 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36edaff-f49e-41dc-b649-6c17c83bf115 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:24.491622 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36edaff-f49e-41dc-b649-6c17c83bf115 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:24.627590 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79015ab5-c386-42ff-a156-1c0b29545dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:24.628271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79015ab5-c386-42ff-a156-1c0b29545dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:24.628654 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79015ab5-c386-42ff-a156-1c0b29545dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:24.629065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79015ab5-c386-42ff-a156-1c0b29545dc9 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:24.630079 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79015ab5-c386-42ff-a156-1c0b29545dc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:24.632838 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79015ab5-c386-42ff-a156-1c0b29545dc9 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:24.659767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:24.670910 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 975/1969] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:24 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:24.676794 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0e0dd-cbf9-491c-b705-0a9dfb03e9b2 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:24.695477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0e0dd-cbf9-491c-b705-0a9dfb03e9b2 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:24.713537 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701bda7-159f-447f-8160-d36fd78dc659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:24.715363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701bda7-159f-447f-8160-d36fd78dc659 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:24.716056 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701bda7-159f-447f-8160-d36fd78dc659 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:24.716763 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701bda7-159f-447f-8160-d36fd78dc659 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:24.719838 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701bda7-159f-447f-8160-d36fd78dc659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:24.723316 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701bda7-159f-447f-8160-d36fd78dc659 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:24.751844 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 995/1970] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:24.757449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79015ab5-c386-42ff-a156-1c0b29545dc9 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:24.782209 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79015ab5-c386-42ff-a156-1c0b29545dc9 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:24.790501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f53eaa-d984-40d2-9d8b-adfac89b64ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:24.791135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f53eaa-d984-40d2-9d8b-adfac89b64ac admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:24.791413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f53eaa-d984-40d2-9d8b-adfac89b64ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:24.791685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f53eaa-d984-40d2-9d8b-adfac89b64ac admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:24.792347 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f53eaa-d984-40d2-9d8b-adfac89b64ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:24.795144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f53eaa-d984-40d2-9d8b-adfac89b64ac admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:24.811888 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 976/1971] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:24.814677 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701bda7-159f-447f-8160-d36fd78dc659 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:24.827388 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701bda7-159f-447f-8160-d36fd78dc659 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:24.835567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c2f56-8827-430e-b985-4cce809e28a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:24.836407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2f56-8827-430e-b985-4cce809e28a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:24.836689 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2f56-8827-430e-b985-4cce809e28a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:24.836954 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2f56-8827-430e-b985-4cce809e28a2 admin admin] PATH_INFO: `/v3/projects/5da0800c89154cb6a92a10dadd2657b4/users/f26aeaf8b97e4bb4892fb86b5f86d58b/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:24.857046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c2f56-8827-430e-b985-4cce809e28a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da0800c89154cb6a92a10dadd2657b4, user_id=f26aeaf8b97e4bb4892fb86b5f86d58b, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:24.861374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c2f56-8827-430e-b985-4cce809e28a2 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:24.864460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:24.885408 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 996/1972] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:24 2022] PUT /identity/v3/projects/5da0800c89154cb6a92a10dadd2657b4/users/f26aeaf8b97e4bb4892fb86b5f86d58b/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:24.894443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e737b-6ccd-4e4c-aab3-1c35c0416448 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:24.895119 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e737b-6ccd-4e4c-aab3-1c35c0416448 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:24.895119 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e737b-6ccd-4e4c-aab3-1c35c0416448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:24.929682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-392e737b-6ccd-4e4c-aab3-1c35c0416448 None None] MFA Rules not processed for user `f26aeaf8b97e4bb4892fb86b5f86d58b`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:24.931272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-392e737b-6ccd-4e4c-aab3-1c35c0416448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:25.050667 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 977/1973] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:54:25.064460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c2f56-8827-430e-b985-4cce809e28a2 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:25.067360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c82c2f56-8827-430e-b985-4cce809e28a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:25.231896 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c2f56-8827-430e-b985-4cce809e28a2 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:25.236261 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6001d15-2a1e-486f-a98d-05c2a673dbfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:25.237292 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6001d15-2a1e-486f-a98d-05c2a673dbfb service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:25.237706 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6001d15-2a1e-486f-a98d-05c2a673dbfb service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:25.238073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6001d15-2a1e-486f-a98d-05c2a673dbfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:25.249716 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6001d15-2a1e-486f-a98d-05c2a673dbfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:25.252015 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6001d15-2a1e-486f-a98d-05c2a673dbfb service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:25.266417 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 997/1974] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:25.498946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e737b-6ccd-4e4c-aab3-1c35c0416448 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:25.502200 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-392e737b-6ccd-4e4c-aab3-1c35c0416448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:25.523820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e737b-6ccd-4e4c-aab3-1c35c0416448 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:25.537712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a659b8d-fda1-4d07-b99a-044aa724974f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:25.537712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a659b8d-fda1-4d07-b99a-044aa724974f service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:25.537712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a659b8d-fda1-4d07-b99a-044aa724974f service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:25.537712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a659b8d-fda1-4d07-b99a-044aa724974f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:25.539273 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0a659b8d-fda1-4d07-b99a-044aa724974f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:25.677626 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a659b8d-fda1-4d07-b99a-044aa724974f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:25.677626 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a659b8d-fda1-4d07-b99a-044aa724974f service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:25.689571 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 978/1975] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:54:28.909531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6001d15-2a1e-486f-a98d-05c2a673dbfb service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:28.912792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b6001d15-2a1e-486f-a98d-05c2a673dbfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:29.135272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6001d15-2a1e-486f-a98d-05c2a673dbfb service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:29.150115 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cc330-7a09-436f-af68-813ca689b6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:29.151367 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cc330-7a09-436f-af68-813ca689b6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:29.152132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cc330-7a09-436f-af68-813ca689b6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:29.153251 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cc330-7a09-436f-af68-813ca689b6ce admin admin] PATH_INFO: `/v3/users/5b2fbc8918e84af793e01331dfec2be6` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:29.158018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cc330-7a09-436f-af68-813ca689b6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b2fbc8918e84af793e01331dfec2be6)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:29.164697 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cc330-7a09-436f-af68-813ca689b6ce admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:29.311826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2a2cc330-7a09-436f-af68-813ca689b6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b2fbc8918e84af793e01331dfec2be6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:29.329640 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2a2cc330-7a09-436f-af68-813ca689b6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b2fbc8918e84af793e01331dfec2be6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:29.378500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2a2cc330-7a09-436f-af68-813ca689b6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b2fbc8918e84af793e01331dfec2be6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:29.395537 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2a2cc330-7a09-436f-af68-813ca689b6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b2fbc8918e84af793e01331dfec2be6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:29.396522 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2a2cc330-7a09-436f-af68-813ca689b6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b2fbc8918e84af793e01331dfec2be6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:29.413335 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 998/1976] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:28 2022] DELETE /identity/v3/users/5b2fbc8918e84af793e01331dfec2be6 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:29.420320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38701e-4c10-4976-a856-005bb9874f37 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:29.421818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38701e-4c10-4976-a856-005bb9874f37 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:29.422224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38701e-4c10-4976-a856-005bb9874f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:29.458622 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-6c38701e-4c10-4976-a856-005bb9874f37 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:29.462532 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6c38701e-4c10-4976-a856-005bb9874f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:29.589190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 979/1977] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:29.604679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cc330-7a09-436f-af68-813ca689b6ce admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:29.607216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2a2cc330-7a09-436f-af68-813ca689b6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:29.660710 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:29.746119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cc330-7a09-436f-af68-813ca689b6ce admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:29.751034 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a24600-fd4c-4a41-949d-fb704d18cc30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:29.751691 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a24600-fd4c-4a41-949d-fb704d18cc30 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:29.751973 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a24600-fd4c-4a41-949d-fb704d18cc30 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:29.752337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a24600-fd4c-4a41-949d-fb704d18cc30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:29.766317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a24600-fd4c-4a41-949d-fb704d18cc30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:29.767806 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a24600-fd4c-4a41-949d-fb704d18cc30 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:29.784891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 999/1978] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:30.341266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38701e-4c10-4976-a856-005bb9874f37 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:30.342809 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6c38701e-4c10-4976-a856-005bb9874f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:30.356031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38701e-4c10-4976-a856-005bb9874f37 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:30.361859 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5713755-503b-40ed-9bf7-e0189be27742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:30.362531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5713755-503b-40ed-9bf7-e0189be27742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:30.362805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5713755-503b-40ed-9bf7-e0189be27742 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:30.363162 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5713755-503b-40ed-9bf7-e0189be27742 admin admin] PATH_INFO: `/v3/users/0736013d56fe4ba98e4a3a3d969eb554` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:30.364476 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5713755-503b-40ed-9bf7-e0189be27742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0736013d56fe4ba98e4a3a3d969eb554)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:30.366774 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5713755-503b-40ed-9bf7-e0189be27742 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:30.375463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:30.420325 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a24600-fd4c-4a41-949d-fb704d18cc30 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:30.428111 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-08a24600-fd4c-4a41-949d-fb704d18cc30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:30.477465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a24600-fd4c-4a41-949d-fb704d18cc30 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:30.498216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462db8aa-7249-4bd4-8071-3d518363f846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:30.504264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462db8aa-7249-4bd4-8071-3d518363f846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:30.504909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462db8aa-7249-4bd4-8071-3d518363f846 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:30.505604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462db8aa-7249-4bd4-8071-3d518363f846 admin admin] PATH_INFO: `/v3/projects/d7ebd1fe98ec44cb929c36385678328b` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:30.510499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462db8aa-7249-4bd4-8071-3d518363f846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ebd1fe98ec44cb929c36385678328b)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:30.516161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462db8aa-7249-4bd4-8071-3d518363f846 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:30.546630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-b5713755-503b-40ed-9bf7-e0189be27742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0736013d56fe4ba98e4a3a3d969eb554'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:30.547868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-b5713755-503b-40ed-9bf7-e0189be27742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0736013d56fe4ba98e4a3a3d969eb554'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:30.550559 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-b5713755-503b-40ed-9bf7-e0189be27742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0736013d56fe4ba98e4a3a3d969eb554'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:30.603630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-b5713755-503b-40ed-9bf7-e0189be27742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0736013d56fe4ba98e4a3a3d969eb554'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:30.624958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-b5713755-503b-40ed-9bf7-e0189be27742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0736013d56fe4ba98e4a3a3d969eb554'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:30.650162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-462db8aa-7249-4bd4-8071-3d518363f846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ebd1fe98ec44cb929c36385678328b', 'request_id': 'req-462db8aa-7249-4bd4-8071-3d518363f846'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:30.661427 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 980/1979] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:30 2022] DELETE /identity/v3/users/0736013d56fe4ba98e4a3a3d969eb554 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:30.670687 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acca29-0797-4019-ab84-cc3ab67345ae None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:30.671220 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acca29-0797-4019-ab84-cc3ab67345ae None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:30.671455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-462db8aa-7249-4bd4-8071-3d518363f846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ebd1fe98ec44cb929c36385678328b', 'request_id': 'req-462db8aa-7249-4bd4-8071-3d518363f846'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:30.673287 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acca29-0797-4019-ab84-cc3ab67345ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:30.690638 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-462db8aa-7249-4bd4-8071-3d518363f846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ebd1fe98ec44cb929c36385678328b', 'request_id': 'req-462db8aa-7249-4bd4-8071-3d518363f846'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:30.716055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-462db8aa-7249-4bd4-8071-3d518363f846 admin admin] The token cache is being invalidate because project d7ebd1fe98ec44cb929c36385678328b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:30.717679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-462db8aa-7249-4bd4-8071-3d518363f846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:30.718989 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-462db8aa-7249-4bd4-8071-3d518363f846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:30.723532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1000/1980] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:30 2022] DELETE /identity/v3/projects/d7ebd1fe98ec44cb929c36385678328b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:30.730283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462db8aa-7249-4bd4-8071-3d518363f846 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:30.733057 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-462db8aa-7249-4bd4-8071-3d518363f846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:30.736845 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-a8acca29-0797-4019-ab84-cc3ab67345ae None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:30.739405 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a8acca29-0797-4019-ab84-cc3ab67345ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:30.894920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 981/1981] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:30.908984 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acca29-0797-4019-ab84-cc3ab67345ae None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:30.909466 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462db8aa-7249-4bd4-8071-3d518363f846 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:30.911630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a8acca29-0797-4019-ab84-cc3ab67345ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:30.922808 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae69ab-3142-403f-8b47-3db65f2a33bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:30.925493 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae69ab-3142-403f-8b47-3db65f2a33bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:30.926015 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae69ab-3142-403f-8b47-3db65f2a33bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:30.926551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae69ab-3142-403f-8b47-3db65f2a33bf admin admin] PATH_INFO: `/v3/users/21eab6edf6884ceea0fe5b0fd52d6d4f` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:30.929020 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae69ab-3142-403f-8b47-3db65f2a33bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=21eab6edf6884ceea0fe5b0fd52d6d4f)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:30.933971 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae69ab-3142-403f-8b47-3db65f2a33bf admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:31.063505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:31.069368 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-02ae69ab-3142-403f-8b47-3db65f2a33bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21eab6edf6884ceea0fe5b0fd52d6d4f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:31.078798 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acca29-0797-4019-ab84-cc3ab67345ae None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:31.083415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8d69b-f9ad-4e3e-b9fa-b82f207cc825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:31.084903 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8d69b-f9ad-4e3e-b9fa-b82f207cc825 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:31.085533 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8d69b-f9ad-4e3e-b9fa-b82f207cc825 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:31.085956 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8d69b-f9ad-4e3e-b9fa-b82f207cc825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:31.088949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-02ae69ab-3142-403f-8b47-3db65f2a33bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21eab6edf6884ceea0fe5b0fd52d6d4f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:31.110604 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8d69b-f9ad-4e3e-b9fa-b82f207cc825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:31.115653 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8d69b-f9ad-4e3e-b9fa-b82f207cc825 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:31.120965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-02ae69ab-3142-403f-8b47-3db65f2a33bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21eab6edf6884ceea0fe5b0fd52d6d4f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:31.133276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-02ae69ab-3142-403f-8b47-3db65f2a33bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21eab6edf6884ceea0fe5b0fd52d6d4f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:31.134361 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-02ae69ab-3142-403f-8b47-3db65f2a33bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21eab6edf6884ceea0fe5b0fd52d6d4f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:31.141466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 982/1982] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:54:31.147150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1001/1983] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:30 2022] DELETE /identity/v3/users/21eab6edf6884ceea0fe5b0fd52d6d4f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:32.287674 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8d69b-f9ad-4e3e-b9fa-b82f207cc825 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:32.289555 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-71d8d69b-f9ad-4e3e-b9fa-b82f207cc825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:32.304301 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae69ab-3142-403f-8b47-3db65f2a33bf admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:32.307610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-02ae69ab-3142-403f-8b47-3db65f2a33bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:32.312343 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8d69b-f9ad-4e3e-b9fa-b82f207cc825 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:32.391557 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:32.487184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae69ab-3142-403f-8b47-3db65f2a33bf admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:32.497654 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f8a68-ba35-4ced-a01e-e52ecc1b4afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:32.498946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f8a68-ba35-4ced-a01e-e52ecc1b4afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:32.499549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f8a68-ba35-4ced-a01e-e52ecc1b4afb admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:32.500125 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f8a68-ba35-4ced-a01e-e52ecc1b4afb admin admin] PATH_INFO: `/v3/projects/97da1459d223467e9755d99a20560054` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:32.503799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f8a68-ba35-4ced-a01e-e52ecc1b4afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=97da1459d223467e9755d99a20560054)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:32.504782 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb7f00-067a-43c0-a37e-87ec718f4a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:32.506742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f8a68-ba35-4ced-a01e-e52ecc1b4afb admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:32.507626 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb7f00-067a-43c0-a37e-87ec718f4a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:32.507967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb7f00-067a-43c0-a37e-87ec718f4a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:32.508410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb7f00-067a-43c0-a37e-87ec718f4a98 admin admin] PATH_INFO: `/v3/projects/2287180187c648dea6f40853f0f3c4fb` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:32.511010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb7f00-067a-43c0-a37e-87ec718f4a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2287180187c648dea6f40853f0f3c4fb)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:32.513636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb7f00-067a-43c0-a37e-87ec718f4a98 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:32.586791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-53fb7f00-067a-43c0-a37e-87ec718f4a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2287180187c648dea6f40853f0f3c4fb', 'request_id': 'req-53fb7f00-067a-43c0-a37e-87ec718f4a98'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:32.602843 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-53fb7f00-067a-43c0-a37e-87ec718f4a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2287180187c648dea6f40853f0f3c4fb', 'request_id': 'req-53fb7f00-067a-43c0-a37e-87ec718f4a98'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:32.615780 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8f2f8a68-ba35-4ced-a01e-e52ecc1b4afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97da1459d223467e9755d99a20560054', 'request_id': 'req-8f2f8a68-ba35-4ced-a01e-e52ecc1b4afb'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:32.633693 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-53fb7f00-067a-43c0-a37e-87ec718f4a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2287180187c648dea6f40853f0f3c4fb', 'request_id': 'req-53fb7f00-067a-43c0-a37e-87ec718f4a98'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:32.640400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8f2f8a68-ba35-4ced-a01e-e52ecc1b4afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97da1459d223467e9755d99a20560054', 'request_id': 'req-8f2f8a68-ba35-4ced-a01e-e52ecc1b4afb'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:32.653170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8f2f8a68-ba35-4ced-a01e-e52ecc1b4afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97da1459d223467e9755d99a20560054', 'request_id': 'req-8f2f8a68-ba35-4ced-a01e-e52ecc1b4afb'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:32.658569 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-53fb7f00-067a-43c0-a37e-87ec718f4a98 admin admin] The token cache is being invalidate because project 2287180187c648dea6f40853f0f3c4fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:32.659266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-53fb7f00-067a-43c0-a37e-87ec718f4a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:32.660809 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-53fb7f00-067a-43c0-a37e-87ec718f4a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:32.664212 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 983/1984] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:32 2022] DELETE /identity/v3/projects/2287180187c648dea6f40853f0f3c4fb => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:32.671393 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb7f00-067a-43c0-a37e-87ec718f4a98 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:32.675138 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-53fb7f00-067a-43c0-a37e-87ec718f4a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:32.684749 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8f2f8a68-ba35-4ced-a01e-e52ecc1b4afb admin admin] The token cache is being invalidate because project 97da1459d223467e9755d99a20560054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:32.685388 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8f2f8a68-ba35-4ced-a01e-e52ecc1b4afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:32.687416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8f2f8a68-ba35-4ced-a01e-e52ecc1b4afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:32.692814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1002/1985] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:32 2022] DELETE /identity/v3/projects/97da1459d223467e9755d99a20560054 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:32.699303 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a1292-7a61-4a89-a6fe-60fb9c6a24c8 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:32.699778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a1292-7a61-4a89-a6fe-60fb9c6a24c8 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:32.700381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a1292-7a61-4a89-a6fe-60fb9c6a24c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:32.741818 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-464a1292-7a61-4a89-a6fe-60fb9c6a24c8 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:32.744183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-464a1292-7a61-4a89-a6fe-60fb9c6a24c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:32.840134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb7f00-067a-43c0-a37e-87ec718f4a98 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:32.898898 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:32.930476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1003/1986] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:32.939429 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779d482-2d55-4b71-aa13-548787a5ef2b None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:32.939876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779d482-2d55-4b71-aa13-548787a5ef2b None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:32.940315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779d482-2d55-4b71-aa13-548787a5ef2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:32.997876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-3779d482-2d55-4b71-aa13-548787a5ef2b None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:33.000484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3779d482-2d55-4b71-aa13-548787a5ef2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:33.022275 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1004/1987] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:54:33.025192 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779d482-2d55-4b71-aa13-548787a5ef2b None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:33.027647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4947d0-8719-4cf6-ab83-a5e7d33f371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:33.028654 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4947d0-8719-4cf6-ab83-a5e7d33f371c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:33.029291 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4947d0-8719-4cf6-ab83-a5e7d33f371c admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:33.029845 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4947d0-8719-4cf6-ab83-a5e7d33f371c admin admin] PATH_INFO: `/v3/users/dbc9e410089849f7ac7d6b0edc311203` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:33.038346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4947d0-8719-4cf6-ab83-a5e7d33f371c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbc9e410089849f7ac7d6b0edc311203)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:33.045389 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4947d0-8719-4cf6-ab83-a5e7d33f371c admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:33.053414 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779d482-2d55-4b71-aa13-548787a5ef2b None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:33.062642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68eb76-b787-4658-88c7-d071088b4a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:33.063953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68eb76-b787-4658-88c7-d071088b4a4f admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:33.064494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68eb76-b787-4658-88c7-d071088b4a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:33.065039 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68eb76-b787-4658-88c7-d071088b4a4f admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:33.067194 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:33.067482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68eb76-b787-4658-88c7-d071088b4a4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:54:33.067482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68eb76-b787-4658-88c7-d071088b4a4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:33.071821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68eb76-b787-4658-88c7-d071088b4a4f admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:33.108085 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1005/1988] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:54:33.114306 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68eb76-b787-4658-88c7-d071088b4a4f admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:33.140160 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68eb76-b787-4658-88c7-d071088b4a4f admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:33.152222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e11811-9776-4dd7-8362-3ceb2ea20a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:33.155051 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e11811-9776-4dd7-8362-3ceb2ea20a8f admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:33.155840 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e11811-9776-4dd7-8362-3ceb2ea20a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:33.156582 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e11811-9776-4dd7-8362-3ceb2ea20a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:33.158368 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e11811-9776-4dd7-8362-3ceb2ea20a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:33.163082 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e11811-9776-4dd7-8362-3ceb2ea20a8f admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:33.190305 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2d4947d0-8719-4cf6-ab83-a5e7d33f371c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbc9e410089849f7ac7d6b0edc311203'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:33.198429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2d4947d0-8719-4cf6-ab83-a5e7d33f371c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbc9e410089849f7ac7d6b0edc311203'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:33.199573 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2d4947d0-8719-4cf6-ab83-a5e7d33f371c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbc9e410089849f7ac7d6b0edc311203'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:33.252920 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1006/1989] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:33 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:33.254938 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e11811-9776-4dd7-8362-3ceb2ea20a8f admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:33.262356 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2d4947d0-8719-4cf6-ab83-a5e7d33f371c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbc9e410089849f7ac7d6b0edc311203'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:33.270293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-66e11811-9776-4dd7-8362-3ceb2ea20a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:33.292484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2d4947d0-8719-4cf6-ab83-a5e7d33f371c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbc9e410089849f7ac7d6b0edc311203'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:33.330387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 984/1990] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:32 2022] DELETE /identity/v3/users/dbc9e410089849f7ac7d6b0edc311203 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:33.487888 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e11811-9776-4dd7-8362-3ceb2ea20a8f admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:33.726974 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c92f4-0337-41e9-b3f8-3198302d4d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:33.732755 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c92f4-0337-41e9-b3f8-3198302d4d7c admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:33.733194 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c92f4-0337-41e9-b3f8-3198302d4d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:33.733507 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c92f4-0337-41e9-b3f8-3198302d4d7c admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:33.734231 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c92f4-0337-41e9-b3f8-3198302d4d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:33.739449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c92f4-0337-41e9-b3f8-3198302d4d7c admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:33.807336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4947d0-8719-4cf6-ab83-a5e7d33f371c admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:33.809996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1007/1991] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:33 2022] POST /identity/v3/users => generated 291 bytes in 556 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:54:33.829633 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4947d0-8719-4cf6-ab83-a5e7d33f371c admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:33.847990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c120331-759b-48e3-8594-f6e99d2b8438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:33.848698 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c120331-759b-48e3-8594-f6e99d2b8438 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:33.849219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c120331-759b-48e3-8594-f6e99d2b8438 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:33.849770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c120331-759b-48e3-8594-f6e99d2b8438 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:33.851680 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c120331-759b-48e3-8594-f6e99d2b8438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:33.864481 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c120331-759b-48e3-8594-f6e99d2b8438 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:33.912410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 985/1992] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:33.916523 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c92f4-0337-41e9-b3f8-3198302d4d7c admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:33.930918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c92f4-0337-41e9-b3f8-3198302d4d7c admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:33.941862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772c735-f867-4269-8040-c1d24fcb295a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:33.942545 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772c735-f867-4269-8040-c1d24fcb295a admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:33.942827 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772c735-f867-4269-8040-c1d24fcb295a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:33.944308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772c735-f867-4269-8040-c1d24fcb295a admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:33.947593 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772c735-f867-4269-8040-c1d24fcb295a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:33.951563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772c735-f867-4269-8040-c1d24fcb295a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:33.982353 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1008/1993] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:33.987084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c120331-759b-48e3-8594-f6e99d2b8438 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:34.008359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c120331-759b-48e3-8594-f6e99d2b8438 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:34.029557 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7501485-2961-49eb-bf46-60ce8fcd95c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:34.032196 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7501485-2961-49eb-bf46-60ce8fcd95c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:34.033586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7501485-2961-49eb-bf46-60ce8fcd95c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:34.034040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7501485-2961-49eb-bf46-60ce8fcd95c2 admin admin] PATH_INFO: `/v3/projects/7cbf7ffab23e463bab79891f9af129e9/users/e20c17916aac440f8996d000e6abf739/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:34.084019 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7501485-2961-49eb-bf46-60ce8fcd95c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cbf7ffab23e463bab79891f9af129e9, user_id=e20c17916aac440f8996d000e6abf739, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:34.090866 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7501485-2961-49eb-bf46-60ce8fcd95c2 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:34.132101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 986/1994] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:33 2022] PUT /identity/v3/projects/7cbf7ffab23e463bab79891f9af129e9/users/e20c17916aac440f8996d000e6abf739/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:34.146208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04079f8-7a7a-4a08-a140-80a5e07563df None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:34.146809 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04079f8-7a7a-4a08-a140-80a5e07563df None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:34.147379 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04079f8-7a7a-4a08-a140-80a5e07563df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:34.242703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-f04079f8-7a7a-4a08-a140-80a5e07563df None None] MFA Rules not processed for user `e20c17916aac440f8996d000e6abf739`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:34.245329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-f04079f8-7a7a-4a08-a140-80a5e07563df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:34.336852 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7501485-2961-49eb-bf46-60ce8fcd95c2 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:34.339605 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f7501485-2961-49eb-bf46-60ce8fcd95c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:34.372468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:34.503455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1009/1995] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:34.507703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04079f8-7a7a-4a08-a140-80a5e07563df None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:34.543971 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7501485-2961-49eb-bf46-60ce8fcd95c2 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:34.565007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b0989-6ff0-4e03-83a9-82f16aa3d562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:34.566120 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b0989-6ff0-4e03-83a9-82f16aa3d562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:34.566655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b0989-6ff0-4e03-83a9-82f16aa3d562 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:34.568669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b0989-6ff0-4e03-83a9-82f16aa3d562 admin admin] PATH_INFO: `/v3/projects/6e30cde5b0ad4b968f336c3aec28f577` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:34.571810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b0989-6ff0-4e03-83a9-82f16aa3d562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e30cde5b0ad4b968f336c3aec28f577)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:34.580545 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b0989-6ff0-4e03-83a9-82f16aa3d562 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:34.684636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-478b0989-6ff0-4e03-83a9-82f16aa3d562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e30cde5b0ad4b968f336c3aec28f577', 'request_id': 'req-478b0989-6ff0-4e03-83a9-82f16aa3d562'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:34.687536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:34.688978 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04079f8-7a7a-4a08-a140-80a5e07563df None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:34.695468 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-478b0989-6ff0-4e03-83a9-82f16aa3d562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e30cde5b0ad4b968f336c3aec28f577', 'request_id': 'req-478b0989-6ff0-4e03-83a9-82f16aa3d562'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:34.712191 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-478b0989-6ff0-4e03-83a9-82f16aa3d562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e30cde5b0ad4b968f336c3aec28f577', 'request_id': 'req-478b0989-6ff0-4e03-83a9-82f16aa3d562'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:34.734948 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-478b0989-6ff0-4e03-83a9-82f16aa3d562 admin admin] The token cache is being invalidate because project 6e30cde5b0ad4b968f336c3aec28f577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:34.734948 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-478b0989-6ff0-4e03-83a9-82f16aa3d562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:34.735224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-478b0989-6ff0-4e03-83a9-82f16aa3d562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:34.742364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 987/1996] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:34 2022] DELETE /identity/v3/projects/6e30cde5b0ad4b968f336c3aec28f577 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:34.742364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b0989-6ff0-4e03-83a9-82f16aa3d562 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:34.742364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-478b0989-6ff0-4e03-83a9-82f16aa3d562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:34.810975 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c306f-4774-4f51-aa38-cf2680211d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:34.811917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c306f-4774-4f51-aa38-cf2680211d86 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:34.811917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c306f-4774-4f51-aa38-cf2680211d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:34.812327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c306f-4774-4f51-aa38-cf2680211d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:34.812984 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c306f-4774-4f51-aa38-cf2680211d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:34.815240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c306f-4774-4f51-aa38-cf2680211d86 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:34.869983 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1010/1997] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:34 2022] POST /identity/v3/projects => generated 381 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:34.869983 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c306f-4774-4f51-aa38-cf2680211d86 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:34.870934 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4c9c306f-4774-4f51-aa38-cf2680211d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:34.901660 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b0989-6ff0-4e03-83a9-82f16aa3d562 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:35.026905 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df177b97-14a9-44a2-ac42-a9a1ec246d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:35.028396 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df177b97-14a9-44a2-ac42-a9a1ec246d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:35.028686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df177b97-14a9-44a2-ac42-a9a1ec246d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:35.028956 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df177b97-14a9-44a2-ac42-a9a1ec246d06 admin admin] PATH_INFO: `/v3/users/e6b8d0f089b44ba38c2b22289e61734e` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:35.030849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df177b97-14a9-44a2-ac42-a9a1ec246d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b8d0f089b44ba38c2b22289e61734e)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:35.033842 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df177b97-14a9-44a2-ac42-a9a1ec246d06 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:35.054328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:35.062962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c306f-4774-4f51-aa38-cf2680211d86 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:35.073724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b1f0e-f7a4-46cf-adcf-3262e8131952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:35.075733 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b1f0e-f7a4-46cf-adcf-3262e8131952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:35.076218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b1f0e-f7a4-46cf-adcf-3262e8131952 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:35.076787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b1f0e-f7a4-46cf-adcf-3262e8131952 admin admin] PATH_INFO: `/v3/users/3cea8b69e20649a09c8e3b76e87d5941` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:35.079784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b1f0e-f7a4-46cf-adcf-3262e8131952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cea8b69e20649a09c8e3b76e87d5941)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:35.084057 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b1f0e-f7a4-46cf-adcf-3262e8131952 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:35.172037 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-df177b97-14a9-44a2-ac42-a9a1ec246d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b8d0f089b44ba38c2b22289e61734e'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:35.173046 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-df177b97-14a9-44a2-ac42-a9a1ec246d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b8d0f089b44ba38c2b22289e61734e'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:35.175865 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-df177b97-14a9-44a2-ac42-a9a1ec246d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b8d0f089b44ba38c2b22289e61734e'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:35.182842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4c8b1f0e-f7a4-46cf-adcf-3262e8131952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cea8b69e20649a09c8e3b76e87d5941'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:35.202942 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4c8b1f0e-f7a4-46cf-adcf-3262e8131952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cea8b69e20649a09c8e3b76e87d5941'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:35.209468 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-df177b97-14a9-44a2-ac42-a9a1ec246d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b8d0f089b44ba38c2b22289e61734e'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:35.238771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4c8b1f0e-f7a4-46cf-adcf-3262e8131952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cea8b69e20649a09c8e3b76e87d5941'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:35.240125 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-df177b97-14a9-44a2-ac42-a9a1ec246d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b8d0f089b44ba38c2b22289e61734e'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:35.255488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4c8b1f0e-f7a4-46cf-adcf-3262e8131952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cea8b69e20649a09c8e3b76e87d5941'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:35.256765 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4c8b1f0e-f7a4-46cf-adcf-3262e8131952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cea8b69e20649a09c8e3b76e87d5941'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:35.267607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1011/1998] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:34 2022] DELETE /identity/v3/users/3cea8b69e20649a09c8e3b76e87d5941 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:35.269028 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b1f0e-f7a4-46cf-adcf-3262e8131952 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:35.270570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4c8b1f0e-f7a4-46cf-adcf-3262e8131952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:35.291381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 988/1999] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:34 2022] DELETE /identity/v3/users/e6b8d0f089b44ba38c2b22289e61734e => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:35.433503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b1f0e-f7a4-46cf-adcf-3262e8131952 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:35.521046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb1260-e113-4e6a-b9fa-1edad15cae27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:35.522903 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb1260-e113-4e6a-b9fa-1edad15cae27 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:35.523236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb1260-e113-4e6a-b9fa-1edad15cae27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:35.524005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb1260-e113-4e6a-b9fa-1edad15cae27 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:35.524695 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb1260-e113-4e6a-b9fa-1edad15cae27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:35.527692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb1260-e113-4e6a-b9fa-1edad15cae27 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:35.583674 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df177b97-14a9-44a2-ac42-a9a1ec246d06 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:35.584492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1012/2000] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:35 2022] POST /identity/v3/users => generated 297 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:35.585855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-df177b97-14a9-44a2-ac42-a9a1ec246d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:35.606934 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df177b97-14a9-44a2-ac42-a9a1ec246d06 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:35.613551 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d8030-1093-4e0a-8d53-e6d4e0bf06dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:35.614502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d8030-1093-4e0a-8d53-e6d4e0bf06dc admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:35.614996 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d8030-1093-4e0a-8d53-e6d4e0bf06dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:35.615642 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d8030-1093-4e0a-8d53-e6d4e0bf06dc admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:35.616823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d8030-1093-4e0a-8d53-e6d4e0bf06dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:35.620457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d8030-1093-4e0a-8d53-e6d4e0bf06dc admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:35.622501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:35.641186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 989/2001] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:35.646259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb1260-e113-4e6a-b9fa-1edad15cae27 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:35.675656 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb1260-e113-4e6a-b9fa-1edad15cae27 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:35.683805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c45144-e02d-446c-9803-218c59d4035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:35.684708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c45144-e02d-446c-9803-218c59d4035b admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:35.685088 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c45144-e02d-446c-9803-218c59d4035b admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:35.685498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c45144-e02d-446c-9803-218c59d4035b admin admin] PATH_INFO: `/v3/projects/27457c5d973f497591139db3e23c7fc1/users/2a6b7777a8e1432c9ca63571c5c442ef/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:35.714380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d8030-1093-4e0a-8d53-e6d4e0bf06dc admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:35.717928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7f4d8030-1093-4e0a-8d53-e6d4e0bf06dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:35.720479 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:35.733184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c45144-e02d-446c-9803-218c59d4035b admin admin] RBAC: Authorizing `identity:create_grant(project_id=27457c5d973f497591139db3e23c7fc1, user_id=2a6b7777a8e1432c9ca63571c5c442ef, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:35.737959 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c45144-e02d-446c-9803-218c59d4035b admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:35.754108 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d8030-1093-4e0a-8d53-e6d4e0bf06dc admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:35.764062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:35.765797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:35.766165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:35.766165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8 admin admin] PATH_INFO: `/v3/projects/e92b1dea1e7048e69520940256aef913` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:35.768866 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e92b1dea1e7048e69520940256aef913)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:35.772690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:35.780592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1013/2002] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:35 2022] PUT /identity/v3/projects/27457c5d973f497591139db3e23c7fc1/users/2a6b7777a8e1432c9ca63571c5c442ef/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:35.786852 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c45144-e02d-446c-9803-218c59d4035b admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:35.855459 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e92b1dea1e7048e69520940256aef913', 'request_id': 'req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:35.868087 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e92b1dea1e7048e69520940256aef913', 'request_id': 'req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:35.882126 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e92b1dea1e7048e69520940256aef913', 'request_id': 'req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:35.888848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c45144-e02d-446c-9803-218c59d4035b admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:35.904479 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8 admin admin] The token cache is being invalidate because project e92b1dea1e7048e69520940256aef913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:35.904965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:35.905855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:35.907431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 990/2003] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:35 2022] DELETE /identity/v3/projects/e92b1dea1e7048e69520940256aef913 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:35.908230 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:35.913377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:35.969617 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd5045-b5fd-4f07-aff3-88a954317c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:35.970328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5045-b5fd-4f07-aff3-88a954317c81 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:35.970616 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5045-b5fd-4f07-aff3-88a954317c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:35.970882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5045-b5fd-4f07-aff3-88a954317c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:35.971763 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd5045-b5fd-4f07-aff3-88a954317c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:35.973435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd5045-b5fd-4f07-aff3-88a954317c81 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:35.985874 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1014/2004] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:35.990586 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540f52f-7c5a-4b69-8492-af45e38a1b72 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:35.990863 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540f52f-7c5a-4b69-8492-af45e38a1b72 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:35.991138 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540f52f-7c5a-4b69-8492-af45e38a1b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:35.997305 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add91ba-c1c3-41b8-8c64-0f1867ef58f8 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:36.005866 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eda5c7-7744-4c4e-82b5-6efec52c5138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:36.007709 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eda5c7-7744-4c4e-82b5-6efec52c5138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:36.008223 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eda5c7-7744-4c4e-82b5-6efec52c5138 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:36.008548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eda5c7-7744-4c4e-82b5-6efec52c5138 admin admin] PATH_INFO: `/v3/projects/935fa0134f9e4fc2950abeb775a47233` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:36.010627 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eda5c7-7744-4c4e-82b5-6efec52c5138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=935fa0134f9e4fc2950abeb775a47233)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:36.013106 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eda5c7-7744-4c4e-82b5-6efec52c5138 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:36.015050 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-4540f52f-7c5a-4b69-8492-af45e38a1b72 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:36.016463 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4540f52f-7c5a-4b69-8492-af45e38a1b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:36.038003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1015/2005] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:36.038003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540f52f-7c5a-4b69-8492-af45e38a1b72 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:36.038003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4540f52f-7c5a-4b69-8492-af45e38a1b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:36.046126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540f52f-7c5a-4b69-8492-af45e38a1b72 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:36.053659 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb56ccd-f6e1-4124-a696-244c4e6753a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:36.057540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb56ccd-f6e1-4124-a696-244c4e6753a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:36.058122 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb56ccd-f6e1-4124-a696-244c4e6753a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:36.058796 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb56ccd-f6e1-4124-a696-244c4e6753a5 admin admin] PATH_INFO: `/v3/projects/27457c5d973f497591139db3e23c7fc1/users/2a6b7777a8e1432c9ca63571c5c442ef/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:36.061395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb56ccd-f6e1-4124-a696-244c4e6753a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27457c5d973f497591139db3e23c7fc1, user_id=2a6b7777a8e1432c9ca63571c5c442ef, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:36.064689 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb56ccd-f6e1-4124-a696-244c4e6753a5 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:36.084655 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1016/2006] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:36 2022] PUT /identity/v3/projects/27457c5d973f497591139db3e23c7fc1/users/2a6b7777a8e1432c9ca63571c5c442ef/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:36.089126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ecd16-a449-4f95-8787-86ffde568387 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:36.089126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ecd16-a449-4f95-8787-86ffde568387 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:36.089126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ecd16-a449-4f95-8787-86ffde568387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:36.106660 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d0eda5c7-7744-4c4e-82b5-6efec52c5138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935fa0134f9e4fc2950abeb775a47233', 'request_id': 'req-d0eda5c7-7744-4c4e-82b5-6efec52c5138'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:36.115319 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d0eda5c7-7744-4c4e-82b5-6efec52c5138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935fa0134f9e4fc2950abeb775a47233', 'request_id': 'req-d0eda5c7-7744-4c4e-82b5-6efec52c5138'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:36.126093 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d0eda5c7-7744-4c4e-82b5-6efec52c5138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935fa0134f9e4fc2950abeb775a47233', 'request_id': 'req-d0eda5c7-7744-4c4e-82b5-6efec52c5138'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:36.127767 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-aa1ecd16-a449-4f95-8787-86ffde568387 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:36.129034 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-aa1ecd16-a449-4f95-8787-86ffde568387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:36.145868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d0eda5c7-7744-4c4e-82b5-6efec52c5138 admin admin] The token cache is being invalidate because project 935fa0134f9e4fc2950abeb775a47233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:36.146690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d0eda5c7-7744-4c4e-82b5-6efec52c5138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:36.148033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d0eda5c7-7744-4c4e-82b5-6efec52c5138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:36.151029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 991/2007] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:35 2022] DELETE /identity/v3/projects/935fa0134f9e4fc2950abeb775a47233 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:36.161551 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7a0f5-947d-4f1b-992b-ebe98cd39ce1 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:36.162040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7a0f5-947d-4f1b-992b-ebe98cd39ce1 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:36.162572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7a0f5-947d-4f1b-992b-ebe98cd39ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:36.203113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:36.212166 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1017/2008] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:36.215282 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5ebf6-07e3-4dcd-8fd1-0960c98f02cf None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:36.216160 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5ebf6-07e3-4dcd-8fd1-0960c98f02cf None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:36.216708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5ebf6-07e3-4dcd-8fd1-0960c98f02cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:36.218194 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-27e7a0f5-947d-4f1b-992b-ebe98cd39ce1 None None] MFA Rules not processed for user `2a6b7777a8e1432c9ca63571c5c442ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:36.220134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-27e7a0f5-947d-4f1b-992b-ebe98cd39ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:36.253804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-17c5ebf6-07e3-4dcd-8fd1-0960c98f02cf None None] MFA Rules not processed for user `458bd8b638f249cb9615711408879307`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:36.256055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-17c5ebf6-07e3-4dcd-8fd1-0960c98f02cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:36.268888 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:36.341434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 992/2009] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:36.342964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820c613-94cc-40d9-afb2-6796c5300808 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:36.343743 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820c613-94cc-40d9-afb2-6796c5300808 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:36.344098 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820c613-94cc-40d9-afb2-6796c5300808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:36.372662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1018/2010] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:36.373887 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5ebf6-07e3-4dcd-8fd1-0960c98f02cf None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:36.382228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-0820c613-94cc-40d9-afb2-6796c5300808 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:36.386061 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0820c613-94cc-40d9-afb2-6796c5300808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:36.392897 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5ebf6-07e3-4dcd-8fd1-0960c98f02cf None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:36.407064 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 993/2011] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:36.407064 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820c613-94cc-40d9-afb2-6796c5300808 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:36.407064 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0820c613-94cc-40d9-afb2-6796c5300808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:36.415129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121d852-7bcf-4454-98c0-b17b629d214a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:36.416443 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121d852-7bcf-4454-98c0-b17b629d214a admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:36.417154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121d852-7bcf-4454-98c0-b17b629d214a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:36.417842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121d852-7bcf-4454-98c0-b17b629d214a admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:36.419379 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121d852-7bcf-4454-98c0-b17b629d214a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:54:36.420284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121d852-7bcf-4454-98c0-b17b629d214a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:36.424515 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121d852-7bcf-4454-98c0-b17b629d214a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:36.456560 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1019/2012] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:54:36.462867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6208b1d-d145-4505-b24d-418730690fff None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:36.462867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6208b1d-d145-4505-b24d-418730690fff None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:36.462867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6208b1d-d145-4505-b24d-418730690fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:36.504123 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-a6208b1d-d145-4505-b24d-418730690fff None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:36.507275 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a6208b1d-d145-4505-b24d-418730690fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:36.507396 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820c613-94cc-40d9-afb2-6796c5300808 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:36.511503 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2e7e8-5f28-4ae3-b267-f6fe009eeca8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:36.512197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2e7e8-5f28-4ae3-b267-f6fe009eeca8 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:36.512479 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2e7e8-5f28-4ae3-b267-f6fe009eeca8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:36.512745 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2e7e8-5f28-4ae3-b267-f6fe009eeca8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:36.524342 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1020/2013] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:36.526163 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6208b1d-d145-4505-b24d-418730690fff None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:36.527281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2e7e8-5f28-4ae3-b267-f6fe009eeca8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:36.528815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2e7e8-5f28-4ae3-b267-f6fe009eeca8 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:36.542198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 994/2014] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:36.544028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2e7e8-5f28-4ae3-b267-f6fe009eeca8 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:36.555648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2e7e8-5f28-4ae3-b267-f6fe009eeca8 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:36.559503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6208b1d-d145-4505-b24d-418730690fff None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:36.560805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167effc1-78a9-4f90-a83d-99f1c16940ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:36.561932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167effc1-78a9-4f90-a83d-99f1c16940ac admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:36.561932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167effc1-78a9-4f90-a83d-99f1c16940ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:36.562236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167effc1-78a9-4f90-a83d-99f1c16940ac admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:36.562964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167effc1-78a9-4f90-a83d-99f1c16940ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:54:36.563542 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167effc1-78a9-4f90-a83d-99f1c16940ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:36.565383 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167effc1-78a9-4f90-a83d-99f1c16940ac admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:36.567609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed9df0-47bc-487a-8024-8c1d9ec3df4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:36.568424 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed9df0-47bc-487a-8024-8c1d9ec3df4c admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:36.568874 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed9df0-47bc-487a-8024-8c1d9ec3df4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:36.569465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed9df0-47bc-487a-8024-8c1d9ec3df4c admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:36.570381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed9df0-47bc-487a-8024-8c1d9ec3df4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:36.572462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed9df0-47bc-487a-8024-8c1d9ec3df4c admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:36.584370 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 995/2015] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:54:36.585095 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167effc1-78a9-4f90-a83d-99f1c16940ac admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:36.598527 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167effc1-78a9-4f90-a83d-99f1c16940ac admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:36.606350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ac18c-7fee-4cfd-b75b-84a62cde0efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:36.608306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ac18c-7fee-4cfd-b75b-84a62cde0efa admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:36.608815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ac18c-7fee-4cfd-b75b-84a62cde0efa admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:36.609262 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ac18c-7fee-4cfd-b75b-84a62cde0efa admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:36.610117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ac18c-7fee-4cfd-b75b-84a62cde0efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:36.610531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1021/2016] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:36 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:36.620790 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed9df0-47bc-487a-8024-8c1d9ec3df4c admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:36.626908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ac18c-7fee-4cfd-b75b-84a62cde0efa admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:36.697821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 996/2017] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:36 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:36.703449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ac18c-7fee-4cfd-b75b-84a62cde0efa admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:36.810028 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed9df0-47bc-487a-8024-8c1d9ec3df4c admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:36.872770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:36.881065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ac18c-7fee-4cfd-b75b-84a62cde0efa admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:36.894755 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497404a-72a2-4a5a-b210-763916a8a146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:36.898036 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497404a-72a2-4a5a-b210-763916a8a146 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:36.899879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497404a-72a2-4a5a-b210-763916a8a146 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:36.900088 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497404a-72a2-4a5a-b210-763916a8a146 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:36.902023 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497404a-72a2-4a5a-b210-763916a8a146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:36.904624 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497404a-72a2-4a5a-b210-763916a8a146 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:36.929072 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d312e-f33b-4323-a6f7-7fae06746634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:36.931131 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d312e-f33b-4323-a6f7-7fae06746634 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:36.931549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d312e-f33b-4323-a6f7-7fae06746634 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:36.931963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d312e-f33b-4323-a6f7-7fae06746634 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:36.932950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d312e-f33b-4323-a6f7-7fae06746634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:36.942917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d312e-f33b-4323-a6f7-7fae06746634 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:36.951444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 997/2018] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:36 2022] POST /identity/v3/users => generated 291 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:36.956444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497404a-72a2-4a5a-b210-763916a8a146 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:36.972269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497404a-72a2-4a5a-b210-763916a8a146 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:36.977025 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1022/2019] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:36 2022] POST /identity/v3/users => generated 292 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:54:36.982018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d312e-f33b-4323-a6f7-7fae06746634 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:36.982976 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a37e50-4acf-40e6-b1b6-9cc2279dad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:36.983740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a37e50-4acf-40e6-b1b6-9cc2279dad74 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:36.984019 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a37e50-4acf-40e6-b1b6-9cc2279dad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:36.984452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a37e50-4acf-40e6-b1b6-9cc2279dad74 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:36.985259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a37e50-4acf-40e6-b1b6-9cc2279dad74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:36.987102 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a37e50-4acf-40e6-b1b6-9cc2279dad74 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:37.000427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d312e-f33b-4323-a6f7-7fae06746634 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:37.006024 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 998/2020] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:54:37.007329 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a37e50-4acf-40e6-b1b6-9cc2279dad74 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:37.011759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a783c-0d60-47b5-a014-836c6dbeeaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:37.013148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a783c-0d60-47b5-a014-836c6dbeeaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:37.013645 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a783c-0d60-47b5-a014-836c6dbeeaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:37.014312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a783c-0d60-47b5-a014-836c6dbeeaf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:37.015349 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a783c-0d60-47b5-a014-836c6dbeeaf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:37.018637 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a783c-0d60-47b5-a014-836c6dbeeaf9 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:37.023017 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a37e50-4acf-40e6-b1b6-9cc2279dad74 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:37.036803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50eaae-a01a-4421-a901-9ec25c59c9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:37.037045 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1023/2021] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:54:37.040441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50eaae-a01a-4421-a901-9ec25c59c9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:37.040764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50eaae-a01a-4421-a901-9ec25c59c9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:37.041041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50eaae-a01a-4421-a901-9ec25c59c9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:37.041527 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a783c-0d60-47b5-a014-836c6dbeeaf9 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:37.041945 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50eaae-a01a-4421-a901-9ec25c59c9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:37.043968 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50eaae-a01a-4421-a901-9ec25c59c9c0 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:37.054472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:37.064033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 999/2022] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:37.065036 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50eaae-a01a-4421-a901-9ec25c59c9c0 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:37.069782 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a783c-0d60-47b5-a014-836c6dbeeaf9 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:37.077009 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f7b92-d3d2-4aa9-b35d-58e4742d340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:37.077826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50eaae-a01a-4421-a901-9ec25c59c9c0 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:37.077958 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f7b92-d3d2-4aa9-b35d-58e4742d340d admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:37.078201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f7b92-d3d2-4aa9-b35d-58e4742d340d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:37.078543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f7b92-d3d2-4aa9-b35d-58e4742d340d admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:37.079490 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f7b92-d3d2-4aa9-b35d-58e4742d340d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:37.081875 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f7b92-d3d2-4aa9-b35d-58e4742d340d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:37.083109 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0673d95-34ba-426c-8e69-3926f81bd6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:37.084226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0673d95-34ba-426c-8e69-3926f81bd6d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:37.085001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0673d95-34ba-426c-8e69-3926f81bd6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:37.085681 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0673d95-34ba-426c-8e69-3926f81bd6d8 admin admin] PATH_INFO: `/v3/projects/ff8edfd884194c64b76b0486570f6eec/users/7c2a646d764d43fab5328c7beb425926/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:37.103658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1024/2023] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:37.106467 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f7b92-d3d2-4aa9-b35d-58e4742d340d admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:37.107445 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0673d95-34ba-426c-8e69-3926f81bd6d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8edfd884194c64b76b0486570f6eec, user_id=7c2a646d764d43fab5328c7beb425926, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:37.110378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0673d95-34ba-426c-8e69-3926f81bd6d8 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:37.133575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1000/2024] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:37 2022] PUT /identity/v3/projects/ff8edfd884194c64b76b0486570f6eec/users/7c2a646d764d43fab5328c7beb425926/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:37.134630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0673d95-34ba-426c-8e69-3926f81bd6d8 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:37.215630 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f7b92-d3d2-4aa9-b35d-58e4742d340d admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:37.227735 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0673d95-34ba-426c-8e69-3926f81bd6d8 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:37.235798 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402e758-f608-4c6c-81e3-0402d4fe3882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:37.238319 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402e758-f608-4c6c-81e3-0402d4fe3882 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:37.238750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402e758-f608-4c6c-81e3-0402d4fe3882 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:37.239286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402e758-f608-4c6c-81e3-0402d4fe3882 admin admin] PATH_INFO: `/v3/projects/bc314ad5d96542b487703085b86f16da/users/938c34cda5234812894863921ad14d4e/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:37.300210 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402e758-f608-4c6c-81e3-0402d4fe3882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc314ad5d96542b487703085b86f16da, user_id=938c34cda5234812894863921ad14d4e, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:37.307932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402e758-f608-4c6c-81e3-0402d4fe3882 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:37.329929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a98055-6132-4674-b37d-9cee8d61a8d7 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6b7777a8e1432c9ca63571c5c442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27457c5d973f497591139db3e23c7fc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:37.335475 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1001/2025] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:37 2022] PUT /identity/v3/projects/bc314ad5d96542b487703085b86f16da/users/938c34cda5234812894863921ad14d4e/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:37.335677 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a98055-6132-4674-b37d-9cee8d61a8d7 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:37.335677 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a98055-6132-4674-b37d-9cee8d61a8d7 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:37.335677 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a98055-6132-4674-b37d-9cee8d61a8d7 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:37.335954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89496441-c0e4-434b-9848-9ed91f5dbbe9 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:37.336079 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a98055-6132-4674-b37d-9cee8d61a8d7 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:54:37.336204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89496441-c0e4-434b-9848-9ed91f5dbbe9 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:37.336287 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a98055-6132-4674-b37d-9cee8d61a8d7 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:37.336369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89496441-c0e4-434b-9848-9ed91f5dbbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:37.347239 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a98055-6132-4674-b37d-9cee8d61a8d7 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:37.367782 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-89496441-c0e4-434b-9848-9ed91f5dbbe9 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:37.369746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-89496441-c0e4-434b-9848-9ed91f5dbbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:37.371781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1025/2026] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:54:37.374300 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3e424-d92e-40ef-9534-62525fc48e2c None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:37.375029 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3e424-d92e-40ef-9534-62525fc48e2c None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:37.375667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3e424-d92e-40ef-9534-62525fc48e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:37.428652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-0cb3e424-d92e-40ef-9534-62525fc48e2c None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:37.434651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0cb3e424-d92e-40ef-9534-62525fc48e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:37.511328 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1002/2027] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:37.512273 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89496441-c0e4-434b-9848-9ed91f5dbbe9 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:37.556639 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1026/2028] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:37.559293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3e424-d92e-40ef-9534-62525fc48e2c None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:37.561743 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0cb3e424-d92e-40ef-9534-62525fc48e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:37.579943 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:37.648155 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:37.659437 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89496441-c0e4-434b-9848-9ed91f5dbbe9 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:37.666469 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550c9af-1404-4915-b411-8f76445f1695 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6b7777a8e1432c9ca63571c5c442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27457c5d973f497591139db3e23c7fc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:37.667138 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550c9af-1404-4915-b411-8f76445f1695 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:37.667442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550c9af-1404-4915-b411-8f76445f1695 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:37.667888 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550c9af-1404-4915-b411-8f76445f1695 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:37.668620 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550c9af-1404-4915-b411-8f76445f1695 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:37.670763 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550c9af-1404-4915-b411-8f76445f1695 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:37.699503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3e424-d92e-40ef-9534-62525fc48e2c None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:37.710251 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535ca58-abd6-4082-bc27-04d2ab701524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:37.711358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535ca58-abd6-4082-bc27-04d2ab701524 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:37.711762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535ca58-abd6-4082-bc27-04d2ab701524 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:37.712048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535ca58-abd6-4082-bc27-04d2ab701524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:37.716989 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1003/2029] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:37 2022] POST /identity/v3/projects => generated 354 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:37.719114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550c9af-1404-4915-b411-8f76445f1695 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:37.723263 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535ca58-abd6-4082-bc27-04d2ab701524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:37.725316 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535ca58-abd6-4082-bc27-04d2ab701524 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:37.742010 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1027/2030] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:37.743178 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535ca58-abd6-4082-bc27-04d2ab701524 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:37.754850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535ca58-abd6-4082-bc27-04d2ab701524 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:37.874501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550c9af-1404-4915-b411-8f76445f1695 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:37.885401 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98a7d8-37f8-46a6-9a6e-e320e5635810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:37.886307 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98a7d8-37f8-46a6-9a6e-e320e5635810 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:37.886795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98a7d8-37f8-46a6-9a6e-e320e5635810 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:37.887529 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98a7d8-37f8-46a6-9a6e-e320e5635810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:37.902072 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdea92a-ddcb-4547-9cbd-129b4972a320 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6b7777a8e1432c9ca63571c5c442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27457c5d973f497591139db3e23c7fc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:37.903113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdea92a-ddcb-4547-9cbd-129b4972a320 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:37.903629 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdea92a-ddcb-4547-9cbd-129b4972a320 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:37.904207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdea92a-ddcb-4547-9cbd-129b4972a320 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:37.905856 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdea92a-ddcb-4547-9cbd-129b4972a320 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:54:37.906401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdea92a-ddcb-4547-9cbd-129b4972a320 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:37.910144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdea92a-ddcb-4547-9cbd-129b4972a320 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:37.938863 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1028/2031] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:54:38.045040 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdea92a-ddcb-4547-9cbd-129b4972a320 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:38.080390 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdea92a-ddcb-4547-9cbd-129b4972a320 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:38.091010 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860ebe0-cb26-480d-a98c-fc49e2c8d809 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a6b7777a8e1432c9ca63571c5c442ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27457c5d973f497591139db3e23c7fc1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:38.092441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860ebe0-cb26-480d-a98c-fc49e2c8d809 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:38.093272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860ebe0-cb26-480d-a98c-fc49e2c8d809 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:38.094041 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860ebe0-cb26-480d-a98c-fc49e2c8d809 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] PATH_INFO: `/v3/projects/b81fff1e4b794127be05e6dbb0549832` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:38.096466 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860ebe0-cb26-480d-a98c-fc49e2c8d809 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b81fff1e4b794127be05e6dbb0549832)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:38.101147 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860ebe0-cb26-480d-a98c-fc49e2c8d809 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:38.131547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98a7d8-37f8-46a6-9a6e-e320e5635810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:38.140421 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98a7d8-37f8-46a6-9a6e-e320e5635810 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:38.166911 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1004/2032] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:38.295342 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b860ebe0-cb26-480d-a98c-fc49e2c8d809 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81fff1e4b794127be05e6dbb0549832', 'request_id': 'req-b860ebe0-cb26-480d-a98c-fc49e2c8d809'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:38.308668 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b860ebe0-cb26-480d-a98c-fc49e2c8d809 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81fff1e4b794127be05e6dbb0549832', 'request_id': 'req-b860ebe0-cb26-480d-a98c-fc49e2c8d809'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:38.318202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b860ebe0-cb26-480d-a98c-fc49e2c8d809 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81fff1e4b794127be05e6dbb0549832', 'request_id': 'req-b860ebe0-cb26-480d-a98c-fc49e2c8d809'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:38.336895 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b860ebe0-cb26-480d-a98c-fc49e2c8d809 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] The token cache is being invalidate because project b81fff1e4b794127be05e6dbb0549832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:38.337229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b860ebe0-cb26-480d-a98c-fc49e2c8d809 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:38.337963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b860ebe0-cb26-480d-a98c-fc49e2c8d809 tempest-VolumeQuotaClassesTest-1368216484 tempest-VolumeQuotaClassesTest-1368216484-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:38.340234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1029/2033] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:38 2022] DELETE /identity/v3/projects/b81fff1e4b794127be05e6dbb0549832 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:54:38.762726 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98a7d8-37f8-46a6-9a6e-e320e5635810 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:38.764268 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-be98a7d8-37f8-46a6-9a6e-e320e5635810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:38.781659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98a7d8-37f8-46a6-9a6e-e320e5635810 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:38.856295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:38.865114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f019d-7403-4311-a94a-289cd3ccc708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:38.865986 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f019d-7403-4311-a94a-289cd3ccc708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:38.867513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f019d-7403-4311-a94a-289cd3ccc708 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:38.868554 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f019d-7403-4311-a94a-289cd3ccc708 admin admin] PATH_INFO: `/v3/users/e20c17916aac440f8996d000e6abf739` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:38.870582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f019d-7403-4311-a94a-289cd3ccc708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e20c17916aac440f8996d000e6abf739)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:38.874022 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f019d-7403-4311-a94a-289cd3ccc708 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:38.935637 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-205f019d-7403-4311-a94a-289cd3ccc708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e20c17916aac440f8996d000e6abf739'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:38.936590 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-205f019d-7403-4311-a94a-289cd3ccc708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e20c17916aac440f8996d000e6abf739'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:38.937441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-205f019d-7403-4311-a94a-289cd3ccc708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e20c17916aac440f8996d000e6abf739'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:38.955511 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-205f019d-7403-4311-a94a-289cd3ccc708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e20c17916aac440f8996d000e6abf739'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:38.973603 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-205f019d-7403-4311-a94a-289cd3ccc708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e20c17916aac440f8996d000e6abf739'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:39.007851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1005/2034] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:38 2022] DELETE /identity/v3/users/e20c17916aac440f8996d000e6abf739 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:39.018063 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685de15-44e0-4d9e-8e11-ec7e6bdc5c80 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:39.018657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685de15-44e0-4d9e-8e11-ec7e6bdc5c80 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:39.018754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685de15-44e0-4d9e-8e11-ec7e6bdc5c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:39.045941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-7685de15-44e0-4d9e-8e11-ec7e6bdc5c80 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:39.047497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-7685de15-44e0-4d9e-8e11-ec7e6bdc5c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:39.124660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:39.145543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1030/2035] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:39.156792 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f019d-7403-4311-a94a-289cd3ccc708 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:39.158898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-205f019d-7403-4311-a94a-289cd3ccc708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:39.228856 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f019d-7403-4311-a94a-289cd3ccc708 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:39.233140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edf59d-53ca-4293-b914-f4ee575f8946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:39.234075 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edf59d-53ca-4293-b914-f4ee575f8946 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:39.234576 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edf59d-53ca-4293-b914-f4ee575f8946 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:39.234889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edf59d-53ca-4293-b914-f4ee575f8946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:39.247155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edf59d-53ca-4293-b914-f4ee575f8946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:39.249905 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edf59d-53ca-4293-b914-f4ee575f8946 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:39.274818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1006/2036] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:54:39.503661 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c6c24-14ec-48cd-8536-1430deac2b14 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:39.504198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c6c24-14ec-48cd-8536-1430deac2b14 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:39.504604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c6c24-14ec-48cd-8536-1430deac2b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:39.558657 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edf59d-53ca-4293-b914-f4ee575f8946 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:39.561980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-89edf59d-53ca-4293-b914-f4ee575f8946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:39.575506 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-9f1c6c24-14ec-48cd-8536-1430deac2b14 None None] MFA Rules not processed for user `7c2a646d764d43fab5328c7beb425926`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:39.577052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9f1c6c24-14ec-48cd-8536-1430deac2b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:39.604483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edf59d-53ca-4293-b914-f4ee575f8946 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:39.623398 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99896ff7-fef7-43c0-8b83-839c95f7b99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:39.625402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99896ff7-fef7-43c0-8b83-839c95f7b99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:39.626153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99896ff7-fef7-43c0-8b83-839c95f7b99f admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:39.626891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99896ff7-fef7-43c0-8b83-839c95f7b99f admin admin] PATH_INFO: `/v3/users/f26aeaf8b97e4bb4892fb86b5f86d58b` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:39.629716 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99896ff7-fef7-43c0-8b83-839c95f7b99f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f26aeaf8b97e4bb4892fb86b5f86d58b)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:39.636778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99896ff7-fef7-43c0-8b83-839c95f7b99f admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:39.808648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1031/2037] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:39.809916 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c6c24-14ec-48cd-8536-1430deac2b14 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:39.811863 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9f1c6c24-14ec-48cd-8536-1430deac2b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:39.822712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-99896ff7-fef7-43c0-8b83-839c95f7b99f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f26aeaf8b97e4bb4892fb86b5f86d58b'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:39.824852 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-99896ff7-fef7-43c0-8b83-839c95f7b99f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f26aeaf8b97e4bb4892fb86b5f86d58b'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:39.826908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-99896ff7-fef7-43c0-8b83-839c95f7b99f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f26aeaf8b97e4bb4892fb86b5f86d58b'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:39.882610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-99896ff7-fef7-43c0-8b83-839c95f7b99f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f26aeaf8b97e4bb4892fb86b5f86d58b'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:39.905768 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-99896ff7-fef7-43c0-8b83-839c95f7b99f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f26aeaf8b97e4bb4892fb86b5f86d58b'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:39.910376 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:39.959887 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1007/2038] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:39 2022] DELETE /identity/v3/users/f26aeaf8b97e4bb4892fb86b5f86d58b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:39.971110 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb840bd5-ad1f-4f8b-b00a-049989e91ddf None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:39.971806 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb840bd5-ad1f-4f8b-b00a-049989e91ddf None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:39.972447 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb840bd5-ad1f-4f8b-b00a-049989e91ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:39.983035 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c6c24-14ec-48cd-8536-1430deac2b14 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:40.058750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-cb840bd5-ad1f-4f8b-b00a-049989e91ddf None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:40.063064 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-cb840bd5-ad1f-4f8b-b00a-049989e91ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:40.219511 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92005986-7916-452a-b350-b375e8d9e2b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:40.220363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92005986-7916-452a-b350-b375e8d9e2b3 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:40.220619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92005986-7916-452a-b350-b375e8d9e2b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:40.221072 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92005986-7916-452a-b350-b375e8d9e2b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:40.229719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-92005986-7916-452a-b350-b375e8d9e2b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:40.300369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1008/2039] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:40.324323 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb840bd5-ad1f-4f8b-b00a-049989e91ddf None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:40.328070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-cb840bd5-ad1f-4f8b-b00a-049989e91ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:40.494865 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:40.517883 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92005986-7916-452a-b350-b375e8d9e2b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:40.525587 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92005986-7916-452a-b350-b375e8d9e2b3 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:40.552627 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb840bd5-ad1f-4f8b-b00a-049989e91ddf None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:40.590335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f9067-ab3b-4c1a-ba44-f35379c7d272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:40.594288 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f9067-ab3b-4c1a-ba44-f35379c7d272 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:40.595679 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f9067-ab3b-4c1a-ba44-f35379c7d272 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:40.596958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f9067-ab3b-4c1a-ba44-f35379c7d272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:40.599379 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1032/2040] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:40.602503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92005986-7916-452a-b350-b375e8d9e2b3 service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:40.608861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-92005986-7916-452a-b350-b375e8d9e2b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:40.646336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f9067-ab3b-4c1a-ba44-f35379c7d272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:40.655054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f9067-ab3b-4c1a-ba44-f35379c7d272 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:40.659623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92005986-7916-452a-b350-b375e8d9e2b3 service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:40.668969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbd466-33dc-44c2-90ae-043321ab6af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:40.670472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbd466-33dc-44c2-90ae-043321ab6af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:40.670892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbd466-33dc-44c2-90ae-043321ab6af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:40.671378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbd466-33dc-44c2-90ae-043321ab6af7 admin admin] PATH_INFO: `/v3/projects/7cbf7ffab23e463bab79891f9af129e9` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:40.673783 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbd466-33dc-44c2-90ae-043321ab6af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cbf7ffab23e463bab79891f9af129e9)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:40.678134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbd466-33dc-44c2-90ae-043321ab6af7 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:40.712912 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1009/2041] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:40.814698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-31dbd466-33dc-44c2-90ae-043321ab6af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cbf7ffab23e463bab79891f9af129e9', 'request_id': 'req-31dbd466-33dc-44c2-90ae-043321ab6af7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:40.844601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-31dbd466-33dc-44c2-90ae-043321ab6af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cbf7ffab23e463bab79891f9af129e9', 'request_id': 'req-31dbd466-33dc-44c2-90ae-043321ab6af7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:40.866742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-31dbd466-33dc-44c2-90ae-043321ab6af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cbf7ffab23e463bab79891f9af129e9', 'request_id': 'req-31dbd466-33dc-44c2-90ae-043321ab6af7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:40.889022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-31dbd466-33dc-44c2-90ae-043321ab6af7 admin admin] The token cache is being invalidate because project 7cbf7ffab23e463bab79891f9af129e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:40.889538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-31dbd466-33dc-44c2-90ae-043321ab6af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:40.892040 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-31dbd466-33dc-44c2-90ae-043321ab6af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:40.902306 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1033/2042] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:40 2022] DELETE /identity/v3/projects/7cbf7ffab23e463bab79891f9af129e9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:40.902671 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f9067-ab3b-4c1a-ba44-f35379c7d272 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:40.914577 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f9067-ab3b-4c1a-ba44-f35379c7d272 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:41.056935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597adfa-8778-498f-8dfc-92201485f18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:41.058427 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597adfa-8778-498f-8dfc-92201485f18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:41.059027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597adfa-8778-498f-8dfc-92201485f18a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:41.060050 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597adfa-8778-498f-8dfc-92201485f18a admin admin] PATH_INFO: `/v3/users/2a6b7777a8e1432c9ca63571c5c442ef` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:41.063966 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597adfa-8778-498f-8dfc-92201485f18a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a6b7777a8e1432c9ca63571c5c442ef)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:41.068884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597adfa-8778-498f-8dfc-92201485f18a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:41.181785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:INSERT=1,keystone:DELETE=6,keystone:SELECT=93 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:41.216369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0597adfa-8778-498f-8dfc-92201485f18a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a6b7777a8e1432c9ca63571c5c442ef'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:41.219466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0597adfa-8778-498f-8dfc-92201485f18a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a6b7777a8e1432c9ca63571c5c442ef'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:41.221068 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0597adfa-8778-498f-8dfc-92201485f18a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a6b7777a8e1432c9ca63571c5c442ef'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:41.271003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0597adfa-8778-498f-8dfc-92201485f18a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a6b7777a8e1432c9ca63571c5c442ef'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:41.280981 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0597adfa-8778-498f-8dfc-92201485f18a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a6b7777a8e1432c9ca63571c5c442ef'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:41.306270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1010/2043] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:40 2022] DELETE /identity/v3/users/2a6b7777a8e1432c9ca63571c5c442ef => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:54:42.022326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbd466-33dc-44c2-90ae-043321ab6af7 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:42.030751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-31dbd466-33dc-44c2-90ae-043321ab6af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:42.072757 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbd466-33dc-44c2-90ae-043321ab6af7 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:42.250813 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b922cd-1f15-436c-8333-4bd056c4df2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:42.251581 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b922cd-1f15-436c-8333-4bd056c4df2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:42.251888 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b922cd-1f15-436c-8333-4bd056c4df2d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:42.252468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b922cd-1f15-436c-8333-4bd056c4df2d admin admin] PATH_INFO: `/v3/projects/27457c5d973f497591139db3e23c7fc1` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:42.254035 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b922cd-1f15-436c-8333-4bd056c4df2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=27457c5d973f497591139db3e23c7fc1)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:42.257723 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b922cd-1f15-436c-8333-4bd056c4df2d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:42.267636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597adfa-8778-498f-8dfc-92201485f18a admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:42.270337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0597adfa-8778-498f-8dfc-92201485f18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:42.293836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597adfa-8778-498f-8dfc-92201485f18a admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:42.317723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335dc8e-f126-4a87-a4b3-ced115d7cfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:42.318483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335dc8e-f126-4a87-a4b3-ced115d7cfef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:42.318954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335dc8e-f126-4a87-a4b3-ced115d7cfef admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:42.319397 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335dc8e-f126-4a87-a4b3-ced115d7cfef admin admin] PATH_INFO: `/v3/projects/5da0800c89154cb6a92a10dadd2657b4` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:42.321592 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335dc8e-f126-4a87-a4b3-ced115d7cfef admin admin] RBAC: Authorizing `identity:delete_project(project_id=5da0800c89154cb6a92a10dadd2657b4)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:42.333860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335dc8e-f126-4a87-a4b3-ced115d7cfef admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:42.338407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-26b922cd-1f15-436c-8333-4bd056c4df2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27457c5d973f497591139db3e23c7fc1', 'request_id': 'req-26b922cd-1f15-436c-8333-4bd056c4df2d'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:42.356882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-26b922cd-1f15-436c-8333-4bd056c4df2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27457c5d973f497591139db3e23c7fc1', 'request_id': 'req-26b922cd-1f15-436c-8333-4bd056c4df2d'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:42.369551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-26b922cd-1f15-436c-8333-4bd056c4df2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27457c5d973f497591139db3e23c7fc1', 'request_id': 'req-26b922cd-1f15-436c-8333-4bd056c4df2d'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:42.390696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-26b922cd-1f15-436c-8333-4bd056c4df2d admin admin] The token cache is being invalidate because project 27457c5d973f497591139db3e23c7fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:42.390947 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-26b922cd-1f15-436c-8333-4bd056c4df2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:42.391913 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-26b922cd-1f15-436c-8333-4bd056c4df2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:42.395477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1034/2044] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:42 2022] DELETE /identity/v3/projects/27457c5d973f497591139db3e23c7fc1 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:42.400734 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd00de-2634-44ca-8cd8-8ecf62f797d9 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:42.401015 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd00de-2634-44ca-8cd8-8ecf62f797d9 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:42.401511 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd00de-2634-44ca-8cd8-8ecf62f797d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:42.414055 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9335dc8e-f126-4a87-a4b3-ced115d7cfef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5da0800c89154cb6a92a10dadd2657b4', 'request_id': 'req-9335dc8e-f126-4a87-a4b3-ced115d7cfef'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:42.420899 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:42.421127 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9335dc8e-f126-4a87-a4b3-ced115d7cfef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5da0800c89154cb6a92a10dadd2657b4', 'request_id': 'req-9335dc8e-f126-4a87-a4b3-ced115d7cfef'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:42.428540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-dddd00de-2634-44ca-8cd8-8ecf62f797d9 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:42.430492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-dddd00de-2634-44ca-8cd8-8ecf62f797d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:42.431337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9335dc8e-f126-4a87-a4b3-ced115d7cfef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5da0800c89154cb6a92a10dadd2657b4', 'request_id': 'req-9335dc8e-f126-4a87-a4b3-ced115d7cfef'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:42.450712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9335dc8e-f126-4a87-a4b3-ced115d7cfef admin admin] The token cache is being invalidate because project 5da0800c89154cb6a92a10dadd2657b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:42.451332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9335dc8e-f126-4a87-a4b3-ced115d7cfef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:42.452120 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9335dc8e-f126-4a87-a4b3-ced115d7cfef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:42.457767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1011/2045] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:42 2022] DELETE /identity/v3/projects/5da0800c89154cb6a92a10dadd2657b4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:54:42.459561 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f519b-0416-4443-a545-6137c57c3df7 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:42.459916 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f519b-0416-4443-a545-6137c57c3df7 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:42.460251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f519b-0416-4443-a545-6137c57c3df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:42.488854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-920f519b-0416-4443-a545-6137c57c3df7 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:42.490593 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-920f519b-0416-4443-a545-6137c57c3df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:42.572650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1035/2046] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:54:42.574599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eded68-6e17-48c0-a012-84f06e0e9c42 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:42.574951 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eded68-6e17-48c0-a012-84f06e0e9c42 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:42.575292 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eded68-6e17-48c0-a012-84f06e0e9c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:42.605381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1012/2047] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:42.605381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee550ba-9f74-473d-89bf-ea376613aed9 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:42.605381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee550ba-9f74-473d-89bf-ea376613aed9 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:42.605381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee550ba-9f74-473d-89bf-ea376613aed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:42.613985 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-95eded68-6e17-48c0-a012-84f06e0e9c42 None None] MFA Rules not processed for user `7c2a646d764d43fab5328c7beb425926`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:42.617900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-95eded68-6e17-48c0-a012-84f06e0e9c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:42.630217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-3ee550ba-9f74-473d-89bf-ea376613aed9 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:42.632753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-3ee550ba-9f74-473d-89bf-ea376613aed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:42.645281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1013/2048] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:42.647139 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa992a2-5ff3-4c02-aedf-f94d46200e04 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:42.647423 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa992a2-5ff3-4c02-aedf-f94d46200e04 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:42.647695 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa992a2-5ff3-4c02-aedf-f94d46200e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:42.678572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-8aa992a2-5ff3-4c02-aedf-f94d46200e04 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:42.679558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-8aa992a2-5ff3-4c02-aedf-f94d46200e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:42.696899 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1014/2049] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:42.697833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa992a2-5ff3-4c02-aedf-f94d46200e04 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:42.716606 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa992a2-5ff3-4c02-aedf-f94d46200e04 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:42.725463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cb584-2f4a-408e-9274-f535d899fd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:42.726489 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb584-2f4a-408e-9274-f535d899fd37 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:42.726971 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb584-2f4a-408e-9274-f535d899fd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:42.728184 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb584-2f4a-408e-9274-f535d899fd37 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:42.729334 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cb584-2f4a-408e-9274-f535d899fd37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:54:42.729854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cb584-2f4a-408e-9274-f535d899fd37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:42.732000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cb584-2f4a-408e-9274-f535d899fd37 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:42.751880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1015/2050] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:54:42.753373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cb584-2f4a-408e-9274-f535d899fd37 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:42.785193 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1036/2051] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:42.785532 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cb584-2f4a-408e-9274-f535d899fd37 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:42.786786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eded68-6e17-48c0-a012-84f06e0e9c42 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:42.803875 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c18a01-552a-4293-8a35-f93785777178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:42.806105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c18a01-552a-4293-8a35-f93785777178 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:42.806664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c18a01-552a-4293-8a35-f93785777178 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:42.807446 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c18a01-552a-4293-8a35-f93785777178 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:42.809487 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c18a01-552a-4293-8a35-f93785777178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:54:42.810140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c18a01-552a-4293-8a35-f93785777178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:42.814372 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c18a01-552a-4293-8a35-f93785777178 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:42.816256 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eded68-6e17-48c0-a012-84f06e0e9c42 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:42.826075 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16130989-7ff4-47af-98f2-6574ba2bbd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:42.827303 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16130989-7ff4-47af-98f2-6574ba2bbd51 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:42.827943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16130989-7ff4-47af-98f2-6574ba2bbd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:42.829005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16130989-7ff4-47af-98f2-6574ba2bbd51 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:42.830489 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16130989-7ff4-47af-98f2-6574ba2bbd51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:42.831666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:42.835072 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16130989-7ff4-47af-98f2-6574ba2bbd51 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:42.858783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1016/2052] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:54:42.866977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c18a01-552a-4293-8a35-f93785777178 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:42.907448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c18a01-552a-4293-8a35-f93785777178 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:42.913576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1037/2053] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:42 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:42.918610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7defc15-cd51-4ecf-995e-634f060563f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:42.920045 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7defc15-cd51-4ecf-995e-634f060563f6 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:42.921060 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7defc15-cd51-4ecf-995e-634f060563f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:42.921810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7defc15-cd51-4ecf-995e-634f060563f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:42.923974 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7defc15-cd51-4ecf-995e-634f060563f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:42.925733 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16130989-7ff4-47af-98f2-6574ba2bbd51 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:42.929386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7defc15-cd51-4ecf-995e-634f060563f6 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:42.995617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1017/2054] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:42 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:43.002381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7defc15-cd51-4ecf-995e-634f060563f6 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:43.061274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16130989-7ff4-47af-98f2-6574ba2bbd51 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:43.146065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:43.195814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7defc15-cd51-4ecf-995e-634f060563f6 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:43.214022 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a894878-8e4a-4022-a7b2-d961014cc7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:43.214853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a894878-8e4a-4022-a7b2-d961014cc7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:43.215271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a894878-8e4a-4022-a7b2-d961014cc7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:43.215763 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a894878-8e4a-4022-a7b2-d961014cc7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:43.216577 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a894878-8e4a-4022-a7b2-d961014cc7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:43.219259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a894878-8e4a-4022-a7b2-d961014cc7a1 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:43.223058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584bbf1-1c24-49f8-865d-41516acbcff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:43.224592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584bbf1-1c24-49f8-865d-41516acbcff8 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:43.225311 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584bbf1-1c24-49f8-865d-41516acbcff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:43.226296 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584bbf1-1c24-49f8-865d-41516acbcff8 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:43.228333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584bbf1-1c24-49f8-865d-41516acbcff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:43.233861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584bbf1-1c24-49f8-865d-41516acbcff8 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:43.269053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1018/2055] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:43 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:43.276412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a894878-8e4a-4022-a7b2-d961014cc7a1 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:43.276678 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1038/2056] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:42 2022] POST /identity/v3/users => generated 289 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:43.283472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584bbf1-1c24-49f8-865d-41516acbcff8 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:43.294563 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a894878-8e4a-4022-a7b2-d961014cc7a1 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:43.300827 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb3c0d-2209-448e-abac-bb60ca363785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:43.302103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb3c0d-2209-448e-abac-bb60ca363785 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:43.302576 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb3c0d-2209-448e-abac-bb60ca363785 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:43.304247 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb3c0d-2209-448e-abac-bb60ca363785 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:43.305952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb3c0d-2209-448e-abac-bb60ca363785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:43.307858 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb3c0d-2209-448e-abac-bb60ca363785 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:43.309065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584bbf1-1c24-49f8-865d-41516acbcff8 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:43.320097 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cee34-c7f5-4bac-9824-1c1ff7902bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:43.323678 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cee34-c7f5-4bac-9824-1c1ff7902bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:43.324317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cee34-c7f5-4bac-9824-1c1ff7902bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:43.324871 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cee34-c7f5-4bac-9824-1c1ff7902bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:43.326241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cee34-c7f5-4bac-9824-1c1ff7902bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:43.326536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1019/2057] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:43.329731 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cee34-c7f5-4bac-9824-1c1ff7902bc2 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:43.332557 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb3c0d-2209-448e-abac-bb60ca363785 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:43.347802 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb3c0d-2209-448e-abac-bb60ca363785 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:43.356163 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4b0f3-4ca3-49d6-a85c-64b3090651bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:43.357131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4b0f3-4ca3-49d6-a85c-64b3090651bb admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:43.358607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4b0f3-4ca3-49d6-a85c-64b3090651bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:43.359249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4b0f3-4ca3-49d6-a85c-64b3090651bb admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:43.360335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4b0f3-4ca3-49d6-a85c-64b3090651bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:43.362402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4b0f3-4ca3-49d6-a85c-64b3090651bb admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:43.372790 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1039/2058] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:43.379094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cee34-c7f5-4bac-9824-1c1ff7902bc2 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:43.379697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1020/2059] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:43.385166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4b0f3-4ca3-49d6-a85c-64b3090651bb admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:43.401217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4b0f3-4ca3-49d6-a85c-64b3090651bb admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:43.409838 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cee34-c7f5-4bac-9824-1c1ff7902bc2 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:43.412612 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907c1eb-7144-48eb-8684-d871dd089ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:43.414256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907c1eb-7144-48eb-8684-d871dd089ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:43.415115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907c1eb-7144-48eb-8684-d871dd089ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:43.415715 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907c1eb-7144-48eb-8684-d871dd089ce5 admin admin] PATH_INFO: `/v3/projects/202be259a96948fa8883e207a794fbc1/users/904dce15d85949c0b8f846e42956c070/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:43.440905 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49cc49-caf9-4a48-a5d1-0391334d857a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:43.442162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49cc49-caf9-4a48-a5d1-0391334d857a admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:43.444804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49cc49-caf9-4a48-a5d1-0391334d857a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:43.445061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49cc49-caf9-4a48-a5d1-0391334d857a admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:43.448483 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49cc49-caf9-4a48-a5d1-0391334d857a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:43.456168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49cc49-caf9-4a48-a5d1-0391334d857a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:43.460618 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907c1eb-7144-48eb-8684-d871dd089ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=202be259a96948fa8883e207a794fbc1, user_id=904dce15d85949c0b8f846e42956c070, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:43.463902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907c1eb-7144-48eb-8684-d871dd089ce5 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:43.481528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1040/2060] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:54:43.491469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49cc49-caf9-4a48-a5d1-0391334d857a admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:43.510962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1021/2061] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:43 2022] PUT /identity/v3/projects/202be259a96948fa8883e207a794fbc1/users/904dce15d85949c0b8f846e42956c070/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:43.518817 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49cc49-caf9-4a48-a5d1-0391334d857a admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:43.529604 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4c27c-5f7e-473b-8553-1d010db31ce0 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:43.529829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4c27c-5f7e-473b-8553-1d010db31ce0 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:43.530141 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4c27c-5f7e-473b-8553-1d010db31ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:43.591597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-e2d4c27c-5f7e-473b-8553-1d010db31ce0 None None] MFA Rules not processed for user `904dce15d85949c0b8f846e42956c070`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:43.594498 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e2d4c27c-5f7e-473b-8553-1d010db31ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:43.617915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d42a70-69da-429c-8b06-ca4c11c333df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:43.618854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d42a70-69da-429c-8b06-ca4c11c333df admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:43.619268 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d42a70-69da-429c-8b06-ca4c11c333df admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:43.619747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d42a70-69da-429c-8b06-ca4c11c333df admin admin] PATH_INFO: `/v3/projects/e86ba2bd7ee245f2ace19877013922f9/users/44aeee169b164c61b249c6e0d4ed4767/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:43.646299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d42a70-69da-429c-8b06-ca4c11c333df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86ba2bd7ee245f2ace19877013922f9, user_id=44aeee169b164c61b249c6e0d4ed4767, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:43.650078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d42a70-69da-429c-8b06-ca4c11c333df admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:43.693111 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1041/2062] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:43 2022] PUT /identity/v3/projects/e86ba2bd7ee245f2ace19877013922f9/users/44aeee169b164c61b249c6e0d4ed4767/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:43.707197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3fc91-fb98-4042-8555-5798e1e9ec7a None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:43.711091 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3fc91-fb98-4042-8555-5798e1e9ec7a None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:43.711614 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3fc91-fb98-4042-8555-5798e1e9ec7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:43.787420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-f8d3fc91-fb98-4042-8555-5798e1e9ec7a None None] MFA Rules not processed for user `44aeee169b164c61b249c6e0d4ed4767`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:43.788949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-f8d3fc91-fb98-4042-8555-5798e1e9ec7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:43.838816 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1022/2063] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:43.843351 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4c27c-5f7e-473b-8553-1d010db31ce0 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:43.869126 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4c27c-5f7e-473b-8553-1d010db31ce0 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:43.880609 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:43.977521 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1042/2064] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:43.983847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3fc91-fb98-4042-8555-5798e1e9ec7a None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:44.048735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:44.050870 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c1933-17f5-4c40-b2c0-6f97a6aa2da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:44.053235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c1933-17f5-4c40-b2c0-6f97a6aa2da1 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:44.053834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c1933-17f5-4c40-b2c0-6f97a6aa2da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:44.055252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c1933-17f5-4c40-b2c0-6f97a6aa2da1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:44.058009 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c1933-17f5-4c40-b2c0-6f97a6aa2da1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:44.062568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c1933-17f5-4c40-b2c0-6f97a6aa2da1 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:44.158095 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1023/2065] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:43 2022] POST /identity/v3/projects => generated 383 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:44.165029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c1933-17f5-4c40-b2c0-6f97a6aa2da1 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:44.199146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3fc91-fb98-4042-8555-5798e1e9ec7a None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:44.419495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c1933-17f5-4c40-b2c0-6f97a6aa2da1 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:44.442144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ac189-e497-4fb8-b53e-cd489d46bafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:44.444186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ac189-e497-4fb8-b53e-cd489d46bafc admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:44.449634 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ac189-e497-4fb8-b53e-cd489d46bafc admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:44.449634 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ac189-e497-4fb8-b53e-cd489d46bafc admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:44.453448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ac189-e497-4fb8-b53e-cd489d46bafc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:44.468167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ac189-e497-4fb8-b53e-cd489d46bafc admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:44.489077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc028d-0825-4341-a170-da67c2335614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:44.489077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc028d-0825-4341-a170-da67c2335614 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:44.489077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc028d-0825-4341-a170-da67c2335614 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:44.490376 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc028d-0825-4341-a170-da67c2335614 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:44.493650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc028d-0825-4341-a170-da67c2335614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:44.500409 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc028d-0825-4341-a170-da67c2335614 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:44.562017 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1024/2066] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:44 2022] POST /identity/v3/users => generated 292 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:44.563568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ac189-e497-4fb8-b53e-cd489d46bafc admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:44.597425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1043/2067] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:43 2022] POST /identity/v3/projects => generated 377 bytes in 613 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:44.605011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc028d-0825-4341-a170-da67c2335614 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:44.612457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ac189-e497-4fb8-b53e-cd489d46bafc admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:44.873186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc028d-0825-4341-a170-da67c2335614 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:44.876190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a915a-9f6c-43ab-aa22-1163f659412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:44.877233 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a915a-9f6c-43ab-aa22-1163f659412c admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:44.877740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a915a-9f6c-43ab-aa22-1163f659412c admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:44.878219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a915a-9f6c-43ab-aa22-1163f659412c admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:44.880567 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a915a-9f6c-43ab-aa22-1163f659412c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:44.885754 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a915a-9f6c-43ab-aa22-1163f659412c admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:44.895923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142598f1-811b-4dac-8d60-fdf26171c9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:44.897012 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142598f1-811b-4dac-8d60-fdf26171c9b1 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:44.897542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142598f1-811b-4dac-8d60-fdf26171c9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:44.898024 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142598f1-811b-4dac-8d60-fdf26171c9b1 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:44.899326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142598f1-811b-4dac-8d60-fdf26171c9b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:44.911272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142598f1-811b-4dac-8d60-fdf26171c9b1 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:44.928680 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1025/2068] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:44.946239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a915a-9f6c-43ab-aa22-1163f659412c admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:44.979098 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a915a-9f6c-43ab-aa22-1163f659412c admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:44.988188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1044/2069] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:44 2022] POST /identity/v3/users => generated 295 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:44.989963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142598f1-811b-4dac-8d60-fdf26171c9b1 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:45.000474 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8601a-6d15-4f4d-9cad-c47b8cd2114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:45.002805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8601a-6d15-4f4d-9cad-c47b8cd2114e admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:45.003282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8601a-6d15-4f4d-9cad-c47b8cd2114e admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:45.003773 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8601a-6d15-4f4d-9cad-c47b8cd2114e admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:45.004937 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8601a-6d15-4f4d-9cad-c47b8cd2114e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:45.007859 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8601a-6d15-4f4d-9cad-c47b8cd2114e admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:45.010150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142598f1-811b-4dac-8d60-fdf26171c9b1 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:45.020089 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84b4b4-1282-42c6-9427-674484047e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:45.021211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84b4b4-1282-42c6-9427-674484047e9a admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:45.022770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84b4b4-1282-42c6-9427-674484047e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:45.022770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84b4b4-1282-42c6-9427-674484047e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:45.023692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84b4b4-1282-42c6-9427-674484047e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:45.026877 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84b4b4-1282-42c6-9427-674484047e9a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:45.031150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1026/2070] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:45.035893 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8601a-6d15-4f4d-9cad-c47b8cd2114e admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:45.047028 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1045/2071] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:45.049761 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84b4b4-1282-42c6-9427-674484047e9a admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:45.060592 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8601a-6d15-4f4d-9cad-c47b8cd2114e admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:45.066236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84b4b4-1282-42c6-9427-674484047e9a admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:45.069762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955603e-a655-497c-a95f-282742361297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:45.071121 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955603e-a655-497c-a95f-282742361297 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:45.071333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955603e-a655-497c-a95f-282742361297 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:45.071685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955603e-a655-497c-a95f-282742361297 admin admin] PATH_INFO: `/v3/projects/0b03c855bf8b40058cb6ad68be9b93aa/users/fe8ea290e23f4d12ad1f6f991ab738c0/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:45.073210 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f5cf9-00f5-4218-aa18-323f18d303e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:45.073968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f5cf9-00f5-4218-aa18-323f18d303e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:45.074843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f5cf9-00f5-4218-aa18-323f18d303e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:45.074843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f5cf9-00f5-4218-aa18-323f18d303e7 admin admin] PATH_INFO: `/v3/projects/30007d0397554b1f817b29c2dded65bf/users/9fffa7d2ea634ac1910c49d3cfaff755/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:45.078903 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:45.099994 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f5cf9-00f5-4218-aa18-323f18d303e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30007d0397554b1f817b29c2dded65bf, user_id=9fffa7d2ea634ac1910c49d3cfaff755, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:45.101312 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955603e-a655-497c-a95f-282742361297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b03c855bf8b40058cb6ad68be9b93aa, user_id=fe8ea290e23f4d12ad1f6f991ab738c0, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:45.103366 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f5cf9-00f5-4218-aa18-323f18d303e7 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:45.105254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955603e-a655-497c-a95f-282742361297 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:45.128921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1027/2073] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:45 2022] PUT /identity/v3/projects/0b03c855bf8b40058cb6ad68be9b93aa/users/fe8ea290e23f4d12ad1f6f991ab738c0/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:54:45.130965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1046/2073] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:45 2022] PUT /identity/v3/projects/30007d0397554b1f817b29c2dded65bf/users/9fffa7d2ea634ac1910c49d3cfaff755/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:45.134988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955603e-a655-497c-a95f-282742361297 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:45.158330 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2efdcf-c5e5-4795-9a4f-c662593943f7 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:45.158890 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2efdcf-c5e5-4795-9a4f-c662593943f7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:45.159347 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2efdcf-c5e5-4795-9a4f-c662593943f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:45.170099 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:45.206717 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-3d2efdcf-c5e5-4795-9a4f-c662593943f7 None None] MFA Rules not processed for user `fe8ea290e23f4d12ad1f6f991ab738c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:45.209052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3d2efdcf-c5e5-4795-9a4f-c662593943f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:45.237284 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955603e-a655-497c-a95f-282742361297 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:45.243403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656ee75-22bf-41bd-a0cd-77cd16d3ad34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:45.244067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656ee75-22bf-41bd-a0cd-77cd16d3ad34 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:45.244919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656ee75-22bf-41bd-a0cd-77cd16d3ad34 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:45.244919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656ee75-22bf-41bd-a0cd-77cd16d3ad34 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:45.245309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656ee75-22bf-41bd-a0cd-77cd16d3ad34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:45.247168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656ee75-22bf-41bd-a0cd-77cd16d3ad34 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:45.259771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1028/2074] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:45.264126 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656ee75-22bf-41bd-a0cd-77cd16d3ad34 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:45.275890 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656ee75-22bf-41bd-a0cd-77cd16d3ad34 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:45.284269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81d5ce-7b83-482b-b918-6c32384f33bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:45.285003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81d5ce-7b83-482b-b918-6c32384f33bd admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:45.285290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81d5ce-7b83-482b-b918-6c32384f33bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:45.285596 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81d5ce-7b83-482b-b918-6c32384f33bd admin admin] PATH_INFO: `/v3/projects/30007d0397554b1f817b29c2dded65bf/users/9fffa7d2ea634ac1910c49d3cfaff755/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:45.291596 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81d5ce-7b83-482b-b918-6c32384f33bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=30007d0397554b1f817b29c2dded65bf, user_id=9fffa7d2ea634ac1910c49d3cfaff755, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:45.297385 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81d5ce-7b83-482b-b918-6c32384f33bd admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:45.321836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1029/2075] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:45 2022] PUT /identity/v3/projects/30007d0397554b1f817b29c2dded65bf/users/9fffa7d2ea634ac1910c49d3cfaff755/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:45.325594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e4729-65f5-4dec-8457-b9a59570f599 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:45.327194 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e4729-65f5-4dec-8457-b9a59570f599 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:45.328534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e4729-65f5-4dec-8457-b9a59570f599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:45.347340 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1047/2076] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:45.354528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2efdcf-c5e5-4795-9a4f-c662593943f7 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:45.384221 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2efdcf-c5e5-4795-9a4f-c662593943f7 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:45.389706 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-579e4729-65f5-4dec-8457-b9a59570f599 None None] MFA Rules not processed for user `9fffa7d2ea634ac1910c49d3cfaff755`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:45.394419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-579e4729-65f5-4dec-8457-b9a59570f599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:45.491193 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b15c4d-63fd-4313-b352-d313007d9d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:45.491745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b15c4d-63fd-4313-b352-d313007d9d23 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:45.492151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b15c4d-63fd-4313-b352-d313007d9d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:45.492538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b15c4d-63fd-4313-b352-d313007d9d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:45.493574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b15c4d-63fd-4313-b352-d313007d9d23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:45.495996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b15c4d-63fd-4313-b352-d313007d9d23 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:45.517991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1030/2077] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:45.528327 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e4729-65f5-4dec-8457-b9a59570f599 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:45.531594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-579e4729-65f5-4dec-8457-b9a59570f599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:45.539346 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1048/2078] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:45 2022] POST /identity/v3/projects => generated 381 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:54:45.545692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b15c4d-63fd-4313-b352-d313007d9d23 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:45.708312 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e4729-65f5-4dec-8457-b9a59570f599 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:45.714943 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:45.784233 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b15c4d-63fd-4313-b352-d313007d9d23 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:45.802566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63623ce6-2426-43a6-940e-dc3fb6696726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:45.804006 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63623ce6-2426-43a6-940e-dc3fb6696726 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:45.804455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63623ce6-2426-43a6-940e-dc3fb6696726 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:45.806874 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63623ce6-2426-43a6-940e-dc3fb6696726 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:45.809448 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63623ce6-2426-43a6-940e-dc3fb6696726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:45.813119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63623ce6-2426-43a6-940e-dc3fb6696726 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:45.818000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557da402-0f81-4537-99cb-fd0d52c84489 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:45.821802 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557da402-0f81-4537-99cb-fd0d52c84489 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:45.822330 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557da402-0f81-4537-99cb-fd0d52c84489 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:45.822751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557da402-0f81-4537-99cb-fd0d52c84489 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:45.867600 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1049/2079] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:45 2022] POST /identity/v3/users => generated 297 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:45.874071 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63623ce6-2426-43a6-940e-dc3fb6696726 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:45.901120 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63623ce6-2426-43a6-940e-dc3fb6696726 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:45.914117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7a735-25af-414d-8462-4526cde938ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:45.914924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7a735-25af-414d-8462-4526cde938ec admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:45.915304 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7a735-25af-414d-8462-4526cde938ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:45.915669 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7a735-25af-414d-8462-4526cde938ec admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:45.916443 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7a735-25af-414d-8462-4526cde938ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:45.920745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7a735-25af-414d-8462-4526cde938ec admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:45.930722 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:45.977489 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1050/2080] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:45.979658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7a735-25af-414d-8462-4526cde938ec admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:46.015293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7a735-25af-414d-8462-4526cde938ec admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:46.030632 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557da402-0f81-4537-99cb-fd0d52c84489 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:46.032862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac2424-7f0b-43c1-9a92-a861d6017d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:46.034101 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac2424-7f0b-43c1-9a92-a861d6017d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:46.034860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557da402-0f81-4537-99cb-fd0d52c84489 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:46.034981 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac2424-7f0b-43c1-9a92-a861d6017d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:46.035527 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac2424-7f0b-43c1-9a92-a861d6017d8b admin admin] PATH_INFO: `/v3/projects/32daafe042704837abf20b1d949bbb30/users/cfd0f17f7bd2418cabd53c5d2a67e0fa/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:46.062747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac2424-7f0b-43c1-9a92-a861d6017d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32daafe042704837abf20b1d949bbb30, user_id=cfd0f17f7bd2418cabd53c5d2a67e0fa, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:46.067290 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac2424-7f0b-43c1-9a92-a861d6017d8b admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:46.077452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1031/2081] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:54:46.099861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1051/2082] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:45 2022] PUT /identity/v3/projects/32daafe042704837abf20b1d949bbb30/users/cfd0f17f7bd2418cabd53c5d2a67e0fa/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:46.105902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557da402-0f81-4537-99cb-fd0d52c84489 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:46.129535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557da402-0f81-4537-99cb-fd0d52c84489 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:46.272005 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f865a-e39f-4ced-aac7-315c2e19b57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:46.272005 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f865a-e39f-4ced-aac7-315c2e19b57c admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:46.273295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f865a-e39f-4ced-aac7-315c2e19b57c admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:46.273839 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f865a-e39f-4ced-aac7-315c2e19b57c admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:46.274602 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f865a-e39f-4ced-aac7-315c2e19b57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:46.278030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f865a-e39f-4ced-aac7-315c2e19b57c admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:46.301777 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1032/2083] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:46.306840 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac2424-7f0b-43c1-9a92-a861d6017d8b admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:46.335908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac2424-7f0b-43c1-9a92-a861d6017d8b admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:46.344727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f7c86-7072-4fd7-9bb9-354848f1ed61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:46.347234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f7c86-7072-4fd7-9bb9-354848f1ed61 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:46.348103 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f7c86-7072-4fd7-9bb9-354848f1ed61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:46.348770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f7c86-7072-4fd7-9bb9-354848f1ed61 admin admin] PATH_INFO: `/v3/projects/32daafe042704837abf20b1d949bbb30/users/cfd0f17f7bd2418cabd53c5d2a67e0fa/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:46.355380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f7c86-7072-4fd7-9bb9-354848f1ed61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32daafe042704837abf20b1d949bbb30, user_id=cfd0f17f7bd2418cabd53c5d2a67e0fa, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:46.362436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f7c86-7072-4fd7-9bb9-354848f1ed61 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:46.393394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1052/2084] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:46 2022] PUT /identity/v3/projects/32daafe042704837abf20b1d949bbb30/users/cfd0f17f7bd2418cabd53c5d2a67e0fa/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:54:46.412388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c85db9-9911-481e-89ba-c6143b24db4d None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:46.412666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c85db9-9911-481e-89ba-c6143b24db4d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:46.413172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c85db9-9911-481e-89ba-c6143b24db4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:46.470569 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-d2c85db9-9911-481e-89ba-c6143b24db4d None None] MFA Rules not processed for user `cfd0f17f7bd2418cabd53c5d2a67e0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:46.474536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-d2c85db9-9911-481e-89ba-c6143b24db4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:46.621419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:46.728212 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1033/2085] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:54:46.731462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f7c86-7072-4fd7-9bb9-354848f1ed61 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:46.886247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f7c86-7072-4fd7-9bb9-354848f1ed61 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:46.890982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adc065-f9dd-4470-906b-41d0ca0aa070 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:46.891712 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc065-f9dd-4470-906b-41d0ca0aa070 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:46.893007 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc065-f9dd-4470-906b-41d0ca0aa070 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:46.893509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc065-f9dd-4470-906b-41d0ca0aa070 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:47.042655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c85db9-9911-481e-89ba-c6143b24db4d None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:47.092066 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adc065-f9dd-4470-906b-41d0ca0aa070 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:47.095545 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adc065-f9dd-4470-906b-41d0ca0aa070 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:47.139296 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1053/2086] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:47.300220 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c85db9-9911-481e-89ba-c6143b24db4d None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:47.314282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26d31d-1fc7-47f9-b908-7098321056f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:47.315749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d31d-1fc7-47f9-b908-7098321056f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:47.316434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d31d-1fc7-47f9-b908-7098321056f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:47.317070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d31d-1fc7-47f9-b908-7098321056f4 admin admin] PATH_INFO: `/v3/users/44aeee169b164c61b249c6e0d4ed4767` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:47.319632 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26d31d-1fc7-47f9-b908-7098321056f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44aeee169b164c61b249c6e0d4ed4767)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:47.323864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26d31d-1fc7-47f9-b908-7098321056f4 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:47.451553 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5d26d31d-1fc7-47f9-b908-7098321056f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44aeee169b164c61b249c6e0d4ed4767'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:47.452590 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5d26d31d-1fc7-47f9-b908-7098321056f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44aeee169b164c61b249c6e0d4ed4767'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:47.453727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5d26d31d-1fc7-47f9-b908-7098321056f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44aeee169b164c61b249c6e0d4ed4767'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:47.492089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5d26d31d-1fc7-47f9-b908-7098321056f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44aeee169b164c61b249c6e0d4ed4767'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:47.516864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5d26d31d-1fc7-47f9-b908-7098321056f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44aeee169b164c61b249c6e0d4ed4767'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:47.557128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1034/2087] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:47 2022] DELETE /identity/v3/users/44aeee169b164c61b249c6e0d4ed4767 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:54:47.563441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460e8b1-4984-4c47-b0ad-e4a55585c8e2 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:47.564214 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460e8b1-4984-4c47-b0ad-e4a55585c8e2 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:47.564805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460e8b1-4984-4c47-b0ad-e4a55585c8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:47.603258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-3460e8b1-4984-4c47-b0ad-e4a55585c8e2 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:47.605928 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3460e8b1-4984-4c47-b0ad-e4a55585c8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:47.787522 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1054/2088] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:47.798451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26d31d-1fc7-47f9-b908-7098321056f4 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:47.801222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5d26d31d-1fc7-47f9-b908-7098321056f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:47.884093 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26d31d-1fc7-47f9-b908-7098321056f4 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:47.888797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7597e1-d284-49e3-8356-f52e68f9a6c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:47.889664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7597e1-d284-49e3-8356-f52e68f9a6c1 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:47.889949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7597e1-d284-49e3-8356-f52e68f9a6c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:47.890221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7597e1-d284-49e3-8356-f52e68f9a6c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:47.904486 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7597e1-d284-49e3-8356-f52e68f9a6c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:47.905913 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7597e1-d284-49e3-8356-f52e68f9a6c1 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:47.931253 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1035/2089] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:48.563314 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460e8b1-4984-4c47-b0ad-e4a55585c8e2 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:48.566223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3460e8b1-4984-4c47-b0ad-e4a55585c8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:48.589164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460e8b1-4984-4c47-b0ad-e4a55585c8e2 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:48.598046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6cff6-3623-4671-93a2-efc13a678ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:48.599369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6cff6-3623-4671-93a2-efc13a678ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:48.600183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6cff6-3623-4671-93a2-efc13a678ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:48.600990 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6cff6-3623-4671-93a2-efc13a678ee4 admin admin] PATH_INFO: `/v3/projects/e86ba2bd7ee245f2ace19877013922f9` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:48.603735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6cff6-3623-4671-93a2-efc13a678ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e86ba2bd7ee245f2ace19877013922f9)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:48.617503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6cff6-3623-4671-93a2-efc13a678ee4 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:48.640093 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:48.720984 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-21c6cff6-3623-4671-93a2-efc13a678ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e86ba2bd7ee245f2ace19877013922f9', 'request_id': 'req-21c6cff6-3623-4671-93a2-efc13a678ee4'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:48.732102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-21c6cff6-3623-4671-93a2-efc13a678ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e86ba2bd7ee245f2ace19877013922f9', 'request_id': 'req-21c6cff6-3623-4671-93a2-efc13a678ee4'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:48.742884 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-21c6cff6-3623-4671-93a2-efc13a678ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e86ba2bd7ee245f2ace19877013922f9', 'request_id': 'req-21c6cff6-3623-4671-93a2-efc13a678ee4'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:48.798486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-21c6cff6-3623-4671-93a2-efc13a678ee4 admin admin] The token cache is being invalidate because project e86ba2bd7ee245f2ace19877013922f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:48.799001 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-21c6cff6-3623-4671-93a2-efc13a678ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:48.802460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-21c6cff6-3623-4671-93a2-efc13a678ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:48.817575 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1055/2090] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:48 2022] DELETE /identity/v3/projects/e86ba2bd7ee245f2ace19877013922f9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:48.817917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7597e1-d284-49e3-8356-f52e68f9a6c1 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:48.833625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:48.855694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7597e1-d284-49e3-8356-f52e68f9a6c1 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:49.051898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c037e26-6b0e-4bbc-9561-1882e2aa662d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:49.053083 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c037e26-6b0e-4bbc-9561-1882e2aa662d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:49.053834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c037e26-6b0e-4bbc-9561-1882e2aa662d admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:49.054255 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c037e26-6b0e-4bbc-9561-1882e2aa662d admin admin] PATH_INFO: `/v3/users/9fffa7d2ea634ac1910c49d3cfaff755` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:49.056992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c037e26-6b0e-4bbc-9561-1882e2aa662d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fffa7d2ea634ac1910c49d3cfaff755)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:49.060797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c037e26-6b0e-4bbc-9561-1882e2aa662d admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:49.158594 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6cff6-3623-4671-93a2-efc13a678ee4 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:49.162541 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-21c6cff6-3623-4671-93a2-efc13a678ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:49.260857 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9c037e26-6b0e-4bbc-9561-1882e2aa662d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fffa7d2ea634ac1910c49d3cfaff755'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:49.263355 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9c037e26-6b0e-4bbc-9561-1882e2aa662d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fffa7d2ea634ac1910c49d3cfaff755'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:49.267540 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9c037e26-6b0e-4bbc-9561-1882e2aa662d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fffa7d2ea634ac1910c49d3cfaff755'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:49.329615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9c037e26-6b0e-4bbc-9561-1882e2aa662d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fffa7d2ea634ac1910c49d3cfaff755'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:49.371418 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9c037e26-6b0e-4bbc-9561-1882e2aa662d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fffa7d2ea634ac1910c49d3cfaff755'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:49.408201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6cff6-3623-4671-93a2-efc13a678ee4 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:49.408201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637baaa3-2171-4566-b16e-20e3a2c24a0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:49.408201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637baaa3-2171-4566-b16e-20e3a2c24a0b service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:49.408201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637baaa3-2171-4566-b16e-20e3a2c24a0b service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:49.408936 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637baaa3-2171-4566-b16e-20e3a2c24a0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:49.409085 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-637baaa3-2171-4566-b16e-20e3a2c24a0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:49.415625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1036/2091] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:48 2022] DELETE /identity/v3/users/9fffa7d2ea634ac1910c49d3cfaff755 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:49.589228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637baaa3-2171-4566-b16e-20e3a2c24a0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:49.591327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637baaa3-2171-4566-b16e-20e3a2c24a0b service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:49.616334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1056/2092] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:50.748979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c037e26-6b0e-4bbc-9561-1882e2aa662d admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:50.751422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9c037e26-6b0e-4bbc-9561-1882e2aa662d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:50.941000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c037e26-6b0e-4bbc-9561-1882e2aa662d admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:50.951152 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385af9d3-9532-4f36-8506-87a0ab83056e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:50.952096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385af9d3-9532-4f36-8506-87a0ab83056e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:50.952729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385af9d3-9532-4f36-8506-87a0ab83056e admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:50.953437 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385af9d3-9532-4f36-8506-87a0ab83056e admin admin] PATH_INFO: `/v3/projects/30007d0397554b1f817b29c2dded65bf` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:50.960610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385af9d3-9532-4f36-8506-87a0ab83056e admin admin] RBAC: Authorizing `identity:delete_project(project_id=30007d0397554b1f817b29c2dded65bf)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:50.974430 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385af9d3-9532-4f36-8506-87a0ab83056e admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:51.028081 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:51.074271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-385af9d3-9532-4f36-8506-87a0ab83056e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30007d0397554b1f817b29c2dded65bf', 'request_id': 'req-385af9d3-9532-4f36-8506-87a0ab83056e'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:51.082527 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-385af9d3-9532-4f36-8506-87a0ab83056e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30007d0397554b1f817b29c2dded65bf', 'request_id': 'req-385af9d3-9532-4f36-8506-87a0ab83056e'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:51.094565 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-385af9d3-9532-4f36-8506-87a0ab83056e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30007d0397554b1f817b29c2dded65bf', 'request_id': 'req-385af9d3-9532-4f36-8506-87a0ab83056e'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:51.111701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-385af9d3-9532-4f36-8506-87a0ab83056e admin admin] The token cache is being invalidate because project 30007d0397554b1f817b29c2dded65bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:51.112211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-385af9d3-9532-4f36-8506-87a0ab83056e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:51.113251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-385af9d3-9532-4f36-8506-87a0ab83056e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:51.119461 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1037/2093] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:50 2022] DELETE /identity/v3/projects/30007d0397554b1f817b29c2dded65bf => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:54:51.122281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700615d-e378-4e04-ba7b-804cd6383f72 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:51.122856 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700615d-e378-4e04-ba7b-804cd6383f72 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:51.123268 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700615d-e378-4e04-ba7b-804cd6383f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:51.146533 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385af9d3-9532-4f36-8506-87a0ab83056e admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:51.149800 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-385af9d3-9532-4f36-8506-87a0ab83056e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:51.189285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-9700615d-e378-4e04-ba7b-804cd6383f72 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:51.191042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9700615d-e378-4e04-ba7b-804cd6383f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:51.289335 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:51.317333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385af9d3-9532-4f36-8506-87a0ab83056e admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:51.319682 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1057/2094] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:51.333847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d15e7-f92e-467f-9f2c-6ce262316557 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:51.336493 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdbf53-9e50-4e00-9037-01f65d3f5f65 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:51.339356 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdbf53-9e50-4e00-9037-01f65d3f5f65 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:51.340040 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdbf53-9e50-4e00-9037-01f65d3f5f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:51.345639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d15e7-f92e-467f-9f2c-6ce262316557 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:51.346455 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d15e7-f92e-467f-9f2c-6ce262316557 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:51.347900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d15e7-f92e-467f-9f2c-6ce262316557 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:51.355678 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-601d15e7-f92e-467f-9f2c-6ce262316557 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:51.418538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-47bdbf53-9e50-4e00-9037-01f65d3f5f65 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:51.421471 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-47bdbf53-9e50-4e00-9037-01f65d3f5f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:51.432237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1058/2095] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:54:51.436865 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdbf53-9e50-4e00-9037-01f65d3f5f65 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:51.466935 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdbf53-9e50-4e00-9037-01f65d3f5f65 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:51.473283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2e6a8-8094-40a2-82f7-756685e6aa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:51.474311 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2e6a8-8094-40a2-82f7-756685e6aa0d admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:51.474695 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2e6a8-8094-40a2-82f7-756685e6aa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:51.475056 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2e6a8-8094-40a2-82f7-756685e6aa0d admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:51.476146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2e6a8-8094-40a2-82f7-756685e6aa0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:54:51.476781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2e6a8-8094-40a2-82f7-756685e6aa0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:51.479457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2e6a8-8094-40a2-82f7-756685e6aa0d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:51.500895 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1059/2096] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:54:51.503658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2e6a8-8094-40a2-82f7-756685e6aa0d admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:51.519208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2e6a8-8094-40a2-82f7-756685e6aa0d admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:51.528683 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebf001-909c-464e-8afa-da534dee5c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:51.529533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebf001-909c-464e-8afa-da534dee5c7c admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:51.530134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebf001-909c-464e-8afa-da534dee5c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:51.530515 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebf001-909c-464e-8afa-da534dee5c7c admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:51.536971 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebf001-909c-464e-8afa-da534dee5c7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:51.539529 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebf001-909c-464e-8afa-da534dee5c7c admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:51.542386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d15e7-f92e-467f-9f2c-6ce262316557 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:51.544760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d15e7-f92e-467f-9f2c-6ce262316557 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:51.598987 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1060/2097] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:51 2022] POST /identity/v3/projects => generated 359 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:51.603434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebf001-909c-464e-8afa-da534dee5c7c admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:51.620942 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1038/2098] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:51.747413 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebf001-909c-464e-8afa-da534dee5c7c admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:51.761110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9ba38-64ce-4ff4-990f-389a4ce7da40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:51.764413 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9ba38-64ce-4ff4-990f-389a4ce7da40 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:51.766738 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9ba38-64ce-4ff4-990f-389a4ce7da40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:51.766738 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9ba38-64ce-4ff4-990f-389a4ce7da40 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:51.767286 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9ba38-64ce-4ff4-990f-389a4ce7da40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:51.774152 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9ba38-64ce-4ff4-990f-389a4ce7da40 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:51.834593 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1061/2099] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:51 2022] POST /identity/v3/users => generated 280 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:51.837778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d15e7-f92e-467f-9f2c-6ce262316557 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:51.853752 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d15e7-f92e-467f-9f2c-6ce262316557 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:51.871947 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f016f-52c8-459b-ada8-524e0e30c511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:51.873759 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f016f-52c8-459b-ada8-524e0e30c511 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:51.874109 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f016f-52c8-459b-ada8-524e0e30c511 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:51.875033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f016f-52c8-459b-ada8-524e0e30c511 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:51.875158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f016f-52c8-459b-ada8-524e0e30c511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:51.876814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f016f-52c8-459b-ada8-524e0e30c511 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:51.903642 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1039/2100] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:51.907737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9ba38-64ce-4ff4-990f-389a4ce7da40 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:51.921208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9ba38-64ce-4ff4-990f-389a4ce7da40 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:51.928379 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd35377-3c9e-4498-b5aa-8e4d01e47fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:51.929208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35377-3c9e-4498-b5aa-8e4d01e47fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:51.929685 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35377-3c9e-4498-b5aa-8e4d01e47fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:51.930059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd35377-3c9e-4498-b5aa-8e4d01e47fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:51.930837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd35377-3c9e-4498-b5aa-8e4d01e47fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:51.932816 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd35377-3c9e-4498-b5aa-8e4d01e47fe3 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:51.946959 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1062/2101] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:51.952287 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f016f-52c8-459b-ada8-524e0e30c511 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:51.970654 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f016f-52c8-459b-ada8-524e0e30c511 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:51.978269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282658c-7d28-492a-aba9-6f7c3750b91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:51.979410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282658c-7d28-492a-aba9-6f7c3750b91f admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:51.979774 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282658c-7d28-492a-aba9-6f7c3750b91f admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:51.980060 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282658c-7d28-492a-aba9-6f7c3750b91f admin admin] PATH_INFO: `/v3/projects/448af3eef5494a9f9593157133a3fd4f/users/ee56b2e12b5c4d49822f979a9a0d74f1/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:52.003893 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282658c-7d28-492a-aba9-6f7c3750b91f admin admin] RBAC: Authorizing `identity:create_grant(project_id=448af3eef5494a9f9593157133a3fd4f, user_id=ee56b2e12b5c4d49822f979a9a0d74f1, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:52.011704 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282658c-7d28-492a-aba9-6f7c3750b91f admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:52.077652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1040/2102] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:51 2022] PUT /identity/v3/projects/448af3eef5494a9f9593157133a3fd4f/users/ee56b2e12b5c4d49822f979a9a0d74f1/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:52.094824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debe8d9-9ae8-4582-bfa8-81087a2d9de4 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:52.095240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debe8d9-9ae8-4582-bfa8-81087a2d9de4 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:52.095616 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debe8d9-9ae8-4582-bfa8-81087a2d9de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:52.170963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-7debe8d9-9ae8-4582-bfa8-81087a2d9de4 None None] MFA Rules not processed for user `ee56b2e12b5c4d49822f979a9a0d74f1`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:52.172681 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-7debe8d9-9ae8-4582-bfa8-81087a2d9de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:52.258900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1063/2103] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:52.299384 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282658c-7d28-492a-aba9-6f7c3750b91f admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:52.338021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:52.370914 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfb64d-b0cb-4d53-9951-52aa9a1b0aaa None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:52.371351 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfb64d-b0cb-4d53-9951-52aa9a1b0aaa None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:52.371629 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfb64d-b0cb-4d53-9951-52aa9a1b0aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:52.384468 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282658c-7d28-492a-aba9-6f7c3750b91f admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:52.388830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5e45b-9bae-4429-b738-e11d774b21f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:52.392146 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5e45b-9bae-4429-b738-e11d774b21f0 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:52.392146 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5e45b-9bae-4429-b738-e11d774b21f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:52.392146 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5e45b-9bae-4429-b738-e11d774b21f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:52.403094 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5e45b-9bae-4429-b738-e11d774b21f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:52.404933 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5e45b-9bae-4429-b738-e11d774b21f0 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:52.414081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-d6dfb64d-b0cb-4d53-9951-52aa9a1b0aaa None None] MFA Rules not processed for user `938c34cda5234812894863921ad14d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:52.416017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d6dfb64d-b0cb-4d53-9951-52aa9a1b0aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:52.429933 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:52.439010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1041/2104] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:54:52.456749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5e45b-9bae-4429-b738-e11d774b21f0 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:52.531760 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1064/2105] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:52.547969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfb64d-b0cb-4d53-9951-52aa9a1b0aaa None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:52.550318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d6dfb64d-b0cb-4d53-9951-52aa9a1b0aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:52.563910 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5e45b-9bae-4429-b738-e11d774b21f0 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:52.574549 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fb350-1237-4038-98fd-048651b67da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:52.574549 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fb350-1237-4038-98fd-048651b67da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:52.574879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fb350-1237-4038-98fd-048651b67da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:52.575237 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fb350-1237-4038-98fd-048651b67da2 admin admin] PATH_INFO: `/v3/users/ee56b2e12b5c4d49822f979a9a0d74f1` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:52.576673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fb350-1237-4038-98fd-048651b67da2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee56b2e12b5c4d49822f979a9a0d74f1)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:52.578810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fb350-1237-4038-98fd-048651b67da2 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:52.679058 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-539fb350-1237-4038-98fd-048651b67da2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee56b2e12b5c4d49822f979a9a0d74f1'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:52.680077 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-539fb350-1237-4038-98fd-048651b67da2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee56b2e12b5c4d49822f979a9a0d74f1'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:52.680878 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-539fb350-1237-4038-98fd-048651b67da2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee56b2e12b5c4d49822f979a9a0d74f1'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:52.690483 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfb64d-b0cb-4d53-9951-52aa9a1b0aaa None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:52.696855 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6782d02-27af-4ffd-b994-d898aabf43fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:52.697608 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6782d02-27af-4ffd-b994-d898aabf43fb service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:52.697937 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6782d02-27af-4ffd-b994-d898aabf43fb service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:52.698213 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-539fb350-1237-4038-98fd-048651b67da2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee56b2e12b5c4d49822f979a9a0d74f1'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:52.698317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6782d02-27af-4ffd-b994-d898aabf43fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:52.700467 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b6782d02-27af-4ffd-b994-d898aabf43fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:52.708139 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-539fb350-1237-4038-98fd-048651b67da2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee56b2e12b5c4d49822f979a9a0d74f1'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:52.714153 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6782d02-27af-4ffd-b994-d898aabf43fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:52.717621 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6782d02-27af-4ffd-b994-d898aabf43fb service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:52.731485 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1065/2107] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:54:52.733273 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1042/2107] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:52 2022] DELETE /identity/v3/users/ee56b2e12b5c4d49822f979a9a0d74f1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:52.734809 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15db44-0d2d-4e58-aa76-6acacbd9fd0f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:52.735098 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15db44-0d2d-4e58-aa76-6acacbd9fd0f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:52.735485 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15db44-0d2d-4e58-aa76-6acacbd9fd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:52.762868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-0d15db44-0d2d-4e58-aa76-6acacbd9fd0f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:52.764402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0d15db44-0d2d-4e58-aa76-6acacbd9fd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:52.879673 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1066/2108] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:52.895376 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fb350-1237-4038-98fd-048651b67da2 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:52.900334 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-539fb350-1237-4038-98fd-048651b67da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:53.053170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:53.062847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fb350-1237-4038-98fd-048651b67da2 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:53.074125 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a1de3-34b4-46fe-a8ac-9c9ed5bb59b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:53.077325 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a1de3-34b4-46fe-a8ac-9c9ed5bb59b8 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:53.077632 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a1de3-34b4-46fe-a8ac-9c9ed5bb59b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:53.077932 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a1de3-34b4-46fe-a8ac-9c9ed5bb59b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:53.113097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a1de3-34b4-46fe-a8ac-9c9ed5bb59b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:53.115758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a1de3-34b4-46fe-a8ac-9c9ed5bb59b8 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:53.142971 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1043/2109] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:54:54.738349 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15db44-0d2d-4e58-aa76-6acacbd9fd0f None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:54.743542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0d15db44-0d2d-4e58-aa76-6acacbd9fd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:54.802450 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15db44-0d2d-4e58-aa76-6acacbd9fd0f None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:54.813000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f017cc1-7e78-4f71-ad46-12076989b5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:54.813715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f017cc1-7e78-4f71-ad46-12076989b5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:54.813997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f017cc1-7e78-4f71-ad46-12076989b5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:54.818194 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f017cc1-7e78-4f71-ad46-12076989b5e8 admin admin] PATH_INFO: `/v3/projects/448af3eef5494a9f9593157133a3fd4f` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:54.823007 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f017cc1-7e78-4f71-ad46-12076989b5e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=448af3eef5494a9f9593157133a3fd4f)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:54.825046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f017cc1-7e78-4f71-ad46-12076989b5e8 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:54.911062 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:54.962312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8f017cc1-7e78-4f71-ad46-12076989b5e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448af3eef5494a9f9593157133a3fd4f', 'request_id': 'req-8f017cc1-7e78-4f71-ad46-12076989b5e8'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:54.987644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8f017cc1-7e78-4f71-ad46-12076989b5e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448af3eef5494a9f9593157133a3fd4f', 'request_id': 'req-8f017cc1-7e78-4f71-ad46-12076989b5e8'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:55.005383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8f017cc1-7e78-4f71-ad46-12076989b5e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448af3eef5494a9f9593157133a3fd4f', 'request_id': 'req-8f017cc1-7e78-4f71-ad46-12076989b5e8'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:55.044732 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8f017cc1-7e78-4f71-ad46-12076989b5e8 admin admin] The token cache is being invalidate because project 448af3eef5494a9f9593157133a3fd4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:55.047724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8f017cc1-7e78-4f71-ad46-12076989b5e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:55.050747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8f017cc1-7e78-4f71-ad46-12076989b5e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:55.053137 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1067/2110] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:54 2022] DELETE /identity/v3/projects/448af3eef5494a9f9593157133a3fd4f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:55.059341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c019383-ab31-4846-8568-0526d072e298 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:55.059908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c019383-ab31-4846-8568-0526d072e298 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:55.060283 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c019383-ab31-4846-8568-0526d072e298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:55.147047 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-0c019383-ab31-4846-8568-0526d072e298 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:55.149312 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0c019383-ab31-4846-8568-0526d072e298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:55.381905 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1044/2111] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:55.389688 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba4a40-cd14-49c8-9d12-0b927fecfcc3 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:55.390672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba4a40-cd14-49c8-9d12-0b927fecfcc3 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:55.391775 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba4a40-cd14-49c8-9d12-0b927fecfcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:55.481080 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-feba4a40-cd14-49c8-9d12-0b927fecfcc3 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:55.483134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-feba4a40-cd14-49c8-9d12-0b927fecfcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:55.531899 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1068/2112] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:54:55.539725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c019383-ab31-4846-8568-0526d072e298 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:55.638453 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c019383-ab31-4846-8568-0526d072e298 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:55.686025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac41ea-159a-4d25-993e-382e4608df51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:55.687427 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac41ea-159a-4d25-993e-382e4608df51 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:55.687975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac41ea-159a-4d25-993e-382e4608df51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:55.688452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac41ea-159a-4d25-993e-382e4608df51 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:55.689716 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac41ea-159a-4d25-993e-382e4608df51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:54:55.690210 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac41ea-159a-4d25-993e-382e4608df51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:55.703928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac41ea-159a-4d25-993e-382e4608df51 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:55.753290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1045/2113] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:54:55.758912 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba4a40-cd14-49c8-9d12-0b927fecfcc3 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:55.814903 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba4a40-cd14-49c8-9d12-0b927fecfcc3 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:55.832028 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139695c-2e19-4e09-81f0-50ac83f6c853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:55.832757 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139695c-2e19-4e09-81f0-50ac83f6c853 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:55.833702 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139695c-2e19-4e09-81f0-50ac83f6c853 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:55.834221 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139695c-2e19-4e09-81f0-50ac83f6c853 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:55.835241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139695c-2e19-4e09-81f0-50ac83f6c853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:55.869332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139695c-2e19-4e09-81f0-50ac83f6c853 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:55.932697 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1069/2114] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:54:55 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:54:55.939201 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac41ea-159a-4d25-993e-382e4608df51 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:55.952778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac41ea-159a-4d25-993e-382e4608df51 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:56.103820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae55662-9aa8-44f3-a7b6-6f5929933cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:56.113543 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae55662-9aa8-44f3-a7b6-6f5929933cdf admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:56.114777 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae55662-9aa8-44f3-a7b6-6f5929933cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:56.115832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae55662-9aa8-44f3-a7b6-6f5929933cdf admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:56.117789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae55662-9aa8-44f3-a7b6-6f5929933cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:56.123080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae55662-9aa8-44f3-a7b6-6f5929933cdf admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:56.170720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1046/2115] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:54:55 2022] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:54:56.176808 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139695c-2e19-4e09-81f0-50ac83f6c853 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:56.194075 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139695c-2e19-4e09-81f0-50ac83f6c853 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:56.200068 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589ba94-b6c7-4237-9710-553d5300c8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:56.200707 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589ba94-b6c7-4237-9710-553d5300c8fe admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:56.201244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589ba94-b6c7-4237-9710-553d5300c8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:56.201244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589ba94-b6c7-4237-9710-553d5300c8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:56.201969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589ba94-b6c7-4237-9710-553d5300c8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:56.203990 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589ba94-b6c7-4237-9710-553d5300c8fe admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:56.220222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1070/2116] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:54:56.226678 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae55662-9aa8-44f3-a7b6-6f5929933cdf admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:56.247014 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae55662-9aa8-44f3-a7b6-6f5929933cdf admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:56.257109 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19d5f7-1f62-416d-abda-32db04a5c336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:56.258978 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19d5f7-1f62-416d-abda-32db04a5c336 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:56.259496 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19d5f7-1f62-416d-abda-32db04a5c336 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:56.260072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19d5f7-1f62-416d-abda-32db04a5c336 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:56.262039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19d5f7-1f62-416d-abda-32db04a5c336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:56.265093 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19d5f7-1f62-416d-abda-32db04a5c336 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:56.281438 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1047/2117] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:54:56.287743 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589ba94-b6c7-4237-9710-553d5300c8fe admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:56.307687 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589ba94-b6c7-4237-9710-553d5300c8fe admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:56.319365 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b2c37-b0b2-4463-aada-c3b9f24b8b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:56.320210 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b2c37-b0b2-4463-aada-c3b9f24b8b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:56.320559 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b2c37-b0b2-4463-aada-c3b9f24b8b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:56.320905 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b2c37-b0b2-4463-aada-c3b9f24b8b6c admin admin] PATH_INFO: `/v3/projects/903f1195ba9e4a8ebfa8390dab8e460a/users/054f42188d5444b0a9e186dafb1a5c20/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:56.342671 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b2c37-b0b2-4463-aada-c3b9f24b8b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=903f1195ba9e4a8ebfa8390dab8e460a, user_id=054f42188d5444b0a9e186dafb1a5c20, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:56.345661 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b2c37-b0b2-4463-aada-c3b9f24b8b6c admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:56.366323 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1071/2118] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:54:56 2022] PUT /identity/v3/projects/903f1195ba9e4a8ebfa8390dab8e460a/users/054f42188d5444b0a9e186dafb1a5c20/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:56.384813 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141509a4-2f65-4abe-8d48-c8238c256ded None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:56.385183 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141509a4-2f65-4abe-8d48-c8238c256ded None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:56.385727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141509a4-2f65-4abe-8d48-c8238c256ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:56.452323 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-141509a4-2f65-4abe-8d48-c8238c256ded None None] MFA Rules not processed for user `054f42188d5444b0a9e186dafb1a5c20`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:56.455549 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-141509a4-2f65-4abe-8d48-c8238c256ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:56.542480 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:56.581629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1048/2119] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:56.594159 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b2c37-b0b2-4463-aada-c3b9f24b8b6c admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:56.596117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4e1b2c37-b0b2-4463-aada-c3b9f24b8b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:56.688022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b2c37-b0b2-4463-aada-c3b9f24b8b6c admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:56.692787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40036b-7438-48e7-a680-aa11fc5c1d88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:56.693573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40036b-7438-48e7-a680-aa11fc5c1d88 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:56.693922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40036b-7438-48e7-a680-aa11fc5c1d88 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:56.694265 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40036b-7438-48e7-a680-aa11fc5c1d88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:56.717373 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40036b-7438-48e7-a680-aa11fc5c1d88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:56.717373 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40036b-7438-48e7-a680-aa11fc5c1d88 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:56.724201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1072/2120] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:57.073200 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141509a4-2f65-4abe-8d48-c8238c256ded None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:57.077154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-141509a4-2f65-4abe-8d48-c8238c256ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:57.240935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141509a4-2f65-4abe-8d48-c8238c256ded None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:57.246205 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f077e0f-31f6-4aa9-b6d3-6df5ba8e42bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:57.247058 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f077e0f-31f6-4aa9-b6d3-6df5ba8e42bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:57.247818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f077e0f-31f6-4aa9-b6d3-6df5ba8e42bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:57.248170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f077e0f-31f6-4aa9-b6d3-6df5ba8e42bd admin admin] PATH_INFO: `/v3/users/904dce15d85949c0b8f846e42956c070` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:57.249731 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f077e0f-31f6-4aa9-b6d3-6df5ba8e42bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=904dce15d85949c0b8f846e42956c070)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:57.251931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f077e0f-31f6-4aa9-b6d3-6df5ba8e42bd admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:57.359021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5f077e0f-31f6-4aa9-b6d3-6df5ba8e42bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '904dce15d85949c0b8f846e42956c070'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:57.359920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5f077e0f-31f6-4aa9-b6d3-6df5ba8e42bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '904dce15d85949c0b8f846e42956c070'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:57.360930 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5f077e0f-31f6-4aa9-b6d3-6df5ba8e42bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '904dce15d85949c0b8f846e42956c070'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:57.390513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5f077e0f-31f6-4aa9-b6d3-6df5ba8e42bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '904dce15d85949c0b8f846e42956c070'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:57.410560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-5f077e0f-31f6-4aa9-b6d3-6df5ba8e42bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '904dce15d85949c0b8f846e42956c070'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:57.440599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1049/2121] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:57 2022] DELETE /identity/v3/users/904dce15d85949c0b8f846e42956c070 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:57.446231 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a007b-f7cc-47c3-9061-3742e188c435 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:57.446692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a007b-f7cc-47c3-9061-3742e188c435 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:57.446692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a007b-f7cc-47c3-9061-3742e188c435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:57.471503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-808a007b-f7cc-47c3-9061-3742e188c435 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:57.472928 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-808a007b-f7cc-47c3-9061-3742e188c435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:57.547585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:57.572249 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1073/2122] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:57.601719 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f077e0f-31f6-4aa9-b6d3-6df5ba8e42bd admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:57.603352 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5f077e0f-31f6-4aa9-b6d3-6df5ba8e42bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:57.768270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f077e0f-31f6-4aa9-b6d3-6df5ba8e42bd admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:57.773430 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3f905-10ae-4da8-bfcd-10fdc8e0a87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:57.774193 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3f905-10ae-4da8-bfcd-10fdc8e0a87e service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:57.774553 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3f905-10ae-4da8-bfcd-10fdc8e0a87e service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:57.774805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3f905-10ae-4da8-bfcd-10fdc8e0a87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:57.787536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3f905-10ae-4da8-bfcd-10fdc8e0a87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:57.789431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3f905-10ae-4da8-bfcd-10fdc8e0a87e service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:57.806093 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1050/2123] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:54:58.095537 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791794bf-073d-4ef9-a788-20b83d183924 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:58.095885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791794bf-073d-4ef9-a788-20b83d183924 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:58.096498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791794bf-073d-4ef9-a788-20b83d183924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:58.152656 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-791794bf-073d-4ef9-a788-20b83d183924 None None] MFA Rules not processed for user `938c34cda5234812894863921ad14d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:54:58.154570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-791794bf-073d-4ef9-a788-20b83d183924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:58.284453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1074/2124] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:54:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:54:58.716881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3f905-10ae-4da8-bfcd-10fdc8e0a87e service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:58.719530 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-dee3f905-10ae-4da8-bfcd-10fdc8e0a87e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:54:58.781585 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3f905-10ae-4da8-bfcd-10fdc8e0a87e service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:58.790402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:58.791635 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:58.792102 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:58.792734 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2 admin admin] PATH_INFO: `/v3/projects/202be259a96948fa8883e207a794fbc1` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:58.795601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=202be259a96948fa8883e207a794fbc1)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:58.799771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:58.825745 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:58.946165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202be259a96948fa8883e207a794fbc1', 'request_id': 'req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:58.960756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202be259a96948fa8883e207a794fbc1', 'request_id': 'req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:58.978431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202be259a96948fa8883e207a794fbc1', 'request_id': 'req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:59.006212 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2 admin admin] The token cache is being invalidate because project 202be259a96948fa8883e207a794fbc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:54:59.006929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:59.008107 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:59.011112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1051/2125] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:54:58 2022] DELETE /identity/v3/projects/202be259a96948fa8883e207a794fbc1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:54:59.016486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791794bf-073d-4ef9-a788-20b83d183924 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:54:59.031980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791794bf-073d-4ef9-a788-20b83d183924 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:54:59.143058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e9514-3fd6-43da-a321-e51f2b492e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:54:59.144334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e9514-3fd6-43da-a321-e51f2b492e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:54:59.144334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e9514-3fd6-43da-a321-e51f2b492e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:54:59.144550 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e9514-3fd6-43da-a321-e51f2b492e5d admin admin] PATH_INFO: `/v3/users/fe8ea290e23f4d12ad1f6f991ab738c0` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:54:59.146091 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e9514-3fd6-43da-a321-e51f2b492e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe8ea290e23f4d12ad1f6f991ab738c0)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:54:59.148479 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e9514-3fd6-43da-a321-e51f2b492e5d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:54:59.242738 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-289e9514-3fd6-43da-a321-e51f2b492e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe8ea290e23f4d12ad1f6f991ab738c0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:59.267343 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-289e9514-3fd6-43da-a321-e51f2b492e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe8ea290e23f4d12ad1f6f991ab738c0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:59.309787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-289e9514-3fd6-43da-a321-e51f2b492e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe8ea290e23f4d12ad1f6f991ab738c0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:59.338167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-289e9514-3fd6-43da-a321-e51f2b492e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe8ea290e23f4d12ad1f6f991ab738c0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:59.340915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-289e9514-3fd6-43da-a321-e51f2b492e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe8ea290e23f4d12ad1f6f991ab738c0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:54:59.361771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1075/2126] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:54:59 2022] DELETE /identity/v3/users/fe8ea290e23f4d12ad1f6f991ab738c0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:55:00.384494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:00.386281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:00.423864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed16c87-bcdd-44ad-8489-9cde71fea6c2 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:00.516832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefee967-908b-4284-918c-4edf85935219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:00.517751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefee967-908b-4284-918c-4edf85935219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:00.518101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefee967-908b-4284-918c-4edf85935219 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:00.518422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefee967-908b-4284-918c-4edf85935219 admin admin] PATH_INFO: `/v3/projects/0b03c855bf8b40058cb6ad68be9b93aa` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:00.519862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefee967-908b-4284-918c-4edf85935219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b03c855bf8b40058cb6ad68be9b93aa)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:00.522329 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefee967-908b-4284-918c-4edf85935219 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:00.587684 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-eefee967-908b-4284-918c-4edf85935219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b03c855bf8b40058cb6ad68be9b93aa', 'request_id': 'req-eefee967-908b-4284-918c-4edf85935219'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:00.595911 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-eefee967-908b-4284-918c-4edf85935219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b03c855bf8b40058cb6ad68be9b93aa', 'request_id': 'req-eefee967-908b-4284-918c-4edf85935219'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:00.609832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-eefee967-908b-4284-918c-4edf85935219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b03c855bf8b40058cb6ad68be9b93aa', 'request_id': 'req-eefee967-908b-4284-918c-4edf85935219'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:00.631705 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-eefee967-908b-4284-918c-4edf85935219 admin admin] The token cache is being invalidate because project 0b03c855bf8b40058cb6ad68be9b93aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:55:00.632185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-eefee967-908b-4284-918c-4edf85935219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:00.633318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-eefee967-908b-4284-918c-4edf85935219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:00.636094 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1052/2127] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:55:00 2022] DELETE /identity/v3/projects/0b03c855bf8b40058cb6ad68be9b93aa => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:55:00.641817 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e9514-3fd6-43da-a321-e51f2b492e5d admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:00.643761 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-289e9514-3fd6-43da-a321-e51f2b492e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:00.657837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e9514-3fd6-43da-a321-e51f2b492e5d admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:00.690411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:00.753167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c5955-b440-4ef0-86b8-e2ed2a6a2903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:00.754287 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c5955-b440-4ef0-86b8-e2ed2a6a2903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:00.755214 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c5955-b440-4ef0-86b8-e2ed2a6a2903 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:00.755656 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c5955-b440-4ef0-86b8-e2ed2a6a2903 admin admin] PATH_INFO: `/v3/users/cfd0f17f7bd2418cabd53c5d2a67e0fa` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:00.757751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c5955-b440-4ef0-86b8-e2ed2a6a2903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd0f17f7bd2418cabd53c5d2a67e0fa)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:00.760908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c5955-b440-4ef0-86b8-e2ed2a6a2903 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:00.854103 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-122c5955-b440-4ef0-86b8-e2ed2a6a2903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd0f17f7bd2418cabd53c5d2a67e0fa'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:00.880496 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-122c5955-b440-4ef0-86b8-e2ed2a6a2903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd0f17f7bd2418cabd53c5d2a67e0fa'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:00.902730 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-122c5955-b440-4ef0-86b8-e2ed2a6a2903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd0f17f7bd2418cabd53c5d2a67e0fa'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:00.918797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-122c5955-b440-4ef0-86b8-e2ed2a6a2903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd0f17f7bd2418cabd53c5d2a67e0fa'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:00.919957 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-122c5955-b440-4ef0-86b8-e2ed2a6a2903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd0f17f7bd2418cabd53c5d2a67e0fa'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:00.941617 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1076/2128] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:55:00 2022] DELETE /identity/v3/users/cfd0f17f7bd2418cabd53c5d2a67e0fa => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:55:01.150257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefee967-908b-4284-918c-4edf85935219 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:01.153107 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-eefee967-908b-4284-918c-4edf85935219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:01.209132 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefee967-908b-4284-918c-4edf85935219 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:01.271434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:01.395391 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4bd5d-c0f4-4e61-88b3-6468aeb0002a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:01.396599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4bd5d-c0f4-4e61-88b3-6468aeb0002a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:01.402015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4bd5d-c0f4-4e61-88b3-6468aeb0002a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:01.402015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4bd5d-c0f4-4e61-88b3-6468aeb0002a admin admin] PATH_INFO: `/v3/users/054f42188d5444b0a9e186dafb1a5c20` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:01.402015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4bd5d-c0f4-4e61-88b3-6468aeb0002a admin admin] RBAC: Authorizing `identity:delete_user(user_id=054f42188d5444b0a9e186dafb1a5c20)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:01.402885 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4bd5d-c0f4-4e61-88b3-6468aeb0002a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:01.518745 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ffb4bd5d-c0f4-4e61-88b3-6468aeb0002a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '054f42188d5444b0a9e186dafb1a5c20'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:01.519844 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ffb4bd5d-c0f4-4e61-88b3-6468aeb0002a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '054f42188d5444b0a9e186dafb1a5c20'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:01.520895 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ffb4bd5d-c0f4-4e61-88b3-6468aeb0002a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '054f42188d5444b0a9e186dafb1a5c20'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:01.548269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ffb4bd5d-c0f4-4e61-88b3-6468aeb0002a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '054f42188d5444b0a9e186dafb1a5c20'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:01.589122 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ffb4bd5d-c0f4-4e61-88b3-6468aeb0002a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '054f42188d5444b0a9e186dafb1a5c20'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:01.621402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1053/2129] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:55:01 2022] DELETE /identity/v3/users/054f42188d5444b0a9e186dafb1a5c20 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:55:01.624869 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9760e2-0da3-4e6c-a177-b605b0f08a61 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:01.625132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9760e2-0da3-4e6c-a177-b605b0f08a61 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:01.625446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9760e2-0da3-4e6c-a177-b605b0f08a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:01.666037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-6c9760e2-0da3-4e6c-a177-b605b0f08a61 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:01.667341 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6c9760e2-0da3-4e6c-a177-b605b0f08a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:01.882161 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4bd5d-c0f4-4e61-88b3-6468aeb0002a admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:01.884524 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ffb4bd5d-c0f4-4e61-88b3-6468aeb0002a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:01.927384 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1077/2130] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:55:01.939240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9760e2-0da3-4e6c-a177-b605b0f08a61 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:01.941084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6c9760e2-0da3-4e6c-a177-b605b0f08a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:02.063576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:02.066378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4bd5d-c0f4-4e61-88b3-6468aeb0002a admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:02.072801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e4cb0-e170-4854-8610-5b9d1cf9364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:02.073608 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e4cb0-e170-4854-8610-5b9d1cf9364b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:02.073952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e4cb0-e170-4854-8610-5b9d1cf9364b admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:02.074293 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e4cb0-e170-4854-8610-5b9d1cf9364b admin admin] PATH_INFO: `/v3/projects/32daafe042704837abf20b1d949bbb30` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:02.076023 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e4cb0-e170-4854-8610-5b9d1cf9364b admin admin] RBAC: Authorizing `identity:delete_project(project_id=32daafe042704837abf20b1d949bbb30)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:02.079527 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e4cb0-e170-4854-8610-5b9d1cf9364b admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:02.083982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9760e2-0da3-4e6c-a177-b605b0f08a61 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:02.089891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4824622-2cf0-40cc-bd3e-99a905e47493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:02.091856 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4824622-2cf0-40cc-bd3e-99a905e47493 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:02.092240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4824622-2cf0-40cc-bd3e-99a905e47493 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:02.093094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4824622-2cf0-40cc-bd3e-99a905e47493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:02.106443 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4824622-2cf0-40cc-bd3e-99a905e47493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:02.108215 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4824622-2cf0-40cc-bd3e-99a905e47493 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:02.144296 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1078/2131] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:55:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:55:02.174539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:02.181605 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-102e4cb0-e170-4854-8610-5b9d1cf9364b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32daafe042704837abf20b1d949bbb30', 'request_id': 'req-102e4cb0-e170-4854-8610-5b9d1cf9364b'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:02.195996 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-102e4cb0-e170-4854-8610-5b9d1cf9364b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32daafe042704837abf20b1d949bbb30', 'request_id': 'req-102e4cb0-e170-4854-8610-5b9d1cf9364b'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:02.223366 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-102e4cb0-e170-4854-8610-5b9d1cf9364b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32daafe042704837abf20b1d949bbb30', 'request_id': 'req-102e4cb0-e170-4854-8610-5b9d1cf9364b'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:02.256551 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-102e4cb0-e170-4854-8610-5b9d1cf9364b admin admin] The token cache is being invalidate because project 32daafe042704837abf20b1d949bbb30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:55:02.257085 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-102e4cb0-e170-4854-8610-5b9d1cf9364b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:02.258781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-102e4cb0-e170-4854-8610-5b9d1cf9364b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:02.263851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1054/2132] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:55:01 2022] DELETE /identity/v3/projects/32daafe042704837abf20b1d949bbb30 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:55:02.272681 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e494-f79a-4917-8980-ca5291b23921 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:02.273262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e494-f79a-4917-8980-ca5291b23921 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:02.275906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3e494-f79a-4917-8980-ca5291b23921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:02.318505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-31b3e494-f79a-4917-8980-ca5291b23921 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:02.320679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-31b3e494-f79a-4917-8980-ca5291b23921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:02.468199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1079/2133] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:02.483949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19881f1a-97ed-47e5-890a-d30be37f7fab None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:02.484611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19881f1a-97ed-47e5-890a-d30be37f7fab None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:02.484851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19881f1a-97ed-47e5-890a-d30be37f7fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:02.547726 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-19881f1a-97ed-47e5-890a-d30be37f7fab None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:02.550286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-19881f1a-97ed-47e5-890a-d30be37f7fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:02.589080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1055/2134] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:02.595041 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3e494-f79a-4917-8980-ca5291b23921 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:02.611048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b3e494-f79a-4917-8980-ca5291b23921 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:02.627392 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c920c7e-126d-40a8-9605-1f0c949bc4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:02.628876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c920c7e-126d-40a8-9605-1f0c949bc4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:02.629161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c920c7e-126d-40a8-9605-1f0c949bc4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:02.631765 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c920c7e-126d-40a8-9605-1f0c949bc4e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:02.634068 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c920c7e-126d-40a8-9605-1f0c949bc4e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:55:02.635577 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c920c7e-126d-40a8-9605-1f0c949bc4e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:02.641629 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c920c7e-126d-40a8-9605-1f0c949bc4e1 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:02.669491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1080/2135] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:55:02.675883 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19881f1a-97ed-47e5-890a-d30be37f7fab None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:02.689690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19881f1a-97ed-47e5-890a-d30be37f7fab None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:02.696231 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27dea4f-0f24-4f25-aa66-90260635693a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:02.697073 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dea4f-0f24-4f25-aa66-90260635693a admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:02.697482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dea4f-0f24-4f25-aa66-90260635693a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:02.698014 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dea4f-0f24-4f25-aa66-90260635693a admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:02.698954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27dea4f-0f24-4f25-aa66-90260635693a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:02.701121 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27dea4f-0f24-4f25-aa66-90260635693a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:02.766019 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c920c7e-126d-40a8-9605-1f0c949bc4e1 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:02.778696 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1056/2136] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:55:02 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:55:02.785003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c920c7e-126d-40a8-9605-1f0c949bc4e1 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:02.989888 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e957891-f58a-4fc6-a8c4-90041a3115ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:02.990800 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e957891-f58a-4fc6-a8c4-90041a3115ca admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:02.995446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e957891-f58a-4fc6-a8c4-90041a3115ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:02.995648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e957891-f58a-4fc6-a8c4-90041a3115ca admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:02.996635 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e957891-f58a-4fc6-a8c4-90041a3115ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:02.998983 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e957891-f58a-4fc6-a8c4-90041a3115ca admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:03.064287 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1081/2137] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:55:02 2022] POST /identity/v3/users => generated 287 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:55:03.070149 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27dea4f-0f24-4f25-aa66-90260635693a admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:03.086964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27dea4f-0f24-4f25-aa66-90260635693a admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:03.094837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee09c6-5885-4353-9ee4-5b3a5aa72efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:03.095923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee09c6-5885-4353-9ee4-5b3a5aa72efd admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:03.096387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee09c6-5885-4353-9ee4-5b3a5aa72efd admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:03.097104 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee09c6-5885-4353-9ee4-5b3a5aa72efd admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:03.098767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee09c6-5885-4353-9ee4-5b3a5aa72efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:03.101388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee09c6-5885-4353-9ee4-5b3a5aa72efd admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:03.118080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1057/2138] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:55:03.123399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e957891-f58a-4fc6-a8c4-90041a3115ca admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:03.136404 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e957891-f58a-4fc6-a8c4-90041a3115ca admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:03.149010 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8f095-5e82-4818-822c-dcde37aee9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:03.149010 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8f095-5e82-4818-822c-dcde37aee9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:03.149010 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8f095-5e82-4818-822c-dcde37aee9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:03.149010 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8f095-5e82-4818-822c-dcde37aee9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:03.150139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8f095-5e82-4818-822c-dcde37aee9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:03.153845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8f095-5e82-4818-822c-dcde37aee9e1 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:03.168380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1082/2139] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:55:03.174743 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee09c6-5885-4353-9ee4-5b3a5aa72efd admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:03.193065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee09c6-5885-4353-9ee4-5b3a5aa72efd admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:03.200709 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20687b-5c82-49d4-9bfa-42a69f8c086c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:03.201583 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20687b-5c82-49d4-9bfa-42a69f8c086c admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:03.203172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20687b-5c82-49d4-9bfa-42a69f8c086c admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:03.203744 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20687b-5c82-49d4-9bfa-42a69f8c086c admin admin] PATH_INFO: `/v3/projects/bd78407ae9b24f31be53c5197da7dc3e/users/a3c37aa9099143bcb02e97afefbe4ad8/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:03.229861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20687b-5c82-49d4-9bfa-42a69f8c086c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd78407ae9b24f31be53c5197da7dc3e, user_id=a3c37aa9099143bcb02e97afefbe4ad8, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:03.234470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20687b-5c82-49d4-9bfa-42a69f8c086c admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:03.273391 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1058/2140] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:55:03 2022] PUT /identity/v3/projects/bd78407ae9b24f31be53c5197da7dc3e/users/a3c37aa9099143bcb02e97afefbe4ad8/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:55:03.284611 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e836581-89cf-4a5f-a0a8-066105294fcb None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:03.284909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e836581-89cf-4a5f-a0a8-066105294fcb None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:03.285276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e836581-89cf-4a5f-a0a8-066105294fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:03.334473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-5e836581-89cf-4a5f-a0a8-066105294fcb None None] MFA Rules not processed for user `a3c37aa9099143bcb02e97afefbe4ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:03.335941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5e836581-89cf-4a5f-a0a8-066105294fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:03.504589 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:03.562109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1083/2141] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:55:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:55:03.589130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20687b-5c82-49d4-9bfa-42a69f8c086c admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:03.592836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4f20687b-5c82-49d4-9bfa-42a69f8c086c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:03.758147 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e836581-89cf-4a5f-a0a8-066105294fcb None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:03.761532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5e836581-89cf-4a5f-a0a8-066105294fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:03.865770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20687b-5c82-49d4-9bfa-42a69f8c086c admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:03.872765 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c08ddc-1cd1-4c87-b748-60f326e4472b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:03.879485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c08ddc-1cd1-4c87-b748-60f326e4472b service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:03.879856 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c08ddc-1cd1-4c87-b748-60f326e4472b service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:03.880338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c08ddc-1cd1-4c87-b748-60f326e4472b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:03.894344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c08ddc-1cd1-4c87-b748-60f326e4472b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:03.896166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c08ddc-1cd1-4c87-b748-60f326e4472b service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:03.921129 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1059/2142] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:55:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:55:03.928691 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e836581-89cf-4a5f-a0a8-066105294fcb None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:03.944806 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f560805-a077-4304-8dac-43451c600e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:03.947300 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f560805-a077-4304-8dac-43451c600e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:03.947763 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f560805-a077-4304-8dac-43451c600e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:03.948049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f560805-a077-4304-8dac-43451c600e2f admin admin] PATH_INFO: `/v3/projects/903f1195ba9e4a8ebfa8390dab8e460a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:03.960500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f560805-a077-4304-8dac-43451c600e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=903f1195ba9e4a8ebfa8390dab8e460a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:03.963710 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f560805-a077-4304-8dac-43451c600e2f admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:04.035675 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4f560805-a077-4304-8dac-43451c600e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903f1195ba9e4a8ebfa8390dab8e460a', 'request_id': 'req-4f560805-a077-4304-8dac-43451c600e2f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:04.053378 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4f560805-a077-4304-8dac-43451c600e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903f1195ba9e4a8ebfa8390dab8e460a', 'request_id': 'req-4f560805-a077-4304-8dac-43451c600e2f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:04.080477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4f560805-a077-4304-8dac-43451c600e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903f1195ba9e4a8ebfa8390dab8e460a', 'request_id': 'req-4f560805-a077-4304-8dac-43451c600e2f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:04.108355 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4f560805-a077-4304-8dac-43451c600e2f admin admin] The token cache is being invalidate because project 903f1195ba9e4a8ebfa8390dab8e460a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:55:04.108726 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4f560805-a077-4304-8dac-43451c600e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:04.110101 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4f560805-a077-4304-8dac-43451c600e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:04.112972 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1084/2143] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:55:03 2022] DELETE /identity/v3/projects/903f1195ba9e4a8ebfa8390dab8e460a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:55:04.118343 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0631a09-918a-4620-a8ec-33eaac627931 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:04.118878 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0631a09-918a-4620-a8ec-33eaac627931 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:04.119400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0631a09-918a-4620-a8ec-33eaac627931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:04.152789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-a0631a09-918a-4620-a8ec-33eaac627931 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:04.155210 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a0631a09-918a-4620-a8ec-33eaac627931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:04.257094 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1060/2144] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:55:04.272874 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b1668-9e17-4a20-8a63-72435451f46e None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:04.273203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b1668-9e17-4a20-8a63-72435451f46e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:04.276087 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b1668-9e17-4a20-8a63-72435451f46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:04.331803 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-397b1668-9e17-4a20-8a63-72435451f46e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:04.334002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-397b1668-9e17-4a20-8a63-72435451f46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:04.383469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1085/2145] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:04.386788 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0631a09-918a-4620-a8ec-33eaac627931 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:04.412709 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0631a09-918a-4620-a8ec-33eaac627931 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:04.450339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c32bbf-4d72-4c3d-8965-133eb7a81027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:04.451018 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c32bbf-4d72-4c3d-8965-133eb7a81027 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:04.451307 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c32bbf-4d72-4c3d-8965-133eb7a81027 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:04.451580 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c32bbf-4d72-4c3d-8965-133eb7a81027 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:04.453982 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c32bbf-4d72-4c3d-8965-133eb7a81027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:55:04.454354 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c32bbf-4d72-4c3d-8965-133eb7a81027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:04.456071 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c32bbf-4d72-4c3d-8965-133eb7a81027 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:04.489949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:04.505305 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1061/2146] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:55:04.505977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b1668-9e17-4a20-8a63-72435451f46e None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:04.530410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b1668-9e17-4a20-8a63-72435451f46e None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:04.543681 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff71fcb-7252-4156-8bd6-a9d69cdc5235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:04.545191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff71fcb-7252-4156-8bd6-a9d69cdc5235 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:04.545771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff71fcb-7252-4156-8bd6-a9d69cdc5235 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:04.546142 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff71fcb-7252-4156-8bd6-a9d69cdc5235 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:04.547146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff71fcb-7252-4156-8bd6-a9d69cdc5235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:04.558340 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff71fcb-7252-4156-8bd6-a9d69cdc5235 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:04.668620 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1086/2147] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:55:04 2022] POST /identity/v3/projects => generated 397 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:55:04.673021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c32bbf-4d72-4c3d-8965-133eb7a81027 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:04.704433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c32bbf-4d72-4c3d-8965-133eb7a81027 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:04.839357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0b8a4-7309-4be2-8787-5aca39f6f32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:04.839889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0b8a4-7309-4be2-8787-5aca39f6f32f admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:04.840255 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0b8a4-7309-4be2-8787-5aca39f6f32f admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:04.840519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0b8a4-7309-4be2-8787-5aca39f6f32f admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:04.841195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0b8a4-7309-4be2-8787-5aca39f6f32f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:04.845589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0b8a4-7309-4be2-8787-5aca39f6f32f admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:04.885560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1062/2148] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:55:04 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:55:04.889873 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff71fcb-7252-4156-8bd6-a9d69cdc5235 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:04.906246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff71fcb-7252-4156-8bd6-a9d69cdc5235 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:04.913190 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359671c-41e3-411e-a063-392d8d764125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:04.914524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359671c-41e3-411e-a063-392d8d764125 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:04.914524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359671c-41e3-411e-a063-392d8d764125 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:04.914941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359671c-41e3-411e-a063-392d8d764125 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:04.916028 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359671c-41e3-411e-a063-392d8d764125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:04.917932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359671c-41e3-411e-a063-392d8d764125 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:04.937438 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1087/2149] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:55:04.941452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0b8a4-7309-4be2-8787-5aca39f6f32f admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:04.969158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0b8a4-7309-4be2-8787-5aca39f6f32f admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:05.019099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8b9bb-0c02-45a0-b926-5d486c4e0879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:05.019099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8b9bb-0c02-45a0-b926-5d486c4e0879 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:05.019099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8b9bb-0c02-45a0-b926-5d486c4e0879 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:05.019099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8b9bb-0c02-45a0-b926-5d486c4e0879 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:05.023147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8b9bb-0c02-45a0-b926-5d486c4e0879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:05.023147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8b9bb-0c02-45a0-b926-5d486c4e0879 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:05.073369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1063/2150] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:55:05.081014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359671c-41e3-411e-a063-392d8d764125 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:05.104782 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359671c-41e3-411e-a063-392d8d764125 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:05.141187 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b597d80-7888-4627-854c-b39b143b7901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:05.142100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b597d80-7888-4627-854c-b39b143b7901 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:05.144525 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b597d80-7888-4627-854c-b39b143b7901 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:05.155546 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b597d80-7888-4627-854c-b39b143b7901 admin admin] PATH_INFO: `/v3/projects/e868615ce6e34558b4c5291c9802b9ca/users/a2ec9dc7af2c449da42d85e0b3837dfc/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:05.245334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b597d80-7888-4627-854c-b39b143b7901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e868615ce6e34558b4c5291c9802b9ca, user_id=a2ec9dc7af2c449da42d85e0b3837dfc, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:05.250985 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b597d80-7888-4627-854c-b39b143b7901 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:05.271738 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1088/2151] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:55:05 2022] PUT /identity/v3/projects/e868615ce6e34558b4c5291c9802b9ca/users/a2ec9dc7af2c449da42d85e0b3837dfc/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:55:05.290542 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f2c09-2e95-4dd8-b500-3d3f540a388f None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:05.291018 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f2c09-2e95-4dd8-b500-3d3f540a388f None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:05.291376 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f2c09-2e95-4dd8-b500-3d3f540a388f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:05.368576 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-d38f2c09-2e95-4dd8-b500-3d3f540a388f None None] MFA Rules not processed for user `a2ec9dc7af2c449da42d85e0b3837dfc`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:05.385820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-d38f2c09-2e95-4dd8-b500-3d3f540a388f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:05.732137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1064/2152] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:55:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:05.852698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b597d80-7888-4627-854c-b39b143b7901 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:05.859945 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1b597d80-7888-4627-854c-b39b143b7901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:05.890616 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:06.015169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b597d80-7888-4627-854c-b39b143b7901 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:06.026476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9f8d8-85b3-4a77-a44c-62b1b2e20062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:06.027901 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9f8d8-85b3-4a77-a44c-62b1b2e20062 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:06.028606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9f8d8-85b3-4a77-a44c-62b1b2e20062 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:06.029385 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9f8d8-85b3-4a77-a44c-62b1b2e20062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:06.048543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9f8d8-85b3-4a77-a44c-62b1b2e20062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:06.052550 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9f8d8-85b3-4a77-a44c-62b1b2e20062 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:06.076944 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1089/2153] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:55:05 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:55:08.419250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba0c36-85a3-4fa6-a0c1-498453143c62 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:08.420382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba0c36-85a3-4fa6-a0c1-498453143c62 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:08.421152 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba0c36-85a3-4fa6-a0c1-498453143c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:08.457021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-b7ba0c36-85a3-4fa6-a0c1-498453143c62 None None] MFA Rules not processed for user `e1f49820de264982aeec97fa0be3c290`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:08.459594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-b7ba0c36-85a3-4fa6-a0c1-498453143c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:08.564281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1065/2154] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 23:55:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:08.623303 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9f8d8-85b3-4a77-a44c-62b1b2e20062 service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:08.625028 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9cb9f8d8-85b3-4a77-a44c-62b1b2e20062 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:08.801716 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9f8d8-85b3-4a77-a44c-62b1b2e20062 service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:08.812752 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816793c3-0ce0-48ad-888e-0fd67b4146fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c45ae3144b4fe8ab4e921fda30164a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:08.814104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816793c3-0ce0-48ad-888e-0fd67b4146fc service swift] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:08.814814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816793c3-0ce0-48ad-888e-0fd67b4146fc service swift] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:08.815495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816793c3-0ce0-48ad-888e-0fd67b4146fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:08.834722 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816793c3-0ce0-48ad-888e-0fd67b4146fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:08.837439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816793c3-0ce0-48ad-888e-0fd67b4146fc service swift] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:08.851253 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1090/2155] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 23:55:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:55:12.997392 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba0c36-85a3-4fa6-a0c1-498453143c62 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:13.035165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:13.208790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba0c36-85a3-4fa6-a0c1-498453143c62 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:13.218621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0630a-fd45-4110-b2e7-15728c0317a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:13.220296 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0630a-fd45-4110-b2e7-15728c0317a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:13.221072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0630a-fd45-4110-b2e7-15728c0317a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:13.221925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0630a-fd45-4110-b2e7-15728c0317a1 admin admin] PATH_INFO: `/v3/users/a2ec9dc7af2c449da42d85e0b3837dfc` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:13.224546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0630a-fd45-4110-b2e7-15728c0317a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ec9dc7af2c449da42d85e0b3837dfc)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:13.229522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0630a-fd45-4110-b2e7-15728c0317a1 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:13.380554 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-bee0630a-fd45-4110-b2e7-15728c0317a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ec9dc7af2c449da42d85e0b3837dfc'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:13.382210 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-bee0630a-fd45-4110-b2e7-15728c0317a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ec9dc7af2c449da42d85e0b3837dfc'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:13.384403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-bee0630a-fd45-4110-b2e7-15728c0317a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ec9dc7af2c449da42d85e0b3837dfc'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:13.436733 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-bee0630a-fd45-4110-b2e7-15728c0317a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ec9dc7af2c449da42d85e0b3837dfc'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:13.484239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-bee0630a-fd45-4110-b2e7-15728c0317a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ec9dc7af2c449da42d85e0b3837dfc'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:13.540279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1066/2156] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:55:12 2022] DELETE /identity/v3/users/a2ec9dc7af2c449da42d85e0b3837dfc => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:55:13.543420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e179aa-f82e-4bb7-8790-627558df3fd4 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:13.544943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e179aa-f82e-4bb7-8790-627558df3fd4 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:13.545762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e179aa-f82e-4bb7-8790-627558df3fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:13.738789 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-89e179aa-f82e-4bb7-8790-627558df3fd4 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:13.752254 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-89e179aa-f82e-4bb7-8790-627558df3fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:14.029262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1091/2157] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:14.079496 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0630a-fd45-4110-b2e7-15728c0317a1 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:14.090277 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-bee0630a-fd45-4110-b2e7-15728c0317a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:14.290651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0630a-fd45-4110-b2e7-15728c0317a1 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:14.297958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e00997-e46e-4f46-93ba-25435e7ad174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:14.299611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e00997-e46e-4f46-93ba-25435e7ad174 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:14.300126 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e00997-e46e-4f46-93ba-25435e7ad174 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:14.300620 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e00997-e46e-4f46-93ba-25435e7ad174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:14.319383 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e00997-e46e-4f46-93ba-25435e7ad174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:14.322395 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e00997-e46e-4f46-93ba-25435e7ad174 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:14.359557 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1067/2158] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:55:15.591357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e179aa-f82e-4bb7-8790-627558df3fd4 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:15.601731 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-89e179aa-f82e-4bb7-8790-627558df3fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:15.684217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e179aa-f82e-4bb7-8790-627558df3fd4 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:15.701278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112e5a7-3020-47b1-96a4-ab72ab9a47f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:15.711400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112e5a7-3020-47b1-96a4-ab72ab9a47f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:15.711645 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112e5a7-3020-47b1-96a4-ab72ab9a47f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:15.721930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112e5a7-3020-47b1-96a4-ab72ab9a47f8 admin admin] PATH_INFO: `/v3/projects/e868615ce6e34558b4c5291c9802b9ca` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:15.723391 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112e5a7-3020-47b1-96a4-ab72ab9a47f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e868615ce6e34558b4c5291c9802b9ca)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:15.725482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112e5a7-3020-47b1-96a4-ab72ab9a47f8 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:15.824931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:15.870229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-6112e5a7-3020-47b1-96a4-ab72ab9a47f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e868615ce6e34558b4c5291c9802b9ca', 'request_id': 'req-6112e5a7-3020-47b1-96a4-ab72ab9a47f8'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:15.920510 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-6112e5a7-3020-47b1-96a4-ab72ab9a47f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e868615ce6e34558b4c5291c9802b9ca', 'request_id': 'req-6112e5a7-3020-47b1-96a4-ab72ab9a47f8'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:15.952675 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-6112e5a7-3020-47b1-96a4-ab72ab9a47f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e868615ce6e34558b4c5291c9802b9ca', 'request_id': 'req-6112e5a7-3020-47b1-96a4-ab72ab9a47f8'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:16.030332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-6112e5a7-3020-47b1-96a4-ab72ab9a47f8 admin admin] The token cache is being invalidate because project e868615ce6e34558b4c5291c9802b9ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:55:16.030739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-6112e5a7-3020-47b1-96a4-ab72ab9a47f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:16.031686 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-6112e5a7-3020-47b1-96a4-ab72ab9a47f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:16.037787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1092/2159] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:55:15 2022] DELETE /identity/v3/projects/e868615ce6e34558b4c5291c9802b9ca => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:55:20.319630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e00997-e46e-4f46-93ba-25435e7ad174 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:20.322057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f7e00997-e46e-4f46-93ba-25435e7ad174 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:20.349512 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e00997-e46e-4f46-93ba-25435e7ad174 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:20.444743 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:20.547332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cfb17-7ea4-4ac4-ad3d-4af5567fca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:20.548128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cfb17-7ea4-4ac4-ad3d-4af5567fca39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:20.548412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cfb17-7ea4-4ac4-ad3d-4af5567fca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:20.549053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cfb17-7ea4-4ac4-ad3d-4af5567fca39 admin admin] PATH_INFO: `/v3/users/a3c37aa9099143bcb02e97afefbe4ad8` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:20.551001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cfb17-7ea4-4ac4-ad3d-4af5567fca39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c37aa9099143bcb02e97afefbe4ad8)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:20.553762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cfb17-7ea4-4ac4-ad3d-4af5567fca39 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:20.655003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0c9cfb17-7ea4-4ac4-ad3d-4af5567fca39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c37aa9099143bcb02e97afefbe4ad8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:20.655003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0c9cfb17-7ea4-4ac4-ad3d-4af5567fca39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c37aa9099143bcb02e97afefbe4ad8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:20.655003 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0c9cfb17-7ea4-4ac4-ad3d-4af5567fca39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c37aa9099143bcb02e97afefbe4ad8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:20.689021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0c9cfb17-7ea4-4ac4-ad3d-4af5567fca39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c37aa9099143bcb02e97afefbe4ad8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:20.718183 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0c9cfb17-7ea4-4ac4-ad3d-4af5567fca39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c37aa9099143bcb02e97afefbe4ad8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:20.750625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1068/2160] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:55:20 2022] DELETE /identity/v3/users/a3c37aa9099143bcb02e97afefbe4ad8 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:55:20.755263 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963eb30-bdce-4070-bc5a-04cc12589e58 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:20.755876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963eb30-bdce-4070-bc5a-04cc12589e58 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:20.756300 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963eb30-bdce-4070-bc5a-04cc12589e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:20.815591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-5963eb30-bdce-4070-bc5a-04cc12589e58 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:20.818200 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5963eb30-bdce-4070-bc5a-04cc12589e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:20.981634 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1093/2161] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:20.996743 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cfb17-7ea4-4ac4-ad3d-4af5567fca39 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:21.003149 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0c9cfb17-7ea4-4ac4-ad3d-4af5567fca39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:21.118180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cfb17-7ea4-4ac4-ad3d-4af5567fca39 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:21.122363 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a88f2d-a93d-4429-bb56-92d063eab6d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:21.122925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88f2d-a93d-4429-bb56-92d063eab6d0 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:21.123204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88f2d-a93d-4429-bb56-92d063eab6d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:21.123475 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a88f2d-a93d-4429-bb56-92d063eab6d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:21.134016 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a88f2d-a93d-4429-bb56-92d063eab6d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:21.135527 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a88f2d-a93d-4429-bb56-92d063eab6d0 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:21.167972 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1069/2162] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:55:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:55:22.639971 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963eb30-bdce-4070-bc5a-04cc12589e58 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:22.643797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5963eb30-bdce-4070-bc5a-04cc12589e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:22.720982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963eb30-bdce-4070-bc5a-04cc12589e58 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:22.729215 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db9e14-9565-4989-8bff-126289ee8b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:22.730414 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db9e14-9565-4989-8bff-126289ee8b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:22.730884 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db9e14-9565-4989-8bff-126289ee8b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:22.731346 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db9e14-9565-4989-8bff-126289ee8b5d admin admin] PATH_INFO: `/v3/projects/bd78407ae9b24f31be53c5197da7dc3e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:22.735432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db9e14-9565-4989-8bff-126289ee8b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd78407ae9b24f31be53c5197da7dc3e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:22.740172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db9e14-9565-4989-8bff-126289ee8b5d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:22.951998 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d9db9e14-9565-4989-8bff-126289ee8b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd78407ae9b24f31be53c5197da7dc3e', 'request_id': 'req-d9db9e14-9565-4989-8bff-126289ee8b5d'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:22.983680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d9db9e14-9565-4989-8bff-126289ee8b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd78407ae9b24f31be53c5197da7dc3e', 'request_id': 'req-d9db9e14-9565-4989-8bff-126289ee8b5d'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:23.039256 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d9db9e14-9565-4989-8bff-126289ee8b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd78407ae9b24f31be53c5197da7dc3e', 'request_id': 'req-d9db9e14-9565-4989-8bff-126289ee8b5d'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:23.091608 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d9db9e14-9565-4989-8bff-126289ee8b5d admin admin] The token cache is being invalidate because project bd78407ae9b24f31be53c5197da7dc3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:55:23.092431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d9db9e14-9565-4989-8bff-126289ee8b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:23.093536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d9db9e14-9565-4989-8bff-126289ee8b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:23.095937 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1094/2163] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:55:22 2022] DELETE /identity/v3/projects/bd78407ae9b24f31be53c5197da7dc3e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:55:26.841249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0332fd1-5115-4bbb-a4f2-daa009543831 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:26.842595 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0332fd1-5115-4bbb-a4f2-daa009543831 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:26.842595 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0332fd1-5115-4bbb-a4f2-daa009543831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:26.893314 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-d0332fd1-5115-4bbb-a4f2-daa009543831 None None] MFA Rules not processed for user `e1f49820de264982aeec97fa0be3c290`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:26.894550 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-d0332fd1-5115-4bbb-a4f2-daa009543831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:27.006505 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:27.023766 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1070/2164] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 23:55:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:27.050749 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db9e14-9565-4989-8bff-126289ee8b5d admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:27.053578 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d9db9e14-9565-4989-8bff-126289ee8b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:27.131759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:27.165960 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db9e14-9565-4989-8bff-126289ee8b5d admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:27.172569 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d435492-d559-4a23-a196-b3c4f0b00ba2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c45ae3144b4fe8ab4e921fda30164a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:27.173607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d435492-d559-4a23-a196-b3c4f0b00ba2 service swift] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:27.174249 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d435492-d559-4a23-a196-b3c4f0b00ba2 service swift] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:27.174521 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d435492-d559-4a23-a196-b3c4f0b00ba2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:27.187502 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d435492-d559-4a23-a196-b3c4f0b00ba2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:27.190661 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d435492-d559-4a23-a196-b3c4f0b00ba2 service swift] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:27.217371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1095/2165] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 23:55:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:55:27.266159 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95c6bb-d92e-4914-a82a-0a99ded4a235 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:27.266534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95c6bb-d92e-4914-a82a-0a99ded4a235 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:27.266873 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95c6bb-d92e-4914-a82a-0a99ded4a235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:27.332295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-cf95c6bb-d92e-4914-a82a-0a99ded4a235 None None] MFA Rules not processed for user `4e71cfb3bd8646798cd5ab0d1a7445d7`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:27.335081 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-cf95c6bb-d92e-4914-a82a-0a99ded4a235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:27.456927 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1071/2166] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:55:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:37.201828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=11 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:37.446100 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=25 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:39.918681 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d128f-cc8d-4c77-95e0-d768889e5093 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:39.919524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d128f-cc8d-4c77-95e0-d768889e5093 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:39.919524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d128f-cc8d-4c77-95e0-d768889e5093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:39.957113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-073d128f-cc8d-4c77-95e0-d768889e5093 None None] MFA Rules not processed for user `e1f49820de264982aeec97fa0be3c290`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:39.960853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-073d128f-cc8d-4c77-95e0-d768889e5093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:39.977392 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1096/2167] 10.222.0.23 () {58 vars in 967 bytes} [Mon Sep 12 23:55:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:39.992779 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95c6bb-d92e-4914-a82a-0a99ded4a235 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:40.007743 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95c6bb-d92e-4914-a82a-0a99ded4a235 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:40.014033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bb06e-be96-4218-965b-6b9c23cc49d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c45ae3144b4fe8ab4e921fda30164a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:40.014979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bb06e-be96-4218-965b-6b9c23cc49d4 service swift] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:40.018300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bb06e-be96-4218-965b-6b9c23cc49d4 service swift] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:40.018925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bb06e-be96-4218-965b-6b9c23cc49d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:40.030779 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bb06e-be96-4218-965b-6b9c23cc49d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:40.033225 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5bb06e-be96-4218-965b-6b9c23cc49d4 service swift] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:40.046319 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1072/2168] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 23:55:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 12 23:55:42.970827 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d128f-cc8d-4c77-95e0-d768889e5093 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:42.973231 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-073d128f-cc8d-4c77-95e0-d768889e5093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:43.075143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d128f-cc8d-4c77-95e0-d768889e5093 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:43.080704 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365935ea-6938-4589-a7fe-9265d85c67b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:43.081573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365935ea-6938-4589-a7fe-9265d85c67b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:43.081884 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365935ea-6938-4589-a7fe-9265d85c67b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:43.082161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365935ea-6938-4589-a7fe-9265d85c67b9 admin admin] PATH_INFO: `/v3/users/458bd8b638f249cb9615711408879307` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:43.083490 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365935ea-6938-4589-a7fe-9265d85c67b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=458bd8b638f249cb9615711408879307)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:43.085610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365935ea-6938-4589-a7fe-9265d85c67b9 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:43.151092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-365935ea-6938-4589-a7fe-9265d85c67b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '458bd8b638f249cb9615711408879307'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:43.172694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-365935ea-6938-4589-a7fe-9265d85c67b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '458bd8b638f249cb9615711408879307'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:43.188703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-365935ea-6938-4589-a7fe-9265d85c67b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '458bd8b638f249cb9615711408879307'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:43.199758 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-365935ea-6938-4589-a7fe-9265d85c67b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '458bd8b638f249cb9615711408879307'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:43.200407 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-365935ea-6938-4589-a7fe-9265d85c67b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '458bd8b638f249cb9615711408879307'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:43.209073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1097/2169] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:55:42 2022] DELETE /identity/v3/users/458bd8b638f249cb9615711408879307 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:55:43.451544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bb06e-be96-4218-965b-6b9c23cc49d4 service swift] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:43.471214 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bb06e-be96-4218-965b-6b9c23cc49d4 service swift] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:43.581729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac650cd6-1358-4cf8-bfad-fb417bd41471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:43.582501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac650cd6-1358-4cf8-bfad-fb417bd41471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:43.582855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac650cd6-1358-4cf8-bfad-fb417bd41471 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:43.583196 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac650cd6-1358-4cf8-bfad-fb417bd41471 admin admin] PATH_INFO: `/v3/projects/a9f46535fb8a4a0f871ccc7f032eb7fc` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:43.584505 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac650cd6-1358-4cf8-bfad-fb417bd41471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9f46535fb8a4a0f871ccc7f032eb7fc)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:43.586746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac650cd6-1358-4cf8-bfad-fb417bd41471 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:43.657568 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ac650cd6-1358-4cf8-bfad-fb417bd41471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9f46535fb8a4a0f871ccc7f032eb7fc', 'request_id': 'req-ac650cd6-1358-4cf8-bfad-fb417bd41471'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:43.669047 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ac650cd6-1358-4cf8-bfad-fb417bd41471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9f46535fb8a4a0f871ccc7f032eb7fc', 'request_id': 'req-ac650cd6-1358-4cf8-bfad-fb417bd41471'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:43.680886 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ac650cd6-1358-4cf8-bfad-fb417bd41471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9f46535fb8a4a0f871ccc7f032eb7fc', 'request_id': 'req-ac650cd6-1358-4cf8-bfad-fb417bd41471'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:43.704418 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ac650cd6-1358-4cf8-bfad-fb417bd41471 admin admin] The token cache is being invalidate because project a9f46535fb8a4a0f871ccc7f032eb7fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:55:43.705035 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ac650cd6-1358-4cf8-bfad-fb417bd41471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:43.706481 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ac650cd6-1358-4cf8-bfad-fb417bd41471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:55:43.713181 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1073/2170] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:55:43 2022] DELETE /identity/v3/projects/a9f46535fb8a4a0f871ccc7f032eb7fc => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:55:43.715944 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd73d9-6571-4fb5-b2bd-00c7499a9a6c None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:43.716351 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd73d9-6571-4fb5-b2bd-00c7499a9a6c None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:43.716819 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd73d9-6571-4fb5-b2bd-00c7499a9a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:43.743792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-c9bd73d9-6571-4fb5-b2bd-00c7499a9a6c None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:43.745495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c9bd73d9-6571-4fb5-b2bd-00c7499a9a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:43.834801 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1098/2171] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:43.844662 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e4e03-bb71-4dfb-a19c-04357dcef70d None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:43.845001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e4e03-bb71-4dfb-a19c-04357dcef70d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:43.845308 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e4e03-bb71-4dfb-a19c-04357dcef70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:43.868231 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-a79e4e03-bb71-4dfb-a19c-04357dcef70d None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:43.869516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a79e4e03-bb71-4dfb-a19c-04357dcef70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:43.878756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1074/2172] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:43.883176 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd73d9-6571-4fb5-b2bd-00c7499a9a6c None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:43.896054 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd73d9-6571-4fb5-b2bd-00c7499a9a6c None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:43.901630 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3164520-fb98-415a-bd60-ce82dd3ff103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:43.902291 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3164520-fb98-415a-bd60-ce82dd3ff103 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:43.902579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3164520-fb98-415a-bd60-ce82dd3ff103 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:43.902845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3164520-fb98-415a-bd60-ce82dd3ff103 admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:43.903530 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3164520-fb98-415a-bd60-ce82dd3ff103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:55:43.903845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3164520-fb98-415a-bd60-ce82dd3ff103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:43.905560 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3164520-fb98-415a-bd60-ce82dd3ff103 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:43.916212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:43.920394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1099/2173] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:55:43.927248 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e4e03-bb71-4dfb-a19c-04357dcef70d None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:43.938202 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e4e03-bb71-4dfb-a19c-04357dcef70d None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:43.943629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cb543-a227-40bd-84c6-7b5c49f057bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:43.944295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cb543-a227-40bd-84c6-7b5c49f057bf admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:43.944714 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cb543-a227-40bd-84c6-7b5c49f057bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:43.945061 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cb543-a227-40bd-84c6-7b5c49f057bf admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:43.946222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cb543-a227-40bd-84c6-7b5c49f057bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:43.948636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cb543-a227-40bd-84c6-7b5c49f057bf admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:43.984362 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1075/2174] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:55:43 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:55:43.989673 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3164520-fb98-415a-bd60-ce82dd3ff103 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:44.001515 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3164520-fb98-415a-bd60-ce82dd3ff103 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:44.078453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6f53c-9347-454f-a9ba-de2443b68f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:44.081041 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6f53c-9347-454f-a9ba-de2443b68f8c admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:44.081041 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6f53c-9347-454f-a9ba-de2443b68f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:44.081041 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6f53c-9347-454f-a9ba-de2443b68f8c admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:44.081041 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6f53c-9347-454f-a9ba-de2443b68f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:44.082902 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6f53c-9347-454f-a9ba-de2443b68f8c admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:44.123203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1100/2175] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:55:43 2022] POST /identity/v3/users => generated 285 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:55:44.128280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cb543-a227-40bd-84c6-7b5c49f057bf admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:44.146324 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cb543-a227-40bd-84c6-7b5c49f057bf admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:44.155543 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2942-6b39-469f-a023-1a02d5945618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:44.157087 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2942-6b39-469f-a023-1a02d5945618 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:44.157774 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2942-6b39-469f-a023-1a02d5945618 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:44.158216 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2942-6b39-469f-a023-1a02d5945618 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:44.159463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a2942-6b39-469f-a023-1a02d5945618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:44.162552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a2942-6b39-469f-a023-1a02d5945618 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:44.181802 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1076/2176] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:55:44.186235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6f53c-9347-454f-a9ba-de2443b68f8c admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:44.197761 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6f53c-9347-454f-a9ba-de2443b68f8c admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:44.203123 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70be10-a6d5-44cb-9c00-8986186a352a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:44.203892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70be10-a6d5-44cb-9c00-8986186a352a admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:44.204266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70be10-a6d5-44cb-9c00-8986186a352a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:44.204634 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70be10-a6d5-44cb-9c00-8986186a352a admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:44.205468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70be10-a6d5-44cb-9c00-8986186a352a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:44.207224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70be10-a6d5-44cb-9c00-8986186a352a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:44.220698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1101/2177] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:55:44.225369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2942-6b39-469f-a023-1a02d5945618 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:44.236943 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2942-6b39-469f-a023-1a02d5945618 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:44.242819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fd6c5-00ce-45be-aead-102e4bbeefb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:44.243510 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd6c5-00ce-45be-aead-102e4bbeefb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:44.243870 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd6c5-00ce-45be-aead-102e4bbeefb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:44.244141 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd6c5-00ce-45be-aead-102e4bbeefb0 admin admin] PATH_INFO: `/v3/projects/3f4b9177f8ad449f8355a01662d543aa/users/fadfcb954591462eb9493b681f99f273/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:44.263558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fd6c5-00ce-45be-aead-102e4bbeefb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4b9177f8ad449f8355a01662d543aa, user_id=fadfcb954591462eb9493b681f99f273, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:44.266353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fd6c5-00ce-45be-aead-102e4bbeefb0 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:44.283060 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1077/2178] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:55:44 2022] PUT /identity/v3/projects/3f4b9177f8ad449f8355a01662d543aa/users/fadfcb954591462eb9493b681f99f273/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:55:44.294672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac966d-2f46-42b2-a54a-e527e10c0c89 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:44.295021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac966d-2f46-42b2-a54a-e527e10c0c89 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:44.295331 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac966d-2f46-42b2-a54a-e527e10c0c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:44.330028 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-dcac966d-2f46-42b2-a54a-e527e10c0c89 None None] MFA Rules not processed for user `fadfcb954591462eb9493b681f99f273`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:44.332055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-dcac966d-2f46-42b2-a54a-e527e10c0c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:44.455725 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1102/2179] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:55:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:55:44.480201 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fd6c5-00ce-45be-aead-102e4bbeefb0 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:44.482667 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-032fd6c5-00ce-45be-aead-102e4bbeefb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:44.509896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:44.654462 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fd6c5-00ce-45be-aead-102e4bbeefb0 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:44.659025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98cf74-c7be-40aa-9ef6-9ffa3c9047cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21a0c72223417d92e3d8b30ef6bc3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:44.659673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98cf74-c7be-40aa-9ef6-9ffa3c9047cd service glance] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:44.660006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98cf74-c7be-40aa-9ef6-9ffa3c9047cd service glance] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:44.660203 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98cf74-c7be-40aa-9ef6-9ffa3c9047cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:44.687968 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98cf74-c7be-40aa-9ef6-9ffa3c9047cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:44.689655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98cf74-c7be-40aa-9ef6-9ffa3c9047cd service glance] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:44.704257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1078/2180] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:55:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:55:46.423857 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548a53c-c052-42b1-b538-186b2ab717fc None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:46.424460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548a53c-c052-42b1-b538-186b2ab717fc None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:46.424810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548a53c-c052-42b1-b538-186b2ab717fc None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:46.427381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1103/2181] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 23:55:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:55:46.434928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6cfac-f306-4833-8e71-c2e11639b7fa None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:46.435548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6cfac-f306-4833-8e71-c2e11639b7fa None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:46.435816 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6cfac-f306-4833-8e71-c2e11639b7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:46.473106 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-4fe6cfac-f306-4833-8e71-c2e11639b7fa None None] MFA Rules not processed for user `4a87e18c89ff419f8e428e376d33462c`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:46.474697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4fe6cfac-f306-4833-8e71-c2e11639b7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:46.603302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1079/2182] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 23:55:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:46.643884 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548a53c-c052-42b1-b538-186b2ab717fc None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:46.675181 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548a53c-c052-42b1-b538-186b2ab717fc None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:46.682090 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ae530-8d16-4095-8ef7-e4bcfba249eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21a0c72223417d92e3d8b30ef6bc3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:46.683632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ae530-8d16-4095-8ef7-e4bcfba249eb service glance] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:46.685272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ae530-8d16-4095-8ef7-e4bcfba249eb service glance] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:46.685901 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ae530-8d16-4095-8ef7-e4bcfba249eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:46.707560 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ae530-8d16-4095-8ef7-e4bcfba249eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:46.710614 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ae530-8d16-4095-8ef7-e4bcfba249eb service glance] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:46.745915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1104/2183] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:55:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:55:46.878602 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9964acd-4c92-4d09-a5ee-9e7d63e37373 None None] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:46.879018 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9964acd-4c92-4d09-a5ee-9e7d63e37373 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:46.879431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9964acd-4c92-4d09-a5ee-9e7d63e37373 None None] PATH_INFO: `/` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:46.881025 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1080/2184] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 23:55:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:55:46.888245 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ce1db-f00f-497b-878c-3acb82ba38ad None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:46.888533 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ce1db-f00f-497b-878c-3acb82ba38ad None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:46.888933 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ce1db-f00f-497b-878c-3acb82ba38ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:46.922991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-513ce1db-f00f-497b-878c-3acb82ba38ad None None] MFA Rules not processed for user `a5814ac53752455697e050944b6d32b7`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:46.925432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-513ce1db-f00f-497b-878c-3acb82ba38ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:47.030178 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1105/2185] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 23:55:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:55:47.049010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9964acd-4c92-4d09-a5ee-9e7d63e37373 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:47.052225 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-d9964acd-4c92-4d09-a5ee-9e7d63e37373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:47.074335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9964acd-4c92-4d09-a5ee-9e7d63e37373 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:47.078811 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec9bad-a8ea-4d9c-b151-3f82b4e6f1c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:47.079448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec9bad-a8ea-4d9c-b151-3f82b4e6f1c8 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:47.079738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec9bad-a8ea-4d9c-b151-3f82b4e6f1c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:47.080683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec9bad-a8ea-4d9c-b151-3f82b4e6f1c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:47.095802 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec9bad-a8ea-4d9c-b151-3f82b4e6f1c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:47.100038 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec9bad-a8ea-4d9c-b151-3f82b4e6f1c8 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:47.112310 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1081/2186] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:55:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:55:47.242310 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6751b0-2581-452b-85e6-e1b95cdf81fe None None] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:47.242994 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6751b0-2581-452b-85e6-e1b95cdf81fe None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:47.243604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6751b0-2581-452b-85e6-e1b95cdf81fe None None] PATH_INFO: `/` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:47.246397 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1106/2187] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 12 23:55:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 12 23:55:47.253782 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e1a02-23d2-46ef-8257-8de3466e7f20 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:47.254500 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e1a02-23d2-46ef-8257-8de3466e7f20 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:47.255091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e1a02-23d2-46ef-8257-8de3466e7f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:47.296618 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-0e9e1a02-23d2-46ef-8257-8de3466e7f20 None None] MFA Rules not processed for user `4a87e18c89ff419f8e428e376d33462c`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:47.297242 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0e9e1a02-23d2-46ef-8257-8de3466e7f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:47.316478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1082/2188] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 12 23:55:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:47.338412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6751b0-2581-452b-85e6-e1b95cdf81fe None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:47.345866 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:47.356589 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6751b0-2581-452b-85e6-e1b95cdf81fe None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:47.362444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046e5a3-c18f-4564-bcd0-347557a24eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:47.363555 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046e5a3-c18f-4564-bcd0-347557a24eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:47.363928 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046e5a3-c18f-4564-bcd0-347557a24eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:47.364276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046e5a3-c18f-4564-bcd0-347557a24eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:47.377747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046e5a3-c18f-4564-bcd0-347557a24eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:47.380913 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046e5a3-c18f-4564-bcd0-347557a24eb5 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:47.399555 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1107/2189] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:55:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:55:48.102413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae225a98-bcbb-4371-965c-e1ad100908dd None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:48.102998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae225a98-bcbb-4371-965c-e1ad100908dd None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:48.103282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae225a98-bcbb-4371-965c-e1ad100908dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:48.134027 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-ae225a98-bcbb-4371-965c-e1ad100908dd None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:48.135271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ae225a98-bcbb-4371-965c-e1ad100908dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:48.219719 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1083/2190] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 12 23:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:48.243013 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046e5a3-c18f-4564-bcd0-347557a24eb5 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:48.245137 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b046e5a3-c18f-4564-bcd0-347557a24eb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:48.267962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046e5a3-c18f-4564-bcd0-347557a24eb5 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:48.279669 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab809f6d-b4b7-43f4-ae12-43e98a12dd45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:48.280463 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab809f6d-b4b7-43f4-ae12-43e98a12dd45 service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:48.280835 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab809f6d-b4b7-43f4-ae12-43e98a12dd45 service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:48.281195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab809f6d-b4b7-43f4-ae12-43e98a12dd45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:48.292765 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab809f6d-b4b7-43f4-ae12-43e98a12dd45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:48.294528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab809f6d-b4b7-43f4-ae12-43e98a12dd45 service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:48.306704 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1108/2191] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:55:52.361667 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6092-26a3-4bb8-8810-bbd01efad105 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:52.362523 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6092-26a3-4bb8-8810-bbd01efad105 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:52.362671 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6092-26a3-4bb8-8810-bbd01efad105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:52.395673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-5aec6092-26a3-4bb8-8810-bbd01efad105 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:52.397306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5aec6092-26a3-4bb8-8810-bbd01efad105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:52.409282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1084/2192] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 12 23:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:52.429802 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab809f6d-b4b7-43f4-ae12-43e98a12dd45 service nova] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:52.431497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ab809f6d-b4b7-43f4-ae12-43e98a12dd45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:52.452433 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab809f6d-b4b7-43f4-ae12-43e98a12dd45 service nova] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:52.461296 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175594d-bda0-4e58-b8de-3008665d4856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:52.462311 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175594d-bda0-4e58-b8de-3008665d4856 service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:52.462763 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175594d-bda0-4e58-b8de-3008665d4856 service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:52.463233 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175594d-bda0-4e58-b8de-3008665d4856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:52.478597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175594d-bda0-4e58-b8de-3008665d4856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:52.481622 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175594d-bda0-4e58-b8de-3008665d4856 service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:52.499432 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1109/2193] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:55:56.581719 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4142a91-44eb-4226-8b4e-9027d5e3d2b8 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:56.583311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4142a91-44eb-4226-8b4e-9027d5e3d2b8 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:56.583819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4142a91-44eb-4226-8b4e-9027d5e3d2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:56.636519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-b4142a91-44eb-4226-8b4e-9027d5e3d2b8 None None] MFA Rules not processed for user `e1f49820de264982aeec97fa0be3c290`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:56.638982 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-b4142a91-44eb-4226-8b4e-9027d5e3d2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:56.675319 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:56.743785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1085/2194] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 23:55:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:56.764359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175594d-bda0-4e58-b8de-3008665d4856 service nova] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:56.767098 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5175594d-bda0-4e58-b8de-3008665d4856 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:56.886608 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175594d-bda0-4e58-b8de-3008665d4856 service nova] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:56.894114 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0003b-ff68-4387-aa4a-04836f5ba3bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c45ae3144b4fe8ab4e921fda30164a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:56.894433 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0003b-ff68-4387-aa4a-04836f5ba3bf service swift] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:56.894688 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0003b-ff68-4387-aa4a-04836f5ba3bf service swift] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:56.895040 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0003b-ff68-4387-aa4a-04836f5ba3bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:56.905862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0003b-ff68-4387-aa4a-04836f5ba3bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:56.907685 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0003b-ff68-4387-aa4a-04836f5ba3bf service swift] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:56.927291 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1110/2195] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 23:55:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:55:58.008341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363c665-d3d1-467d-81d3-48d7af697319 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:58.008341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363c665-d3d1-467d-81d3-48d7af697319 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:58.008341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363c665-d3d1-467d-81d3-48d7af697319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:58.031648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-c363c665-d3d1-467d-81d3-48d7af697319 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:55:58.033114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c363c665-d3d1-467d-81d3-48d7af697319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:55:58.044805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1086/2196] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 12 23:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:55:58.072199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0003b-ff68-4387-aa4a-04836f5ba3bf service swift] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:55:58.095364 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0003b-ff68-4387-aa4a-04836f5ba3bf service swift] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:55:58.106108 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e91f00-2cef-4b52-9cb3-1c5c7e424dac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:55:58.107357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e91f00-2cef-4b52-9cb3-1c5c7e424dac service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:55:58.107858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e91f00-2cef-4b52-9cb3-1c5c7e424dac service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:55:58.108327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e91f00-2cef-4b52-9cb3-1c5c7e424dac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:55:58.142161 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e91f00-2cef-4b52-9cb3-1c5c7e424dac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:55:58.146305 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e91f00-2cef-4b52-9cb3-1c5c7e424dac service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:55:58.163167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1111/2197] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:56:08.026369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=18 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:08.157187 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=54 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:13.000360 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363c665-d3d1-467d-81d3-48d7af697319 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:13.002331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c363c665-d3d1-467d-81d3-48d7af697319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:13.087705 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363c665-d3d1-467d-81d3-48d7af697319 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:13.093375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebc50e-75d7-46d7-abd7-815aab90912d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4395ee0a00df41adacb55b4a8684786b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:13.093990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebc50e-75d7-46d7-abd7-815aab90912d service placement] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:13.094269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebc50e-75d7-46d7-abd7-815aab90912d service placement] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:13.094544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebc50e-75d7-46d7-abd7-815aab90912d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:13.096440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-86ebc50e-75d7-46d7-abd7-815aab90912d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:13.109426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebc50e-75d7-46d7-abd7-815aab90912d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:13.111096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebc50e-75d7-46d7-abd7-815aab90912d service placement] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:13.123996 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1087/2198] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:56:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:56:13.472216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e91f00-2cef-4b52-9cb3-1c5c7e424dac service nova] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:13.483884 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e91f00-2cef-4b52-9cb3-1c5c7e424dac service nova] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:13.489003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f087c3d-6c48-49f5-846b-98332f2fe147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:13.490004 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f087c3d-6c48-49f5-846b-98332f2fe147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:13.490197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f087c3d-6c48-49f5-846b-98332f2fe147 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:13.490476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f087c3d-6c48-49f5-846b-98332f2fe147 admin admin] PATH_INFO: `/v3/users/fadfcb954591462eb9493b681f99f273` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:13.492218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f087c3d-6c48-49f5-846b-98332f2fe147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fadfcb954591462eb9493b681f99f273)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:13.494605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f087c3d-6c48-49f5-846b-98332f2fe147 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:13.577831 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2f087c3d-6c48-49f5-846b-98332f2fe147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fadfcb954591462eb9493b681f99f273'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:13.589270 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2f087c3d-6c48-49f5-846b-98332f2fe147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fadfcb954591462eb9493b681f99f273'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:13.616770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2f087c3d-6c48-49f5-846b-98332f2fe147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fadfcb954591462eb9493b681f99f273'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:13.628850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2f087c3d-6c48-49f5-846b-98332f2fe147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fadfcb954591462eb9493b681f99f273'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:13.629698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2f087c3d-6c48-49f5-846b-98332f2fe147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fadfcb954591462eb9493b681f99f273'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:13.637645 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1112/2199] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:56:13 2022] DELETE /identity/v3/users/fadfcb954591462eb9493b681f99f273 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:56:13.644153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd3af1-223d-49ee-82a2-4e76ce23568e None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:13.644672 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd3af1-223d-49ee-82a2-4e76ce23568e None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:13.646053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd3af1-223d-49ee-82a2-4e76ce23568e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:13.679694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-defd3af1-223d-49ee-82a2-4e76ce23568e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:13.682065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-defd3af1-223d-49ee-82a2-4e76ce23568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:13.788649 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1088/2200] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:56:13.801230 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f087c3d-6c48-49f5-846b-98332f2fe147 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:13.802870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2f087c3d-6c48-49f5-846b-98332f2fe147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:13.868529 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f087c3d-6c48-49f5-846b-98332f2fe147 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:13.872668 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be43c79-bde7-451b-acb7-c0ebe860ad1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:13.873313 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be43c79-bde7-451b-acb7-c0ebe860ad1f service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:13.873617 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be43c79-bde7-451b-acb7-c0ebe860ad1f service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:13.873889 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be43c79-bde7-451b-acb7-c0ebe860ad1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:13.885528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be43c79-bde7-451b-acb7-c0ebe860ad1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:13.887048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be43c79-bde7-451b-acb7-c0ebe860ad1f service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:13.898001 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1113/2201] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:56:14.248923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd3af1-223d-49ee-82a2-4e76ce23568e None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:14.250657 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-defd3af1-223d-49ee-82a2-4e76ce23568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:14.263786 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd3af1-223d-49ee-82a2-4e76ce23568e None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:14.269048 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db708a-c2b9-490e-9815-72f1c1804931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:14.269749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db708a-c2b9-490e-9815-72f1c1804931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:14.270010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db708a-c2b9-490e-9815-72f1c1804931 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:14.270547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db708a-c2b9-490e-9815-72f1c1804931 admin admin] PATH_INFO: `/v3/projects/3f4b9177f8ad449f8355a01662d543aa` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:14.271784 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db708a-c2b9-490e-9815-72f1c1804931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4b9177f8ad449f8355a01662d543aa)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:14.273878 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db708a-c2b9-490e-9815-72f1c1804931 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:14.344850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e1db708a-c2b9-490e-9815-72f1c1804931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4b9177f8ad449f8355a01662d543aa', 'request_id': 'req-e1db708a-c2b9-490e-9815-72f1c1804931'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:14.353192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e1db708a-c2b9-490e-9815-72f1c1804931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4b9177f8ad449f8355a01662d543aa', 'request_id': 'req-e1db708a-c2b9-490e-9815-72f1c1804931'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:14.366062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e1db708a-c2b9-490e-9815-72f1c1804931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4b9177f8ad449f8355a01662d543aa', 'request_id': 'req-e1db708a-c2b9-490e-9815-72f1c1804931'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:14.394068 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e1db708a-c2b9-490e-9815-72f1c1804931 admin admin] The token cache is being invalidate because project 3f4b9177f8ad449f8355a01662d543aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:56:14.394588 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e1db708a-c2b9-490e-9815-72f1c1804931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:14.396585 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e1db708a-c2b9-490e-9815-72f1c1804931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:14.403868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1089/2202] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:56:14 2022] DELETE /identity/v3/projects/3f4b9177f8ad449f8355a01662d543aa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:56:14.406428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88f0c2-0e7d-4efd-a056-b5e594b7b606 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:14.407071 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88f0c2-0e7d-4efd-a056-b5e594b7b606 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:14.407540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88f0c2-0e7d-4efd-a056-b5e594b7b606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:14.450434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-9d88f0c2-0e7d-4efd-a056-b5e594b7b606 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:14.452878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9d88f0c2-0e7d-4efd-a056-b5e594b7b606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:14.593799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1114/2203] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:56:14.610228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a2f82-90fc-4752-ae84-e7e963db1904 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:14.610526 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a2f82-90fc-4752-ae84-e7e963db1904 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:14.611044 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a2f82-90fc-4752-ae84-e7e963db1904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:14.652074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-c56a2f82-90fc-4752-ae84-e7e963db1904 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:14.654582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c56a2f82-90fc-4752-ae84-e7e963db1904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:14.662999 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca17384-4bcf-42f2-b322-3475605df21f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:14.674284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca17384-4bcf-42f2-b322-3475605df21f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:14.674284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca17384-4bcf-42f2-b322-3475605df21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:14.695980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1090/2204] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:56:14.703204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a2f82-90fc-4752-ae84-e7e963db1904 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:14.717123 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-fca17384-4bcf-42f2-b322-3475605df21f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:14.719377 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-fca17384-4bcf-42f2-b322-3475605df21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:14.719606 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a2f82-90fc-4752-ae84-e7e963db1904 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:14.727702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb1b6b-cd71-4b11-96e9-586ff092af30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:14.728733 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb1b6b-cd71-4b11-96e9-586ff092af30 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:14.729229 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb1b6b-cd71-4b11-96e9-586ff092af30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:14.729699 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb1b6b-cd71-4b11-96e9-586ff092af30 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:14.730792 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb1b6b-cd71-4b11-96e9-586ff092af30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:56:14.731209 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb1b6b-cd71-4b11-96e9-586ff092af30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:14.734134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb1b6b-cd71-4b11-96e9-586ff092af30 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:14.737280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:14.747853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1115/2205] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 12 23:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:56:14.759101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1091/2206] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:56:14.769514 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca17384-4bcf-42f2-b322-3475605df21f None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:14.770615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb1b6b-cd71-4b11-96e9-586ff092af30 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:14.773188 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-45bb1b6b-cd71-4b11-96e9-586ff092af30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:14.781327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca17384-4bcf-42f2-b322-3475605df21f None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:14.787553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9e77a-fbfe-46b7-8dfb-9b7a560fa22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:14.787818 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9e77a-fbfe-46b7-8dfb-9b7a560fa22d admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:14.788100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9e77a-fbfe-46b7-8dfb-9b7a560fa22d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:14.788370 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9e77a-fbfe-46b7-8dfb-9b7a560fa22d admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:14.789031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9e77a-fbfe-46b7-8dfb-9b7a560fa22d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:14.791255 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9e77a-fbfe-46b7-8dfb-9b7a560fa22d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:14.797502 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:14.836258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1116/2207] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:56:14 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:56:14.840867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9e77a-fbfe-46b7-8dfb-9b7a560fa22d admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:14.893311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb1b6b-cd71-4b11-96e9-586ff092af30 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:14.928763 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9e77a-fbfe-46b7-8dfb-9b7a560fa22d admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:14.935423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a025d4-d954-4441-ba2f-98674979a214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:14.937366 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a025d4-d954-4441-ba2f-98674979a214 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:14.937741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a025d4-d954-4441-ba2f-98674979a214 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:14.938454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a025d4-d954-4441-ba2f-98674979a214 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:14.938956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a025d4-d954-4441-ba2f-98674979a214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:14.941589 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a025d4-d954-4441-ba2f-98674979a214 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:14.974911 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1117/2208] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:56:14 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:56:14.979616 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a025d4-d954-4441-ba2f-98674979a214 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:14.985826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79926bd7-ef8f-4991-a496-edbe3732ea66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:14.986446 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79926bd7-ef8f-4991-a496-edbe3732ea66 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:14.986771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79926bd7-ef8f-4991-a496-edbe3732ea66 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:14.987205 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79926bd7-ef8f-4991-a496-edbe3732ea66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:14.996376 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a025d4-d954-4441-ba2f-98674979a214 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:14.997842 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79926bd7-ef8f-4991-a496-edbe3732ea66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:14.999483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79926bd7-ef8f-4991-a496-edbe3732ea66 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:15.006488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb1522-2d5f-4f6f-8d2e-5c1b92a18f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:15.007542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb1522-2d5f-4f6f-8d2e-5c1b92a18f04 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:15.008077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb1522-2d5f-4f6f-8d2e-5c1b92a18f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:15.008565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb1522-2d5f-4f6f-8d2e-5c1b92a18f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:15.009915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb1522-2d5f-4f6f-8d2e-5c1b92a18f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:15.010875 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1092/2209] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:56:15.013115 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb1522-2d5f-4f6f-8d2e-5c1b92a18f04 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:15.035332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1118/2210] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:56:15.040309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79926bd7-ef8f-4991-a496-edbe3732ea66 service nova] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:15.055907 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79926bd7-ef8f-4991-a496-edbe3732ea66 service nova] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:15.062137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ed548-aaf6-4479-aa1b-2439f8e0c282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:15.063099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ed548-aaf6-4479-aa1b-2439f8e0c282 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:15.063575 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ed548-aaf6-4479-aa1b-2439f8e0c282 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:15.063953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ed548-aaf6-4479-aa1b-2439f8e0c282 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:15.064955 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ed548-aaf6-4479-aa1b-2439f8e0c282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:15.067139 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ed548-aaf6-4479-aa1b-2439f8e0c282 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:15.086723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1093/2211] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:56:15.092455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb1522-2d5f-4f6f-8d2e-5c1b92a18f04 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:15.110979 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb1522-2d5f-4f6f-8d2e-5c1b92a18f04 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:15.118134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867423ab-6867-402e-bbb2-baa329b4f4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:15.118882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867423ab-6867-402e-bbb2-baa329b4f4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:15.119190 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867423ab-6867-402e-bbb2-baa329b4f4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:15.119463 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867423ab-6867-402e-bbb2-baa329b4f4c5 admin admin] PATH_INFO: `/v3/projects/22c784e90f024d548a8a66c50d9cef56/users/073f7d9ca942496cb36c6bd34b7367db/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:15.137804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867423ab-6867-402e-bbb2-baa329b4f4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c784e90f024d548a8a66c50d9cef56, user_id=073f7d9ca942496cb36c6bd34b7367db, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:15.140565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867423ab-6867-402e-bbb2-baa329b4f4c5 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:15.158406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1119/2212] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:56:15 2022] PUT /identity/v3/projects/22c784e90f024d548a8a66c50d9cef56/users/073f7d9ca942496cb36c6bd34b7367db/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:56:15.169673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403008d-9c98-4ff7-a3fa-602f48149e9f None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:15.169956 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403008d-9c98-4ff7-a3fa-602f48149e9f None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:15.170214 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403008d-9c98-4ff7-a3fa-602f48149e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:15.203638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-6403008d-9c98-4ff7-a3fa-602f48149e9f None None] MFA Rules not processed for user `073f7d9ca942496cb36c6bd34b7367db`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:15.205032 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6403008d-9c98-4ff7-a3fa-602f48149e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:15.311097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:15.328422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1094/2213] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:56:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:56:15.343109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867423ab-6867-402e-bbb2-baa329b4f4c5 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:15.345123 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-867423ab-6867-402e-bbb2-baa329b4f4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:15.409408 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867423ab-6867-402e-bbb2-baa329b4f4c5 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:15.413726 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201024f-eb0a-45d8-ab8d-ea1e7c34a902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:15.414475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201024f-eb0a-45d8-ab8d-ea1e7c34a902 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:15.414841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201024f-eb0a-45d8-ab8d-ea1e7c34a902 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:15.415198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201024f-eb0a-45d8-ab8d-ea1e7c34a902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:15.425392 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201024f-eb0a-45d8-ab8d-ea1e7c34a902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:15.426867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201024f-eb0a-45d8-ab8d-ea1e7c34a902 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:15.437462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1120/2214] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:56:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:56:16.926444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228c2d6-d4a7-4fb1-a459-521a3c8d705d None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:16.927186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228c2d6-d4a7-4fb1-a459-521a3c8d705d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:16.927951 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228c2d6-d4a7-4fb1-a459-521a3c8d705d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:16.958158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-4228c2d6-d4a7-4fb1-a459-521a3c8d705d None None] MFA Rules not processed for user `e1f49820de264982aeec97fa0be3c290`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:16.959454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4228c2d6-d4a7-4fb1-a459-521a3c8d705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:17.030703 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1095/2215] 10.222.0.23 () {58 vars in 967 bytes} [Mon Sep 12 23:56:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:56:17.057541 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201024f-eb0a-45d8-ab8d-ea1e7c34a902 service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:17.059352 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c201024f-eb0a-45d8-ab8d-ea1e7c34a902 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:17.126989 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:17.154977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201024f-eb0a-45d8-ab8d-ea1e7c34a902 service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:17.164235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac7aad-8935-4140-9839-ad443137a258 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c45ae3144b4fe8ab4e921fda30164a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:17.164867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac7aad-8935-4140-9839-ad443137a258 service swift] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:17.165191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac7aad-8935-4140-9839-ad443137a258 service swift] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:17.165557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac7aad-8935-4140-9839-ad443137a258 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:17.175454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac7aad-8935-4140-9839-ad443137a258 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:17.176887 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac7aad-8935-4140-9839-ad443137a258 service swift] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:17.186483 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1121/2216] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 23:56:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 12 23:56:18.140974 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228c2d6-d4a7-4fb1-a459-521a3c8d705d None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:18.220187 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228c2d6-d4a7-4fb1-a459-521a3c8d705d None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:18.225826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be540669-29f0-41f3-b14d-b4109a2d6545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:18.226496 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be540669-29f0-41f3-b14d-b4109a2d6545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:18.226776 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be540669-29f0-41f3-b14d-b4109a2d6545 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:18.227039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be540669-29f0-41f3-b14d-b4109a2d6545 admin admin] PATH_INFO: `/v3/users/073f7d9ca942496cb36c6bd34b7367db` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:18.228503 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be540669-29f0-41f3-b14d-b4109a2d6545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=073f7d9ca942496cb36c6bd34b7367db)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:18.231030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be540669-29f0-41f3-b14d-b4109a2d6545 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:18.302323 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-be540669-29f0-41f3-b14d-b4109a2d6545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073f7d9ca942496cb36c6bd34b7367db'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:18.303625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-be540669-29f0-41f3-b14d-b4109a2d6545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073f7d9ca942496cb36c6bd34b7367db'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:18.304339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-be540669-29f0-41f3-b14d-b4109a2d6545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073f7d9ca942496cb36c6bd34b7367db'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:18.323207 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-be540669-29f0-41f3-b14d-b4109a2d6545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073f7d9ca942496cb36c6bd34b7367db'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:18.338613 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-be540669-29f0-41f3-b14d-b4109a2d6545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073f7d9ca942496cb36c6bd34b7367db'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:18.362421 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1096/2217] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:56:18 2022] DELETE /identity/v3/users/073f7d9ca942496cb36c6bd34b7367db => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:56:18.366854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0569e1-f9b7-4cb7-bc1c-8a7762eb7f4d None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:18.367751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0569e1-f9b7-4cb7-bc1c-8a7762eb7f4d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:18.368199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0569e1-f9b7-4cb7-bc1c-8a7762eb7f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:18.390929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-1d0569e1-f9b7-4cb7-bc1c-8a7762eb7f4d None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:18.392143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1d0569e1-f9b7-4cb7-bc1c-8a7762eb7f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:18.491216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1122/2218] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:56:18.498777 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be540669-29f0-41f3-b14d-b4109a2d6545 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:18.500228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-be540669-29f0-41f3-b14d-b4109a2d6545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:18.526846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:18.584563 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be540669-29f0-41f3-b14d-b4109a2d6545 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:18.588326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a401c4b-9461-4357-8812-94e4e83164a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:18.588984 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a401c4b-9461-4357-8812-94e4e83164a7 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:18.589268 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a401c4b-9461-4357-8812-94e4e83164a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:18.589573 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a401c4b-9461-4357-8812-94e4e83164a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:18.600040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a401c4b-9461-4357-8812-94e4e83164a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:18.601546 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a401c4b-9461-4357-8812-94e4e83164a7 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:18.613762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1097/2219] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:56:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:56:18.959274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99622f-55f6-4931-86b6-9d82a696e15e None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:18.959582 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99622f-55f6-4931-86b6-9d82a696e15e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:18.959942 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99622f-55f6-4931-86b6-9d82a696e15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:18.968759 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a401c4b-9461-4357-8812-94e4e83164a7 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:18.970651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-3a401c4b-9461-4357-8812-94e4e83164a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:18.986699 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a401c4b-9461-4357-8812-94e4e83164a7 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:18.987590 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-7d99622f-55f6-4931-86b6-9d82a696e15e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:18.989255 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-7d99622f-55f6-4931-86b6-9d82a696e15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:18.997525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfad9f-5f2b-4881-94d1-ac226c142176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:18.998263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfad9f-5f2b-4881-94d1-ac226c142176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:18.998390 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1123/2220] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 12 23:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:56:18.998612 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfad9f-5f2b-4881-94d1-ac226c142176 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:18.998881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfad9f-5f2b-4881-94d1-ac226c142176 admin admin] PATH_INFO: `/v3/projects/22c784e90f024d548a8a66c50d9cef56` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:19.000548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfad9f-5f2b-4881-94d1-ac226c142176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c784e90f024d548a8a66c50d9cef56)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:19.002056 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfad9f-5f2b-4881-94d1-ac226c142176 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:19.022007 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99622f-55f6-4931-86b6-9d82a696e15e None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:19.025245 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-7d99622f-55f6-4931-86b6-9d82a696e15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:19.064583 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d6dfad9f-5f2b-4881-94d1-ac226c142176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c784e90f024d548a8a66c50d9cef56', 'request_id': 'req-d6dfad9f-5f2b-4881-94d1-ac226c142176'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:19.071035 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d6dfad9f-5f2b-4881-94d1-ac226c142176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c784e90f024d548a8a66c50d9cef56', 'request_id': 'req-d6dfad9f-5f2b-4881-94d1-ac226c142176'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:19.081015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d6dfad9f-5f2b-4881-94d1-ac226c142176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c784e90f024d548a8a66c50d9cef56', 'request_id': 'req-d6dfad9f-5f2b-4881-94d1-ac226c142176'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:19.099733 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d6dfad9f-5f2b-4881-94d1-ac226c142176 admin admin] The token cache is being invalidate because project 22c784e90f024d548a8a66c50d9cef56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:56:19.100131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d6dfad9f-5f2b-4881-94d1-ac226c142176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:19.100843 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d6dfad9f-5f2b-4881-94d1-ac226c142176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:19.102556 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1098/2221] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:56:18 2022] DELETE /identity/v3/projects/22c784e90f024d548a8a66c50d9cef56 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:56:19.107384 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a54fe-8437-4aa0-bd1e-c56f4602e6db None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:19.107670 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a54fe-8437-4aa0-bd1e-c56f4602e6db None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:19.107995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a54fe-8437-4aa0-bd1e-c56f4602e6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:19.114309 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99622f-55f6-4931-86b6-9d82a696e15e None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:19.130772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-308a54fe-8437-4aa0-bd1e-c56f4602e6db None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:19.131978 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-308a54fe-8437-4aa0-bd1e-c56f4602e6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:19.182212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:19.195111 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816874b-a52e-4bbb-8dab-85e661033758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:19.196039 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816874b-a52e-4bbb-8dab-85e661033758 service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:19.196512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816874b-a52e-4bbb-8dab-85e661033758 service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:19.196986 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816874b-a52e-4bbb-8dab-85e661033758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:19.200132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3816874b-a52e-4bbb-8dab-85e661033758 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:19.205518 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1099/2222] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:56:19.213842 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d027-eb7b-45fd-9980-acef8c3c243f None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:19.214125 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d027-eb7b-45fd-9980-acef8c3c243f None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:19.214393 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d027-eb7b-45fd-9980-acef8c3c243f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:19.217025 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816874b-a52e-4bbb-8dab-85e661033758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:19.219049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3816874b-a52e-4bbb-8dab-85e661033758 service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:19.230168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1124/2223] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:56:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:56:19.238842 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-9dc6d027-eb7b-45fd-9980-acef8c3c243f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:19.240328 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9dc6d027-eb7b-45fd-9980-acef8c3c243f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:19.248666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1100/2224] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:56:19.253702 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816874b-a52e-4bbb-8dab-85e661033758 service nova] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:19.266017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3816874b-a52e-4bbb-8dab-85e661033758 service nova] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:19.274073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c997c3-363a-4c8b-90c0-c6aa7b485277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:19.274748 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c997c3-363a-4c8b-90c0-c6aa7b485277 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:19.275031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c997c3-363a-4c8b-90c0-c6aa7b485277 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:19.275330 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c997c3-363a-4c8b-90c0-c6aa7b485277 admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:19.277205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c997c3-363a-4c8b-90c0-c6aa7b485277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:56:19.277205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c997c3-363a-4c8b-90c0-c6aa7b485277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:19.277949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c997c3-363a-4c8b-90c0-c6aa7b485277 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:19.292781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1125/2225] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:56:19.297826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6d027-eb7b-45fd-9980-acef8c3c243f None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:19.309654 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6d027-eb7b-45fd-9980-acef8c3c243f None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:19.316394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7966b-aa74-4d2e-b1dc-52d3ec08e180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:19.317429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7966b-aa74-4d2e-b1dc-52d3ec08e180 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:19.317739 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7966b-aa74-4d2e-b1dc-52d3ec08e180 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:19.318009 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7966b-aa74-4d2e-b1dc-52d3ec08e180 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:19.318692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7966b-aa74-4d2e-b1dc-52d3ec08e180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:19.320702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7966b-aa74-4d2e-b1dc-52d3ec08e180 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:19.350082 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1101/2226] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:56:19 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:56:19.354624 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c997c3-363a-4c8b-90c0-c6aa7b485277 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:19.365714 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c997c3-363a-4c8b-90c0-c6aa7b485277 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:19.426134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12752f9-a4d1-4f41-a323-97900d8a3e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:19.427157 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12752f9-a4d1-4f41-a323-97900d8a3e97 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:19.427157 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12752f9-a4d1-4f41-a323-97900d8a3e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:19.427483 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12752f9-a4d1-4f41-a323-97900d8a3e97 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:19.427930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12752f9-a4d1-4f41-a323-97900d8a3e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:19.429944 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12752f9-a4d1-4f41-a323-97900d8a3e97 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:19.455220 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1126/2227] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:56:19 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:56:19.461229 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7966b-aa74-4d2e-b1dc-52d3ec08e180 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:19.477883 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7966b-aa74-4d2e-b1dc-52d3ec08e180 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:19.483655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0278d5f-3e4d-499d-a39c-e4d7c49f9fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:19.484258 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0278d5f-3e4d-499d-a39c-e4d7c49f9fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:19.484538 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0278d5f-3e4d-499d-a39c-e4d7c49f9fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:19.484810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0278d5f-3e4d-499d-a39c-e4d7c49f9fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:19.485522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0278d5f-3e4d-499d-a39c-e4d7c49f9fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:19.487166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0278d5f-3e4d-499d-a39c-e4d7c49f9fe5 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:19.499408 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1102/2228] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:56:19.505395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12752f9-a4d1-4f41-a323-97900d8a3e97 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:19.515966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12752f9-a4d1-4f41-a323-97900d8a3e97 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:19.521118 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5103077-3afd-4396-96cf-6869b9a6e437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:19.521746 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5103077-3afd-4396-96cf-6869b9a6e437 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:19.522025 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5103077-3afd-4396-96cf-6869b9a6e437 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:19.522299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5103077-3afd-4396-96cf-6869b9a6e437 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:19.522959 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5103077-3afd-4396-96cf-6869b9a6e437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:19.524654 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5103077-3afd-4396-96cf-6869b9a6e437 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:19.536286 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1127/2229] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:56:19.541299 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0278d5f-3e4d-499d-a39c-e4d7c49f9fe5 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:19.556466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0278d5f-3e4d-499d-a39c-e4d7c49f9fe5 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:19.561483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4c4f4-71ec-4619-9ef9-0c7c376bb2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:19.562139 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4c4f4-71ec-4619-9ef9-0c7c376bb2bb admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:19.562418 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4c4f4-71ec-4619-9ef9-0c7c376bb2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:19.562689 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4c4f4-71ec-4619-9ef9-0c7c376bb2bb admin admin] PATH_INFO: `/v3/projects/7f98eac085964f07ad28b82a0fa7dab2/users/6d20f580a6fb4ae4925deb8658a504e8/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:19.564994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:19.581795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4c4f4-71ec-4619-9ef9-0c7c376bb2bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f98eac085964f07ad28b82a0fa7dab2, user_id=6d20f580a6fb4ae4925deb8658a504e8, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:19.584616 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4c4f4-71ec-4619-9ef9-0c7c376bb2bb admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:19.600808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1103/2230] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:56:19 2022] PUT /identity/v3/projects/7f98eac085964f07ad28b82a0fa7dab2/users/6d20f580a6fb4ae4925deb8658a504e8/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:56:19.612915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955eea47-37f7-494c-87a3-f31ec9b1a273 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:19.613200 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955eea47-37f7-494c-87a3-f31ec9b1a273 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:19.613515 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955eea47-37f7-494c-87a3-f31ec9b1a273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:19.643696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-955eea47-37f7-494c-87a3-f31ec9b1a273 None None] MFA Rules not processed for user `6d20f580a6fb4ae4925deb8658a504e8`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:19.644928 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-955eea47-37f7-494c-87a3-f31ec9b1a273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:19.713828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1128/2231] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:56:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:56:19.726022 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4c4f4-71ec-4619-9ef9-0c7c376bb2bb admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:19.728131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a4f4c4f4-71ec-4619-9ef9-0c7c376bb2bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:19.797039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4c4f4-71ec-4619-9ef9-0c7c376bb2bb admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:19.803265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b04c9-87fd-48c7-914d-ccf2b3c0cd08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:19.803904 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b04c9-87fd-48c7-914d-ccf2b3c0cd08 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:19.804208 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b04c9-87fd-48c7-914d-ccf2b3c0cd08 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:19.804483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b04c9-87fd-48c7-914d-ccf2b3c0cd08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:19.814820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b04c9-87fd-48c7-914d-ccf2b3c0cd08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:19.816511 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b04c9-87fd-48c7-914d-ccf2b3c0cd08 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:19.826832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1104/2232] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:56:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:56:19.860697 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955eea47-37f7-494c-87a3-f31ec9b1a273 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:19.940824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:19.959173 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955eea47-37f7-494c-87a3-f31ec9b1a273 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:19.964278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d90cc-ab21-423c-80ac-3c3656549806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:19.964882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d90cc-ab21-423c-80ac-3c3656549806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:19.965173 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d90cc-ab21-423c-80ac-3c3656549806 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:19.965481 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d90cc-ab21-423c-80ac-3c3656549806 admin admin] PATH_INFO: `/v3/users/6d20f580a6fb4ae4925deb8658a504e8` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:19.966616 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d90cc-ab21-423c-80ac-3c3656549806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d20f580a6fb4ae4925deb8658a504e8)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:19.968529 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d90cc-ab21-423c-80ac-3c3656549806 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:20.030652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-301d90cc-ab21-423c-80ac-3c3656549806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d20f580a6fb4ae4925deb8658a504e8'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:20.037996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-301d90cc-ab21-423c-80ac-3c3656549806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d20f580a6fb4ae4925deb8658a504e8'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:20.055274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-301d90cc-ab21-423c-80ac-3c3656549806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d20f580a6fb4ae4925deb8658a504e8'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:20.064238 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-301d90cc-ab21-423c-80ac-3c3656549806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d20f580a6fb4ae4925deb8658a504e8'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:20.064951 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-301d90cc-ab21-423c-80ac-3c3656549806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d20f580a6fb4ae4925deb8658a504e8'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:20.072189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1129/2233] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:56:19 2022] DELETE /identity/v3/users/6d20f580a6fb4ae4925deb8658a504e8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:56:20.077112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18eff8-3380-4e7b-98e8-5fe8a68f19f2 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:20.077648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18eff8-3380-4e7b-98e8-5fe8a68f19f2 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:20.077912 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18eff8-3380-4e7b-98e8-5fe8a68f19f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:20.102180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-8a18eff8-3380-4e7b-98e8-5fe8a68f19f2 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:20.103832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-8a18eff8-3380-4e7b-98e8-5fe8a68f19f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:20.171922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1105/2234] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:56:20.184526 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d90cc-ab21-423c-80ac-3c3656549806 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:20.187358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-301d90cc-ab21-423c-80ac-3c3656549806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:20.255619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d90cc-ab21-423c-80ac-3c3656549806 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:20.258237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbf049-d665-4e82-87bc-de140ff4013b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:20.258902 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbf049-d665-4e82-87bc-de140ff4013b service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:20.259182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbf049-d665-4e82-87bc-de140ff4013b service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:20.259454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbf049-d665-4e82-87bc-de140ff4013b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:20.275268 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbf049-d665-4e82-87bc-de140ff4013b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:20.276721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbf049-d665-4e82-87bc-de140ff4013b service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:20.288148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1130/2235] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:56:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:56:20.594611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18eff8-3380-4e7b-98e8-5fe8a68f19f2 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:20.596119 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-8a18eff8-3380-4e7b-98e8-5fe8a68f19f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:20.611703 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18eff8-3380-4e7b-98e8-5fe8a68f19f2 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:20.617677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:20.618469 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:20.618780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:20.619051 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8 admin admin] PATH_INFO: `/v3/projects/7f98eac085964f07ad28b82a0fa7dab2` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:20.620355 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f98eac085964f07ad28b82a0fa7dab2)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:20.622850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:20.676871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f98eac085964f07ad28b82a0fa7dab2', 'request_id': 'req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:20.683595 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f98eac085964f07ad28b82a0fa7dab2', 'request_id': 'req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:20.693447 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f98eac085964f07ad28b82a0fa7dab2', 'request_id': 'req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:20.707163 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8 admin admin] The token cache is being invalidate because project 7f98eac085964f07ad28b82a0fa7dab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:56:20.707441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:20.708141 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:56:20.709766 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1106/2236] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:56:20 2022] DELETE /identity/v3/projects/7f98eac085964f07ad28b82a0fa7dab2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:56:22.110690 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895d8b0-f72a-4ae7-9802-d49596b77461 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:22.111251 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895d8b0-f72a-4ae7-9802-d49596b77461 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:22.111428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895d8b0-f72a-4ae7-9802-d49596b77461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:22.137642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-2895d8b0-f72a-4ae7-9802-d49596b77461 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:22.138929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2895d8b0-f72a-4ae7-9802-d49596b77461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:22.204228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1131/2237] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 12 23:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:56:22.219870 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:22.221291 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:22.232751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:22.310885 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3f28a-1851-420a-b099-ccbb6ad9bec8 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:22.318863 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383586c1-03f8-4e64-af71-5b8ca7d31511 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:22.319611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383586c1-03f8-4e64-af71-5b8ca7d31511 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:22.319900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383586c1-03f8-4e64-af71-5b8ca7d31511 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:22.320175 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383586c1-03f8-4e64-af71-5b8ca7d31511 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:22.329824 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383586c1-03f8-4e64-af71-5b8ca7d31511 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:22.331446 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383586c1-03f8-4e64-af71-5b8ca7d31511 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:22.341299 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1107/2238] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:56:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:56:24.038344 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863f847-1455-47e9-9b29-139523ad0c75 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:24.038981 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863f847-1455-47e9-9b29-139523ad0c75 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:24.038981 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863f847-1455-47e9-9b29-139523ad0c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:24.067418 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-f863f847-1455-47e9-9b29-139523ad0c75 None None] MFA Rules not processed for user `938c34cda5234812894863921ad14d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:24.068791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-f863f847-1455-47e9-9b29-139523ad0c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:24.075415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:24.139195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1132/2239] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:56:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:56:32.336735 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=30 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:34.131025 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=21 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:37.554147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646bc27-c36e-4148-851a-80a62bb0e127 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:37.554708 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646bc27-c36e-4148-851a-80a62bb0e127 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:37.554708 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646bc27-c36e-4148-851a-80a62bb0e127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:37.576638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-2646bc27-c36e-4148-851a-80a62bb0e127 None None] MFA Rules not processed for user `7c2a646d764d43fab5328c7beb425926`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:37.577929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-2646bc27-c36e-4148-851a-80a62bb0e127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:37.638731 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1108/2240] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:56:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:56:47.629853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=25 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:53.558026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169e324-b174-474f-b0d3-88adce5581af None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:53.558786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169e324-b174-474f-b0d3-88adce5581af None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:53.558786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169e324-b174-474f-b0d3-88adce5581af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:53.585208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-f169e324-b174-474f-b0d3-88adce5581af None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:53.586459 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-f169e324-b174-474f-b0d3-88adce5581af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:53.595244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1133/2241] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 12 23:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:56:53.610792 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646bc27-c36e-4148-851a-80a62bb0e127 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:53.630028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646bc27-c36e-4148-851a-80a62bb0e127 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:53.638086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58107bf3-5c50-4bbd-8602-6956a6e585b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:53.638893 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58107bf3-5c50-4bbd-8602-6956a6e585b0 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:53.639187 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58107bf3-5c50-4bbd-8602-6956a6e585b0 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:53.639488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58107bf3-5c50-4bbd-8602-6956a6e585b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:53.648732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58107bf3-5c50-4bbd-8602-6956a6e585b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:53.650352 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58107bf3-5c50-4bbd-8602-6956a6e585b0 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:53.660891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1109/2242] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:56:56.812812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cbefb-ae5e-4f8c-a607-917505d73a12 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:56.813373 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cbefb-ae5e-4f8c-a607-917505d73a12 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:56.813373 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cbefb-ae5e-4f8c-a607-917505d73a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:56.834570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-4d3cbefb-ae5e-4f8c-a607-917505d73a12 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:56.835764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4d3cbefb-ae5e-4f8c-a607-917505d73a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:56.845370 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1134/2243] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 12 23:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:56:56.862140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58107bf3-5c50-4bbd-8602-6956a6e585b0 service nova] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:56.874626 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58107bf3-5c50-4bbd-8602-6956a6e585b0 service nova] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:56.881830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcc1aa-fa3b-4415-9841-c514c1a17c37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:56.882451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcc1aa-fa3b-4415-9841-c514c1a17c37 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:56.882728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcc1aa-fa3b-4415-9841-c514c1a17c37 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:56.883000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcc1aa-fa3b-4415-9841-c514c1a17c37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:56.894652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcc1aa-fa3b-4415-9841-c514c1a17c37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:56.896313 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcc1aa-fa3b-4415-9841-c514c1a17c37 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:56:56.907762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1110/2244] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:56:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:56:59.905686 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080abd4-e6b8-49c2-bee1-f3477b985123 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:59.906436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080abd4-e6b8-49c2-bee1-f3477b985123 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:59.906436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080abd4-e6b8-49c2-bee1-f3477b985123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:59.930362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-c080abd4-e6b8-49c2-bee1-f3477b985123 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:56:59.931564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c080abd4-e6b8-49c2-bee1-f3477b985123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:56:59.940977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1135/2245] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 12 23:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:56:59.965753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcc1aa-fa3b-4415-9841-c514c1a17c37 service nova] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:56:59.977784 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcc1aa-fa3b-4415-9841-c514c1a17c37 service nova] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:56:59.986406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7ce6c-ee05-41ef-a075-2376d0a536cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:56:59.987222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7ce6c-ee05-41ef-a075-2376d0a536cc service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:56:59.987562 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7ce6c-ee05-41ef-a075-2376d0a536cc service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:56:59.987806 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7ce6c-ee05-41ef-a075-2376d0a536cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:56:59.997952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7ce6c-ee05-41ef-a075-2376d0a536cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:56:59.999642 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7ce6c-ee05-41ef-a075-2376d0a536cc service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:57:00.010022 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1111/2246] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:56:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:57:04.120240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dec2d-e0cc-411f-93e5-7c4c369da82e None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:57:04.120975 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dec2d-e0cc-411f-93e5-7c4c369da82e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:57:04.121162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dec2d-e0cc-411f-93e5-7c4c369da82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:57:04.147623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-429dec2d-e0cc-411f-93e5-7c4c369da82e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:57:04.149786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-429dec2d-e0cc-411f-93e5-7c4c369da82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:57:04.163582 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1136/2247] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 12 23:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:57:04.182093 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7ce6c-ee05-41ef-a075-2376d0a536cc service nova] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:57:04.194906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7ce6c-ee05-41ef-a075-2376d0a536cc service nova] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:57:04.200745 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181739c5-a4d6-45c6-879b-b4a2bad60ee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:57:04.201407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181739c5-a4d6-45c6-879b-b4a2bad60ee6 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:57:04.201689 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181739c5-a4d6-45c6-879b-b4a2bad60ee6 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:57:04.201959 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181739c5-a4d6-45c6-879b-b4a2bad60ee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:57:04.211504 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181739c5-a4d6-45c6-879b-b4a2bad60ee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:57:04.213158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181739c5-a4d6-45c6-879b-b4a2bad60ee6 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:57:04.224681 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1112/2248] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:57:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:57:08.404303 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8d65d-4b2d-48d3-bf0d-0cdb214c26ef None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:57:08.405127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8d65d-4b2d-48d3-bf0d-0cdb214c26ef None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:57:08.405324 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8d65d-4b2d-48d3-bf0d-0cdb214c26ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:57:08.464405 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-7ee8d65d-4b2d-48d3-bf0d-0cdb214c26ef None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:57:08.465887 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-7ee8d65d-4b2d-48d3-bf0d-0cdb214c26ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:57:08.485992 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1137/2249] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 12 23:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:57:08.512740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181739c5-a4d6-45c6-879b-b4a2bad60ee6 service nova] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:57:08.542820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181739c5-a4d6-45c6-879b-b4a2bad60ee6 service nova] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:57:08.553173 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341db58-2427-421e-a307-60f8beb3e7ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:57:08.554293 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341db58-2427-421e-a307-60f8beb3e7ad service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:57:08.554787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341db58-2427-421e-a307-60f8beb3e7ad service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:57:08.555271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341db58-2427-421e-a307-60f8beb3e7ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:57:08.571310 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341db58-2427-421e-a307-60f8beb3e7ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:57:08.575335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341db58-2427-421e-a307-60f8beb3e7ad service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:57:08.591093 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1113/2250] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:57:09.940328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8d006-dc37-4afd-87fe-01e798886757 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:57:09.941408 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8d006-dc37-4afd-87fe-01e798886757 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:57:09.942014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8d006-dc37-4afd-87fe-01e798886757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:57:09.972686 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-d1c8d006-dc37-4afd-87fe-01e798886757 None None] MFA Rules not processed for user `4e71cfb3bd8646798cd5ab0d1a7445d7`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:57:09.974220 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d1c8d006-dc37-4afd-87fe-01e798886757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:57:10.076314 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1138/2251] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:57:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:57:11.600336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e16439-f375-4fbf-b4a3-7af913f1f06f None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:57:11.600827 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e16439-f375-4fbf-b4a3-7af913f1f06f None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:57:11.600944 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e16439-f375-4fbf-b4a3-7af913f1f06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:57:11.622408 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-b2e16439-f375-4fbf-b4a3-7af913f1f06f None None] MFA Rules not processed for user `1f69ab01440e406f86f50bedc7e02fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:57:11.623658 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-b2e16439-f375-4fbf-b4a3-7af913f1f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:57:11.704491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1114/2252] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:57:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:57:20.068681 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=40 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:21.692183 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=55 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:42.362357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98e4a0-2508-4c9c-90ad-a8214b785deb None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:57:42.362941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98e4a0-2508-4c9c-90ad-a8214b785deb None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:57:42.362941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98e4a0-2508-4c9c-90ad-a8214b785deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:57:42.382846 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-df98e4a0-2508-4c9c-90ad-a8214b785deb None None] MFA Rules not processed for user `938c34cda5234812894863921ad14d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:57:42.384109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-df98e4a0-2508-4c9c-90ad-a8214b785deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:57:42.391507 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1139/2253] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:57:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:57:43.188293 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e16439-f375-4fbf-b4a3-7af913f1f06f None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:57:43.190543 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-b2e16439-f375-4fbf-b4a3-7af913f1f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:57:43.207375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e16439-f375-4fbf-b4a3-7af913f1f06f None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:57:43.213173 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a9b30-82c3-4f1e-9586-704c4109be01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:57:43.213976 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a9b30-82c3-4f1e-9586-704c4109be01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:57:43.214344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a9b30-82c3-4f1e-9586-704c4109be01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:57:43.214826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a9b30-82c3-4f1e-9586-704c4109be01 admin admin] PATH_INFO: `/v3/users/7c2a646d764d43fab5328c7beb425926` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:57:43.216204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a9b30-82c3-4f1e-9586-704c4109be01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2a646d764d43fab5328c7beb425926)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:57:43.218465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a9b30-82c3-4f1e-9586-704c4109be01 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:57:43.265441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-602a9b30-82c3-4f1e-9586-704c4109be01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2a646d764d43fab5328c7beb425926'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:57:43.266101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-602a9b30-82c3-4f1e-9586-704c4109be01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2a646d764d43fab5328c7beb425926'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:57:43.266732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-602a9b30-82c3-4f1e-9586-704c4109be01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2a646d764d43fab5328c7beb425926'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:57:43.281613 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-602a9b30-82c3-4f1e-9586-704c4109be01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2a646d764d43fab5328c7beb425926'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:57:43.289170 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-602a9b30-82c3-4f1e-9586-704c4109be01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2a646d764d43fab5328c7beb425926'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:57:43.307491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1115/2254] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:57:43 2022] DELETE /identity/v3/users/7c2a646d764d43fab5328c7beb425926 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:57:43.489495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98e4a0-2508-4c9c-90ad-a8214b785deb None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:57:43.503288 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98e4a0-2508-4c9c-90ad-a8214b785deb None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:57:43.579914 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270d070-5c54-433d-ab9e-ac4f3ade38b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:57:43.580503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d070-5c54-433d-ab9e-ac4f3ade38b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:57:43.580778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d070-5c54-433d-ab9e-ac4f3ade38b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:57:43.581066 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d070-5c54-433d-ab9e-ac4f3ade38b5 admin admin] PATH_INFO: `/v3/projects/ff8edfd884194c64b76b0486570f6eec` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:57:43.582242 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270d070-5c54-433d-ab9e-ac4f3ade38b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff8edfd884194c64b76b0486570f6eec)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:57:43.584158 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270d070-5c54-433d-ab9e-ac4f3ade38b5 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:57:43.634199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f270d070-5c54-433d-ab9e-ac4f3ade38b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff8edfd884194c64b76b0486570f6eec', 'request_id': 'req-f270d070-5c54-433d-ab9e-ac4f3ade38b5'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:57:43.642406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f270d070-5c54-433d-ab9e-ac4f3ade38b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff8edfd884194c64b76b0486570f6eec', 'request_id': 'req-f270d070-5c54-433d-ab9e-ac4f3ade38b5'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:57:43.649072 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f270d070-5c54-433d-ab9e-ac4f3ade38b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff8edfd884194c64b76b0486570f6eec', 'request_id': 'req-f270d070-5c54-433d-ab9e-ac4f3ade38b5'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:57:43.662056 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f270d070-5c54-433d-ab9e-ac4f3ade38b5 admin admin] The token cache is being invalidate because project ff8edfd884194c64b76b0486570f6eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:57:43.662273 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f270d070-5c54-433d-ab9e-ac4f3ade38b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:57:43.662824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f270d070-5c54-433d-ab9e-ac4f3ade38b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:57:43.664462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1140/2255] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:57:43 2022] DELETE /identity/v3/projects/ff8edfd884194c64b76b0486570f6eec => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:57:53.301737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:53.658800 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:58.835770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbbff2-bdd2-48d2-9462-b48ebb7d965a None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:57:58.836450 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbbff2-bdd2-48d2-9462-b48ebb7d965a None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:57:58.836450 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbbff2-bdd2-48d2-9462-b48ebb7d965a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:57:58.859217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-6ffbbff2-bdd2-48d2-9462-b48ebb7d965a None None] MFA Rules not processed for user `a3caf53b684542ac87474ab807b5fdcc`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:57:58.860429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6ffbbff2-bdd2-48d2-9462-b48ebb7d965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:57:58.927511 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1116/2256] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:57:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:04.862000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270d070-5c54-433d-ab9e-ac4f3ade38b5 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:04.863572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-f270d070-5c54-433d-ab9e-ac4f3ade38b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:04.926955 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270d070-5c54-433d-ab9e-ac4f3ade38b5 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:04.930935 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e90203-64b7-4914-9e72-3764a46f0012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:04.931561 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e90203-64b7-4914-9e72-3764a46f0012 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:04.931837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e90203-64b7-4914-9e72-3764a46f0012 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:04.932110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e90203-64b7-4914-9e72-3764a46f0012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:04.933962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-71e90203-64b7-4914-9e72-3764a46f0012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:05.014523 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e90203-64b7-4914-9e72-3764a46f0012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:05.016046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e90203-64b7-4914-9e72-3764a46f0012 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:05.028805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1141/2257] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:08.919809 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=25 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:11.086266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbbff2-bdd2-48d2-9462-b48ebb7d965a None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:11.088189 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6ffbbff2-bdd2-48d2-9462-b48ebb7d965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:11.103471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbbff2-bdd2-48d2-9462-b48ebb7d965a None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:11.108456 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cc28a-b084-4dbf-aa39-504f8e939ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:11.109498 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cc28a-b084-4dbf-aa39-504f8e939ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:11.109840 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cc28a-b084-4dbf-aa39-504f8e939ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:11.110192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cc28a-b084-4dbf-aa39-504f8e939ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:11.112359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e00cc28a-b084-4dbf-aa39-504f8e939ae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:11.133877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cc28a-b084-4dbf-aa39-504f8e939ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:11.136647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cc28a-b084-4dbf-aa39-504f8e939ae2 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:11.162704 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1117/2258] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:15.022937 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=54 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:17.505629 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e90203-64b7-4914-9e72-3764a46f0012 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:17.514847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e90203-64b7-4914-9e72-3764a46f0012 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:17.518864 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7d6f7-a59c-4e92-b807-af3d951fb8ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:17.519502 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7d6f7-a59c-4e92-b807-af3d951fb8ca service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:17.519766 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7d6f7-a59c-4e92-b807-af3d951fb8ca service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:17.520032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7d6f7-a59c-4e92-b807-af3d951fb8ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:17.521902 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-93f7d6f7-a59c-4e92-b807-af3d951fb8ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:17.593315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7d6f7-a59c-4e92-b807-af3d951fb8ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:17.594737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7d6f7-a59c-4e92-b807-af3d951fb8ca service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:17.606004 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1142/2259] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:21.048449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cc28a-b084-4dbf-aa39-504f8e939ae2 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:21.050049 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e00cc28a-b084-4dbf-aa39-504f8e939ae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:21.064790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cc28a-b084-4dbf-aa39-504f8e939ae2 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:21.070552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee72a5-a157-4a1d-a6d8-76f5353a1872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:21.071194 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee72a5-a157-4a1d-a6d8-76f5353a1872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:21.071472 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee72a5-a157-4a1d-a6d8-76f5353a1872 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:21.071739 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee72a5-a157-4a1d-a6d8-76f5353a1872 admin admin] PATH_INFO: `/v3/users/4e71cfb3bd8646798cd5ab0d1a7445d7` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:21.072870 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee72a5-a157-4a1d-a6d8-76f5353a1872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e71cfb3bd8646798cd5ab0d1a7445d7)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:21.075928 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee72a5-a157-4a1d-a6d8-76f5353a1872 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:21.127696 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a1ee72a5-a157-4a1d-a6d8-76f5353a1872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e71cfb3bd8646798cd5ab0d1a7445d7'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:21.128417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a1ee72a5-a157-4a1d-a6d8-76f5353a1872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e71cfb3bd8646798cd5ab0d1a7445d7'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:21.129097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a1ee72a5-a157-4a1d-a6d8-76f5353a1872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e71cfb3bd8646798cd5ab0d1a7445d7'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:21.148399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a1ee72a5-a157-4a1d-a6d8-76f5353a1872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e71cfb3bd8646798cd5ab0d1a7445d7'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:21.155479 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a1ee72a5-a157-4a1d-a6d8-76f5353a1872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e71cfb3bd8646798cd5ab0d1a7445d7'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:21.169967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1118/2260] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:58:21 2022] DELETE /identity/v3/users/4e71cfb3bd8646798cd5ab0d1a7445d7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:21.359240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7d6f7-a59c-4e92-b807-af3d951fb8ca service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:21.371610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7d6f7-a59c-4e92-b807-af3d951fb8ca service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:21.435998 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93de688-b10d-4c8f-8343-945a7db5a80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:21.436655 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93de688-b10d-4c8f-8343-945a7db5a80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:21.436936 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93de688-b10d-4c8f-8343-945a7db5a80f admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:21.437215 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93de688-b10d-4c8f-8343-945a7db5a80f admin admin] PATH_INFO: `/v3/projects/599db5bc6cd74f27ae885c9994f06953` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:21.438475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93de688-b10d-4c8f-8343-945a7db5a80f admin admin] RBAC: Authorizing `identity:delete_project(project_id=599db5bc6cd74f27ae885c9994f06953)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:21.440414 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93de688-b10d-4c8f-8343-945a7db5a80f admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:21.489461 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e93de688-b10d-4c8f-8343-945a7db5a80f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '599db5bc6cd74f27ae885c9994f06953', 'request_id': 'req-e93de688-b10d-4c8f-8343-945a7db5a80f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:21.499499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e93de688-b10d-4c8f-8343-945a7db5a80f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '599db5bc6cd74f27ae885c9994f06953', 'request_id': 'req-e93de688-b10d-4c8f-8343-945a7db5a80f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:21.505459 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e93de688-b10d-4c8f-8343-945a7db5a80f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '599db5bc6cd74f27ae885c9994f06953', 'request_id': 'req-e93de688-b10d-4c8f-8343-945a7db5a80f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:21.517450 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e93de688-b10d-4c8f-8343-945a7db5a80f admin admin] The token cache is being invalidate because project 599db5bc6cd74f27ae885c9994f06953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:58:21.517688 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e93de688-b10d-4c8f-8343-945a7db5a80f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:21.518310 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e93de688-b10d-4c8f-8343-945a7db5a80f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:21.519831 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1143/2261] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:58:21 2022] DELETE /identity/v3/projects/599db5bc6cd74f27ae885c9994f06953 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:21.525143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcec04-2cb7-4c13-8d42-e792a4ddc4b0 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:21.525435 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcec04-2cb7-4c13-8d42-e792a4ddc4b0 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:21.525710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcec04-2cb7-4c13-8d42-e792a4ddc4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:21.545152 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-f1dcec04-2cb7-4c13-8d42-e792a4ddc4b0 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:21.546380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f1dcec04-2cb7-4c13-8d42-e792a4ddc4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:21.616784 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1119/2262] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:21.625544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b51e54-da61-40f5-a79e-784b494c4722 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:21.625799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b51e54-da61-40f5-a79e-784b494c4722 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:21.626106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b51e54-da61-40f5-a79e-784b494c4722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:21.647733 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-b8b51e54-da61-40f5-a79e-784b494c4722 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:21.648898 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b8b51e54-da61-40f5-a79e-784b494c4722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:21.657251 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1144/2263] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:21.662033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcec04-2cb7-4c13-8d42-e792a4ddc4b0 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:21.672773 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcec04-2cb7-4c13-8d42-e792a4ddc4b0 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:21.677966 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49977077-4dda-4da8-920c-e6b08a67115e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:21.678606 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49977077-4dda-4da8-920c-e6b08a67115e admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:21.678874 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49977077-4dda-4da8-920c-e6b08a67115e admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:21.679131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49977077-4dda-4da8-920c-e6b08a67115e admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:21.679817 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49977077-4dda-4da8-920c-e6b08a67115e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:58:21.680119 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49977077-4dda-4da8-920c-e6b08a67115e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:21.681807 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49977077-4dda-4da8-920c-e6b08a67115e admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:21.694813 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1120/2264] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:58:21.699374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b51e54-da61-40f5-a79e-784b494c4722 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:21.709701 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b51e54-da61-40f5-a79e-784b494c4722 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:21.714880 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21861ff-e854-466c-bec2-07b5209a7ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:21.715488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21861ff-e854-466c-bec2-07b5209a7ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:21.716190 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21861ff-e854-466c-bec2-07b5209a7ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:21.716190 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21861ff-e854-466c-bec2-07b5209a7ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:21.716664 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21861ff-e854-466c-bec2-07b5209a7ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:21.718579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21861ff-e854-466c-bec2-07b5209a7ef6 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:21.736149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:21.754239 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1145/2265] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:58:21 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:58:21.758692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49977077-4dda-4da8-920c-e6b08a67115e admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:21.769515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49977077-4dda-4da8-920c-e6b08a67115e admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:21.817681 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:21.831487 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6d750-b9c1-4d7a-ab4a-808524b15f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:21.832199 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d750-b9c1-4d7a-ab4a-808524b15f49 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:21.832474 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d750-b9c1-4d7a-ab4a-808524b15f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:21.832740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6d750-b9c1-4d7a-ab4a-808524b15f49 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:21.833406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6d750-b9c1-4d7a-ab4a-808524b15f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:21.835378 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6d750-b9c1-4d7a-ab4a-808524b15f49 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:21.864383 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1121/2266] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:58:21 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:58:21.865744 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21861ff-e854-466c-bec2-07b5209a7ef6 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:21.878934 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21861ff-e854-466c-bec2-07b5209a7ef6 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:21.884134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375599b7-bf5e-4177-a06b-29efe57aa57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:21.884755 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375599b7-bf5e-4177-a06b-29efe57aa57f admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:21.885032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375599b7-bf5e-4177-a06b-29efe57aa57f admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:21.885303 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375599b7-bf5e-4177-a06b-29efe57aa57f admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:21.886054 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375599b7-bf5e-4177-a06b-29efe57aa57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:21.887665 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375599b7-bf5e-4177-a06b-29efe57aa57f admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:21.898219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1146/2267] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:58:21.902409 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6d750-b9c1-4d7a-ab4a-808524b15f49 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:21.912629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6d750-b9c1-4d7a-ab4a-808524b15f49 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:21.917499 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f9ed2-001f-4e2e-ad3f-ef5f91fc1f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:21.918101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f9ed2-001f-4e2e-ad3f-ef5f91fc1f4a admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:21.918376 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f9ed2-001f-4e2e-ad3f-ef5f91fc1f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:21.918643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f9ed2-001f-4e2e-ad3f-ef5f91fc1f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:21.919290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f9ed2-001f-4e2e-ad3f-ef5f91fc1f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:21.920884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f9ed2-001f-4e2e-ad3f-ef5f91fc1f4a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:21.932361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1122/2268] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:58:21.936674 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375599b7-bf5e-4177-a06b-29efe57aa57f admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:21.946837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375599b7-bf5e-4177-a06b-29efe57aa57f admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:21.951727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f53e2-eb76-4b7d-9f74-a0ef1311c704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:21.952395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f53e2-eb76-4b7d-9f74-a0ef1311c704 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:21.952673 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f53e2-eb76-4b7d-9f74-a0ef1311c704 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:21.952946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f53e2-eb76-4b7d-9f74-a0ef1311c704 admin admin] PATH_INFO: `/v3/projects/f907e260bedc4d14965d2feb7529a76f/users/7639abc3bdef4df4859d232a4db0275b/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:21.975388 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f53e2-eb76-4b7d-9f74-a0ef1311c704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f907e260bedc4d14965d2feb7529a76f, user_id=7639abc3bdef4df4859d232a4db0275b, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:21.979396 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f53e2-eb76-4b7d-9f74-a0ef1311c704 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:21.996597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1147/2269] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:58:21 2022] PUT /identity/v3/projects/f907e260bedc4d14965d2feb7529a76f/users/7639abc3bdef4df4859d232a4db0275b/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:58:22.008080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72587b1a-f201-43c0-ac3a-7af54555ffd3 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:22.008442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72587b1a-f201-43c0-ac3a-7af54555ffd3 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:22.008713 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72587b1a-f201-43c0-ac3a-7af54555ffd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:22.038283 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-72587b1a-f201-43c0-ac3a-7af54555ffd3 None None] MFA Rules not processed for user `7639abc3bdef4df4859d232a4db0275b`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:22.039523 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-72587b1a-f201-43c0-ac3a-7af54555ffd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:22.117595 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1123/2270] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:22.122665 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f53e2-eb76-4b7d-9f74-a0ef1311c704 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:22.190482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f53e2-eb76-4b7d-9f74-a0ef1311c704 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:22.196185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb6ee5-7829-41d7-b806-a3114b3f8dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:22.196906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb6ee5-7829-41d7-b806-a3114b3f8dae admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:22.197198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb6ee5-7829-41d7-b806-a3114b3f8dae admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:22.197519 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb6ee5-7829-41d7-b806-a3114b3f8dae admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:22.198197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb6ee5-7829-41d7-b806-a3114b3f8dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:22.200263 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb6ee5-7829-41d7-b806-a3114b3f8dae admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:22.231800 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1148/2271] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:58:22 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:58:22.233488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72587b1a-f201-43c0-ac3a-7af54555ffd3 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:22.246001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72587b1a-f201-43c0-ac3a-7af54555ffd3 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:22.305138 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198c7ee-0af6-41b6-9919-4f414f2bc0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:22.305791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198c7ee-0af6-41b6-9919-4f414f2bc0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:22.306069 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198c7ee-0af6-41b6-9919-4f414f2bc0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:22.306336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198c7ee-0af6-41b6-9919-4f414f2bc0b7 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:22.307029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198c7ee-0af6-41b6-9919-4f414f2bc0b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:22.309043 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198c7ee-0af6-41b6-9919-4f414f2bc0b7 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:22.335791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1124/2272] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:58:22 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:58:22.339825 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb6ee5-7829-41d7-b806-a3114b3f8dae admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:22.350296 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb6ee5-7829-41d7-b806-a3114b3f8dae admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:22.354975 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fff016-78c7-49fb-8ab7-76985cd67845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:22.355581 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fff016-78c7-49fb-8ab7-76985cd67845 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:22.355863 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fff016-78c7-49fb-8ab7-76985cd67845 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:22.356134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fff016-78c7-49fb-8ab7-76985cd67845 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:22.356785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fff016-78c7-49fb-8ab7-76985cd67845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:22.358420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fff016-78c7-49fb-8ab7-76985cd67845 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:22.369150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1149/2273] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:58:22.373947 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198c7ee-0af6-41b6-9919-4f414f2bc0b7 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:22.385389 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198c7ee-0af6-41b6-9919-4f414f2bc0b7 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:22.391063 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b7968-450f-4c2e-beaf-7cae19551af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:22.391718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b7968-450f-4c2e-beaf-7cae19551af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:22.391990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b7968-450f-4c2e-beaf-7cae19551af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:22.392251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b7968-450f-4c2e-beaf-7cae19551af7 admin admin] PATH_INFO: `/v3/projects/a5e24c90a81e4ebbb4fa60930dae3690/users/b814e29e3c924bbab538c64cd60808dc/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:22.409488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b7968-450f-4c2e-beaf-7cae19551af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e24c90a81e4ebbb4fa60930dae3690, user_id=b814e29e3c924bbab538c64cd60808dc, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:22.412206 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b7968-450f-4c2e-beaf-7cae19551af7 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:22.428901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1125/2274] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:58:22 2022] PUT /identity/v3/projects/a5e24c90a81e4ebbb4fa60930dae3690/users/b814e29e3c924bbab538c64cd60808dc/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:22.432951 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fff016-78c7-49fb-8ab7-76985cd67845 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:22.447018 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fff016-78c7-49fb-8ab7-76985cd67845 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:22.507372 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf83db-3ed4-48ca-9b2d-9e337d01e897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:22.507903 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf83db-3ed4-48ca-9b2d-9e337d01e897 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:22.508182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf83db-3ed4-48ca-9b2d-9e337d01e897 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:22.508478 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf83db-3ed4-48ca-9b2d-9e337d01e897 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:22.509142 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf83db-3ed4-48ca-9b2d-9e337d01e897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:22.510898 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf83db-3ed4-48ca-9b2d-9e337d01e897 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:22.521951 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1150/2275] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:58:22.527087 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b7968-450f-4c2e-beaf-7cae19551af7 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:22.538289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b7968-450f-4c2e-beaf-7cae19551af7 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:22.543788 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e4592-85a2-4c13-8b56-d362155d0ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:22.544461 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e4592-85a2-4c13-8b56-d362155d0ed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:22.544741 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e4592-85a2-4c13-8b56-d362155d0ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:22.545013 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e4592-85a2-4c13-8b56-d362155d0ed7 admin admin] PATH_INFO: `/v3/projects/a5e24c90a81e4ebbb4fa60930dae3690/users/b814e29e3c924bbab538c64cd60808dc/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:22.547470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e4592-85a2-4c13-8b56-d362155d0ed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e24c90a81e4ebbb4fa60930dae3690, user_id=b814e29e3c924bbab538c64cd60808dc, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:22.550193 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e4592-85a2-4c13-8b56-d362155d0ed7 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:22.561240 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1126/2276] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:58:22 2022] PUT /identity/v3/projects/a5e24c90a81e4ebbb4fa60930dae3690/users/b814e29e3c924bbab538c64cd60808dc/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:22.577367 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac232329-9803-4620-9753-2fb709fd6355 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:22.577679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac232329-9803-4620-9753-2fb709fd6355 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:22.577955 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac232329-9803-4620-9753-2fb709fd6355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:22.611043 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-ac232329-9803-4620-9753-2fb709fd6355 None None] MFA Rules not processed for user `b814e29e3c924bbab538c64cd60808dc`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:22.612268 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ac232329-9803-4620-9753-2fb709fd6355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:22.632516 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:22.695055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1151/2277] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:22.707120 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e4592-85a2-4c13-8b56-d362155d0ed7 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:22.709163 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5c9e4592-85a2-4c13-8b56-d362155d0ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:22.719627 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:22.771643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e4592-85a2-4c13-8b56-d362155d0ed7 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:22.778442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f568023-8cdf-4bb2-a127-13331a6ca7c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:22.778591 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f568023-8cdf-4bb2-a127-13331a6ca7c0 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:22.778907 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f568023-8cdf-4bb2-a127-13331a6ca7c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:22.779201 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f568023-8cdf-4bb2-a127-13331a6ca7c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:22.790603 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f568023-8cdf-4bb2-a127-13331a6ca7c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:22.792346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f568023-8cdf-4bb2-a127-13331a6ca7c0 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:22.805389 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1127/2278] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:22.899434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac232329-9803-4620-9753-2fb709fd6355 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:22.910330 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac232329-9803-4620-9753-2fb709fd6355 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:22.914197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44618835-0aea-4715-a78d-997fb18215a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:22.914817 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44618835-0aea-4715-a78d-997fb18215a2 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:22.915067 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44618835-0aea-4715-a78d-997fb18215a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:22.915337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44618835-0aea-4715-a78d-997fb18215a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:22.982004 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44618835-0aea-4715-a78d-997fb18215a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:22.983427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44618835-0aea-4715-a78d-997fb18215a2 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:22.992537 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1152/2279] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:23.345995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f568023-8cdf-4bb2-a127-13331a6ca7c0 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:23.347617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-2f568023-8cdf-4bb2-a127-13331a6ca7c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:23.429398 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f568023-8cdf-4bb2-a127-13331a6ca7c0 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:23.435374 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869dc8f-958b-4562-af59-1ec2b8feccf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:23.435977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869dc8f-958b-4562-af59-1ec2b8feccf9 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:23.436252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869dc8f-958b-4562-af59-1ec2b8feccf9 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:23.436502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869dc8f-958b-4562-af59-1ec2b8feccf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:23.438400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7869dc8f-958b-4562-af59-1ec2b8feccf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:23.500722 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869dc8f-958b-4562-af59-1ec2b8feccf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:23.502368 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869dc8f-958b-4562-af59-1ec2b8feccf9 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:23.511628 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1128/2280] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:24.516584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8849bda-4eec-49d3-9b20-30125c81bfcd None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:24.517226 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8849bda-4eec-49d3-9b20-30125c81bfcd None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:24.517553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8849bda-4eec-49d3-9b20-30125c81bfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:24.546386 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-b8849bda-4eec-49d3-9b20-30125c81bfcd None None] MFA Rules not processed for user `e1f49820de264982aeec97fa0be3c290`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:24.548136 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b8849bda-4eec-49d3-9b20-30125c81bfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:24.645329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1153/2281] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 23:58:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:24.763024 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869dc8f-958b-4562-af59-1ec2b8feccf9 service nova] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:24.765893 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7869dc8f-958b-4562-af59-1ec2b8feccf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:24.853432 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:24.884243 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869dc8f-958b-4562-af59-1ec2b8feccf9 service nova] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:24.893469 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38192f-5392-49f8-be56-4f947df66b8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c45ae3144b4fe8ab4e921fda30164a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:24.894508 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38192f-5392-49f8-be56-4f947df66b8b service swift] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:24.894959 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38192f-5392-49f8-be56-4f947df66b8b service swift] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:24.895434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38192f-5392-49f8-be56-4f947df66b8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:24.906707 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38192f-5392-49f8-be56-4f947df66b8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:24.908344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38192f-5392-49f8-be56-4f947df66b8b service swift] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:24.919032 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1129/2282] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 23:58:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:58:30.972875 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8849bda-4eec-49d3-9b20-30125c81bfcd None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:31.070691 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8849bda-4eec-49d3-9b20-30125c81bfcd None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:31.081272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d61db-e8f3-43ad-b22e-9679d84b1c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:31.082717 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d61db-e8f3-43ad-b22e-9679d84b1c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:31.083119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d61db-e8f3-43ad-b22e-9679d84b1c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:31.083494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d61db-e8f3-43ad-b22e-9679d84b1c09 admin admin] PATH_INFO: `/v3/users/7639abc3bdef4df4859d232a4db0275b` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:31.085035 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d61db-e8f3-43ad-b22e-9679d84b1c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7639abc3bdef4df4859d232a4db0275b)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:31.087609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d61db-e8f3-43ad-b22e-9679d84b1c09 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:31.089722 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:31.176652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f77d61db-e8f3-43ad-b22e-9679d84b1c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7639abc3bdef4df4859d232a4db0275b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:31.192596 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f77d61db-e8f3-43ad-b22e-9679d84b1c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7639abc3bdef4df4859d232a4db0275b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:31.223585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f77d61db-e8f3-43ad-b22e-9679d84b1c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7639abc3bdef4df4859d232a4db0275b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:31.249506 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f77d61db-e8f3-43ad-b22e-9679d84b1c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7639abc3bdef4df4859d232a4db0275b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:31.249506 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f77d61db-e8f3-43ad-b22e-9679d84b1c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7639abc3bdef4df4859d232a4db0275b'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:31.259331 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1154/2283] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:58:30 2022] DELETE /identity/v3/users/7639abc3bdef4df4859d232a4db0275b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:31.264994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66c79d-b47e-4f03-9281-92ce55737ba3 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:31.264994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66c79d-b47e-4f03-9281-92ce55737ba3 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:31.265554 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66c79d-b47e-4f03-9281-92ce55737ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:31.292570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-3e66c79d-b47e-4f03-9281-92ce55737ba3 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:31.294294 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-3e66c79d-b47e-4f03-9281-92ce55737ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:31.393429 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1130/2284] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:31.404990 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d61db-e8f3-43ad-b22e-9679d84b1c09 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:31.406817 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-f77d61db-e8f3-43ad-b22e-9679d84b1c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:31.497090 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d61db-e8f3-43ad-b22e-9679d84b1c09 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:31.501106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa77bf-d686-42f4-a54f-bdf5dba9358f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:31.501982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa77bf-d686-42f4-a54f-bdf5dba9358f service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:31.502492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa77bf-d686-42f4-a54f-bdf5dba9358f service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:31.502923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa77bf-d686-42f4-a54f-bdf5dba9358f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:31.515326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa77bf-d686-42f4-a54f-bdf5dba9358f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:31.517060 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa77bf-d686-42f4-a54f-bdf5dba9358f service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:31.529660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1155/2285] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:32.010582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66c79d-b47e-4f03-9281-92ce55737ba3 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:32.012210 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-3e66c79d-b47e-4f03-9281-92ce55737ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:32.035577 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66c79d-b47e-4f03-9281-92ce55737ba3 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:32.043374 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db22365-457c-446f-9488-5358dd371506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:32.044304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db22365-457c-446f-9488-5358dd371506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:32.044620 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db22365-457c-446f-9488-5358dd371506 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:32.044982 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db22365-457c-446f-9488-5358dd371506 admin admin] PATH_INFO: `/v3/projects/f907e260bedc4d14965d2feb7529a76f` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:32.046560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db22365-457c-446f-9488-5358dd371506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f907e260bedc4d14965d2feb7529a76f)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:32.049650 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db22365-457c-446f-9488-5358dd371506 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:32.143655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2db22365-457c-446f-9488-5358dd371506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f907e260bedc4d14965d2feb7529a76f', 'request_id': 'req-2db22365-457c-446f-9488-5358dd371506'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:32.152028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2db22365-457c-446f-9488-5358dd371506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f907e260bedc4d14965d2feb7529a76f', 'request_id': 'req-2db22365-457c-446f-9488-5358dd371506'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:32.163611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2db22365-457c-446f-9488-5358dd371506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f907e260bedc4d14965d2feb7529a76f', 'request_id': 'req-2db22365-457c-446f-9488-5358dd371506'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:32.185260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2db22365-457c-446f-9488-5358dd371506 admin admin] The token cache is being invalidate because project f907e260bedc4d14965d2feb7529a76f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:58:32.185641 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2db22365-457c-446f-9488-5358dd371506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:32.186473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2db22365-457c-446f-9488-5358dd371506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:32.188858 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1131/2286] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:58:32 2022] DELETE /identity/v3/projects/f907e260bedc4d14965d2feb7529a76f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:58:32.195020 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa77bf-d686-42f4-a54f-bdf5dba9358f service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:32.211844 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa77bf-d686-42f4-a54f-bdf5dba9358f service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:32.312685 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0c835-6b18-45ae-9c18-54fc7fa4a1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:32.313641 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0c835-6b18-45ae-9c18-54fc7fa4a1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:32.314131 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0c835-6b18-45ae-9c18-54fc7fa4a1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:32.314513 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0c835-6b18-45ae-9c18-54fc7fa4a1a2 admin admin] PATH_INFO: `/v3/users/b814e29e3c924bbab538c64cd60808dc` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:32.316022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0c835-6b18-45ae-9c18-54fc7fa4a1a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b814e29e3c924bbab538c64cd60808dc)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:32.319864 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0c835-6b18-45ae-9c18-54fc7fa4a1a2 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:32.348638 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:32.388363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-1dc0c835-6b18-45ae-9c18-54fc7fa4a1a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b814e29e3c924bbab538c64cd60808dc'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:32.406307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-1dc0c835-6b18-45ae-9c18-54fc7fa4a1a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b814e29e3c924bbab538c64cd60808dc'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:32.426100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-1dc0c835-6b18-45ae-9c18-54fc7fa4a1a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b814e29e3c924bbab538c64cd60808dc'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:32.455915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-1dc0c835-6b18-45ae-9c18-54fc7fa4a1a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b814e29e3c924bbab538c64cd60808dc'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:32.457403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-1dc0c835-6b18-45ae-9c18-54fc7fa4a1a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b814e29e3c924bbab538c64cd60808dc'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:32.466689 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1156/2287] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:58:32 2022] DELETE /identity/v3/users/b814e29e3c924bbab538c64cd60808dc => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:32.886212 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db22365-457c-446f-9488-5358dd371506 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:32.887767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-2db22365-457c-446f-9488-5358dd371506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:32.916109 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db22365-457c-446f-9488-5358dd371506 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:33.028018 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7f1b6-a7bf-419d-98a6-08acd0c1e2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:33.028745 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f1b6-a7bf-419d-98a6-08acd0c1e2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:33.029024 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f1b6-a7bf-419d-98a6-08acd0c1e2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:33.029480 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f1b6-a7bf-419d-98a6-08acd0c1e2a3 admin admin] PATH_INFO: `/v3/projects/a5e24c90a81e4ebbb4fa60930dae3690` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:33.031311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7f1b6-a7bf-419d-98a6-08acd0c1e2a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e24c90a81e4ebbb4fa60930dae3690)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:33.036602 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7f1b6-a7bf-419d-98a6-08acd0c1e2a3 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:33.039385 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:33.136119 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-16b7f1b6-a7bf-419d-98a6-08acd0c1e2a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e24c90a81e4ebbb4fa60930dae3690', 'request_id': 'req-16b7f1b6-a7bf-419d-98a6-08acd0c1e2a3'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:33.147656 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-16b7f1b6-a7bf-419d-98a6-08acd0c1e2a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e24c90a81e4ebbb4fa60930dae3690', 'request_id': 'req-16b7f1b6-a7bf-419d-98a6-08acd0c1e2a3'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:33.165114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-16b7f1b6-a7bf-419d-98a6-08acd0c1e2a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e24c90a81e4ebbb4fa60930dae3690', 'request_id': 'req-16b7f1b6-a7bf-419d-98a6-08acd0c1e2a3'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:33.189881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-16b7f1b6-a7bf-419d-98a6-08acd0c1e2a3 admin admin] The token cache is being invalidate because project a5e24c90a81e4ebbb4fa60930dae3690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:58:33.190218 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-16b7f1b6-a7bf-419d-98a6-08acd0c1e2a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:33.191266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-16b7f1b6-a7bf-419d-98a6-08acd0c1e2a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:33.195434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1132/2288] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:58:32 2022] DELETE /identity/v3/projects/a5e24c90a81e4ebbb4fa60930dae3690 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:33.203269 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8015b3-8686-4ded-8234-e888a7797a45 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:33.203852 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8015b3-8686-4ded-8234-e888a7797a45 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:33.203852 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8015b3-8686-4ded-8234-e888a7797a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:33.234347 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-ef8015b3-8686-4ded-8234-e888a7797a45 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:33.236033 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ef8015b3-8686-4ded-8234-e888a7797a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:33.365903 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1157/2289] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:33.374461 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaadc20-e8ca-4f0e-8f72-99356d1efefd None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:33.374822 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaadc20-e8ca-4f0e-8f72-99356d1efefd None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:33.375175 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaadc20-e8ca-4f0e-8f72-99356d1efefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:33.399009 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-7aaadc20-e8ca-4f0e-8f72-99356d1efefd None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:33.400449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7aaadc20-e8ca-4f0e-8f72-99356d1efefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:33.413195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1133/2290] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:33.417840 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8015b3-8686-4ded-8234-e888a7797a45 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:33.434611 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8015b3-8686-4ded-8234-e888a7797a45 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:33.459435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bac0d-ffcf-412f-b21f-ee0bc27da8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:33.459435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bac0d-ffcf-412f-b21f-ee0bc27da8ab admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:33.459435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bac0d-ffcf-412f-b21f-ee0bc27da8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:33.459981 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bac0d-ffcf-412f-b21f-ee0bc27da8ab admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:33.460361 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bac0d-ffcf-412f-b21f-ee0bc27da8ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:58:33.460670 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bac0d-ffcf-412f-b21f-ee0bc27da8ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:33.470586 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bac0d-ffcf-412f-b21f-ee0bc27da8ab admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:33.499792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1158/2291] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:58:33.505751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaadc20-e8ca-4f0e-8f72-99356d1efefd None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:33.517109 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaadc20-e8ca-4f0e-8f72-99356d1efefd None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:33.530759 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005344d-3285-4f30-ad02-793defadd4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:33.531965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005344d-3285-4f30-ad02-793defadd4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:33.532590 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005344d-3285-4f30-ad02-793defadd4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:33.533135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005344d-3285-4f30-ad02-793defadd4e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:33.534290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005344d-3285-4f30-ad02-793defadd4e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:33.539647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005344d-3285-4f30-ad02-793defadd4e2 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:33.589821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1134/2292] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:58:33 2022] POST /identity/v3/projects => generated 363 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:58:33.594876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bac0d-ffcf-412f-b21f-ee0bc27da8ab admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:33.612721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bac0d-ffcf-412f-b21f-ee0bc27da8ab admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:33.684836 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71552d1b-8543-49d7-826b-9776702ef69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:33.685727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71552d1b-8543-49d7-826b-9776702ef69a admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:33.686199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71552d1b-8543-49d7-826b-9776702ef69a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:33.686501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71552d1b-8543-49d7-826b-9776702ef69a admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:33.687454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71552d1b-8543-49d7-826b-9776702ef69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:33.689967 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71552d1b-8543-49d7-826b-9776702ef69a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:33.730381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005344d-3285-4f30-ad02-793defadd4e2 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:33.732578 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1159/2293] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:58:33 2022] POST /identity/v3/users => generated 282 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:58:33.758332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005344d-3285-4f30-ad02-793defadd4e2 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:33.771806 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86406dbf-5460-4d66-9a5d-34dd2ecec5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:33.773087 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86406dbf-5460-4d66-9a5d-34dd2ecec5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:33.773536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86406dbf-5460-4d66-9a5d-34dd2ecec5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:33.774044 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86406dbf-5460-4d66-9a5d-34dd2ecec5e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:33.774784 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86406dbf-5460-4d66-9a5d-34dd2ecec5e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:33.776908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86406dbf-5460-4d66-9a5d-34dd2ecec5e0 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:33.805794 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1135/2294] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:58:33.806514 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71552d1b-8543-49d7-826b-9776702ef69a admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:33.821835 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71552d1b-8543-49d7-826b-9776702ef69a admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:33.837707 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1443c9-1009-4ea6-916d-90a3a58ccb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:33.838524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1443c9-1009-4ea6-916d-90a3a58ccb48 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:33.838863 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1443c9-1009-4ea6-916d-90a3a58ccb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:33.839198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1443c9-1009-4ea6-916d-90a3a58ccb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:33.840066 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1443c9-1009-4ea6-916d-90a3a58ccb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:33.841837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1443c9-1009-4ea6-916d-90a3a58ccb48 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:33.863848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1160/2295] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:58:33.865114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86406dbf-5460-4d66-9a5d-34dd2ecec5e0 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:33.876564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86406dbf-5460-4d66-9a5d-34dd2ecec5e0 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:33.886445 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1103af-242e-489f-b862-363c1a3b70bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:33.887545 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1103af-242e-489f-b862-363c1a3b70bb admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:33.887961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1103af-242e-489f-b862-363c1a3b70bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:33.888126 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1103af-242e-489f-b862-363c1a3b70bb admin admin] PATH_INFO: `/v3/projects/6a77354a2bbe49e4992d4b7a26eb2408/users/3cf7155cada447a2a19a0f8ac33016cf/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:33.933578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1103af-242e-489f-b862-363c1a3b70bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a77354a2bbe49e4992d4b7a26eb2408, user_id=3cf7155cada447a2a19a0f8ac33016cf, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:33.935943 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1103af-242e-489f-b862-363c1a3b70bb admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:33.954720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1136/2296] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:58:33 2022] PUT /identity/v3/projects/6a77354a2bbe49e4992d4b7a26eb2408/users/3cf7155cada447a2a19a0f8ac33016cf/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:33.965956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fa990-8603-4497-9938-65763122599e None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:33.966636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fa990-8603-4497-9938-65763122599e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:33.967156 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fa990-8603-4497-9938-65763122599e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:33.991768 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:34.011968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-658fa990-8603-4497-9938-65763122599e None None] MFA Rules not processed for user `3cf7155cada447a2a19a0f8ac33016cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:34.013247 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-658fa990-8603-4497-9938-65763122599e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:34.255169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1161/2297] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:34.261883 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1103af-242e-489f-b862-363c1a3b70bb admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:34.354781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1103af-242e-489f-b862-363c1a3b70bb admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:34.360388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03f219-fd21-4534-833d-54a309ee7d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:34.361136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03f219-fd21-4534-833d-54a309ee7d18 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:34.361479 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03f219-fd21-4534-833d-54a309ee7d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:34.361830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03f219-fd21-4534-833d-54a309ee7d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:34.362616 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03f219-fd21-4534-833d-54a309ee7d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:34.364753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03f219-fd21-4534-833d-54a309ee7d18 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:34.409380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1137/2298] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:58:34 2022] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:58:34.414502 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fa990-8603-4497-9938-65763122599e None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:34.427681 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fa990-8603-4497-9938-65763122599e None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:34.514880 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317234d3-cf53-4381-84e2-b6b68ffdf203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:34.515789 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317234d3-cf53-4381-84e2-b6b68ffdf203 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:34.516301 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317234d3-cf53-4381-84e2-b6b68ffdf203 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:34.516773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317234d3-cf53-4381-84e2-b6b68ffdf203 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:34.517963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317234d3-cf53-4381-84e2-b6b68ffdf203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:34.521090 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317234d3-cf53-4381-84e2-b6b68ffdf203 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:34.572193 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1162/2299] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:58:34 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:58:34.576381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03f219-fd21-4534-833d-54a309ee7d18 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:34.593786 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03f219-fd21-4534-833d-54a309ee7d18 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:34.607041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a958ddd-f512-49d4-838b-0b49f6a7caca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:34.608129 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a958ddd-f512-49d4-838b-0b49f6a7caca admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:34.609076 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a958ddd-f512-49d4-838b-0b49f6a7caca admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:34.609925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a958ddd-f512-49d4-838b-0b49f6a7caca admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:34.611756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a958ddd-f512-49d4-838b-0b49f6a7caca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:34.613963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a958ddd-f512-49d4-838b-0b49f6a7caca admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:34.623389 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:34.640691 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317234d3-cf53-4381-84e2-b6b68ffdf203 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:34.651473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1138/2300] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:58:34.678406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317234d3-cf53-4381-84e2-b6b68ffdf203 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:34.690526 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00109120-0c52-422f-a953-53992573dbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:34.693293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00109120-0c52-422f-a953-53992573dbaa admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:34.694443 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00109120-0c52-422f-a953-53992573dbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:34.695573 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00109120-0c52-422f-a953-53992573dbaa admin admin] PATH_INFO: `/v3/projects/32267317c5b64ac78f327b8eac1d736c/users/f01661e7d89f44e79476d34b7979eea9/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:34.748262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00109120-0c52-422f-a953-53992573dbaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=32267317c5b64ac78f327b8eac1d736c, user_id=f01661e7d89f44e79476d34b7979eea9, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:34.751441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00109120-0c52-422f-a953-53992573dbaa admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:34.793246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1163/2301] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:58:34 2022] PUT /identity/v3/projects/32267317c5b64ac78f327b8eac1d736c/users/f01661e7d89f44e79476d34b7979eea9/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:34.794827 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a958ddd-f512-49d4-838b-0b49f6a7caca admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:34.814593 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a958ddd-f512-49d4-838b-0b49f6a7caca admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:34.915991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162e3e5-f78e-43e8-9ff8-a158e7e49e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:34.917388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162e3e5-f78e-43e8-9ff8-a158e7e49e48 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:34.917705 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162e3e5-f78e-43e8-9ff8-a158e7e49e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:34.917919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162e3e5-f78e-43e8-9ff8-a158e7e49e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:34.918581 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162e3e5-f78e-43e8-9ff8-a158e7e49e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:34.920393 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162e3e5-f78e-43e8-9ff8-a158e7e49e48 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:34.934843 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1139/2302] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:58:34.940221 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00109120-0c52-422f-a953-53992573dbaa admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:34.974380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00109120-0c52-422f-a953-53992573dbaa admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:34.990952 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66c752-2ca0-45cb-8339-f2fe06baeed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:34.992565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66c752-2ca0-45cb-8339-f2fe06baeed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:34.994308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66c752-2ca0-45cb-8339-f2fe06baeed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:34.995134 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66c752-2ca0-45cb-8339-f2fe06baeed2 admin admin] PATH_INFO: `/v3/projects/32267317c5b64ac78f327b8eac1d736c/users/f01661e7d89f44e79476d34b7979eea9/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:34.998827 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66c752-2ca0-45cb-8339-f2fe06baeed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32267317c5b64ac78f327b8eac1d736c, user_id=f01661e7d89f44e79476d34b7979eea9, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:35.002674 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66c752-2ca0-45cb-8339-f2fe06baeed2 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:35.016367 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1164/2303] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:58:34 2022] PUT /identity/v3/projects/32267317c5b64ac78f327b8eac1d736c/users/f01661e7d89f44e79476d34b7979eea9/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:35.028898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecd394-9e91-422e-a0ae-11428a9dc853 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:35.029246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecd394-9e91-422e-a0ae-11428a9dc853 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:35.029548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecd394-9e91-422e-a0ae-11428a9dc853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:35.084497 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-77ecd394-9e91-422e-a0ae-11428a9dc853 None None] MFA Rules not processed for user `f01661e7d89f44e79476d34b7979eea9`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:35.091514 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-77ecd394-9e91-422e-a0ae-11428a9dc853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:35.277762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1140/2304] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:35.291743 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66c752-2ca0-45cb-8339-f2fe06baeed2 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:35.294465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1c66c752-2ca0-45cb-8339-f2fe06baeed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:35.372572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:35.377648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66c752-2ca0-45cb-8339-f2fe06baeed2 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:35.383773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef907a37-b5ce-41cc-b95a-d44b18169b48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:35.385188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef907a37-b5ce-41cc-b95a-d44b18169b48 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:35.385682 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef907a37-b5ce-41cc-b95a-d44b18169b48 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:35.386284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef907a37-b5ce-41cc-b95a-d44b18169b48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:35.397786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef907a37-b5ce-41cc-b95a-d44b18169b48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:35.399738 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef907a37-b5ce-41cc-b95a-d44b18169b48 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:35.412963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1165/2305] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:58:35.547937 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecd394-9e91-422e-a0ae-11428a9dc853 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:35.560319 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecd394-9e91-422e-a0ae-11428a9dc853 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:35.565662 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1b9ee-c081-42bd-a721-21dc305521e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:35.566112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1b9ee-c081-42bd-a721-21dc305521e2 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:35.566394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1b9ee-c081-42bd-a721-21dc305521e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:35.566779 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1b9ee-c081-42bd-a721-21dc305521e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:35.652205 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1b9ee-c081-42bd-a721-21dc305521e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:35.653858 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1b9ee-c081-42bd-a721-21dc305521e2 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:35.664398 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1141/2306] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:38.488100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef907a37-b5ce-41cc-b95a-d44b18169b48 service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:38.559738 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef907a37-b5ce-41cc-b95a-d44b18169b48 service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:38.565307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5828a9f-5a87-46b7-a6de-cd2d87da15a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:38.565968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5828a9f-5a87-46b7-a6de-cd2d87da15a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:38.566246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5828a9f-5a87-46b7-a6de-cd2d87da15a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:38.566524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5828a9f-5a87-46b7-a6de-cd2d87da15a9 admin admin] PATH_INFO: `/v3/users/3cf7155cada447a2a19a0f8ac33016cf` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:38.567688 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5828a9f-5a87-46b7-a6de-cd2d87da15a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf7155cada447a2a19a0f8ac33016cf)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:38.569648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5828a9f-5a87-46b7-a6de-cd2d87da15a9 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:38.618162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a5828a9f-5a87-46b7-a6de-cd2d87da15a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf7155cada447a2a19a0f8ac33016cf'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:38.625190 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a5828a9f-5a87-46b7-a6de-cd2d87da15a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf7155cada447a2a19a0f8ac33016cf'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:38.639363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a5828a9f-5a87-46b7-a6de-cd2d87da15a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf7155cada447a2a19a0f8ac33016cf'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:38.647711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a5828a9f-5a87-46b7-a6de-cd2d87da15a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf7155cada447a2a19a0f8ac33016cf'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:38.648427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a5828a9f-5a87-46b7-a6de-cd2d87da15a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf7155cada447a2a19a0f8ac33016cf'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:38.654995 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1166/2307] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:58:38 2022] DELETE /identity/v3/users/3cf7155cada447a2a19a0f8ac33016cf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:38.659856 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620ca34-9c45-4063-bbb1-4f71be29a3db None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:38.660467 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620ca34-9c45-4063-bbb1-4f71be29a3db None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:38.660740 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620ca34-9c45-4063-bbb1-4f71be29a3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:38.682367 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-f620ca34-9c45-4063-bbb1-4f71be29a3db None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:38.683618 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f620ca34-9c45-4063-bbb1-4f71be29a3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:38.699184 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:38.750697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1142/2308] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:38.760252 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5828a9f-5a87-46b7-a6de-cd2d87da15a9 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:38.761895 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a5828a9f-5a87-46b7-a6de-cd2d87da15a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:38.822697 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5828a9f-5a87-46b7-a6de-cd2d87da15a9 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:38.826883 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114a7b9-d29f-407e-b2ec-820c32b72d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:38.827768 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114a7b9-d29f-407e-b2ec-820c32b72d1e service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:38.828219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114a7b9-d29f-407e-b2ec-820c32b72d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:38.828460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114a7b9-d29f-407e-b2ec-820c32b72d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:38.840725 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114a7b9-d29f-407e-b2ec-820c32b72d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:38.842224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114a7b9-d29f-407e-b2ec-820c32b72d1e service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:38.852532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1167/2309] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:39.193326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620ca34-9c45-4063-bbb1-4f71be29a3db None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:39.196149 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f620ca34-9c45-4063-bbb1-4f71be29a3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:39.216075 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620ca34-9c45-4063-bbb1-4f71be29a3db None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:39.224302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05337d49-2369-4993-b77a-00c403cb6009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:39.224891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05337d49-2369-4993-b77a-00c403cb6009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:39.226572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05337d49-2369-4993-b77a-00c403cb6009 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:39.226864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05337d49-2369-4993-b77a-00c403cb6009 admin admin] PATH_INFO: `/v3/projects/6a77354a2bbe49e4992d4b7a26eb2408` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:39.228676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05337d49-2369-4993-b77a-00c403cb6009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a77354a2bbe49e4992d4b7a26eb2408)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:39.231621 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05337d49-2369-4993-b77a-00c403cb6009 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:39.303599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-05337d49-2369-4993-b77a-00c403cb6009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a77354a2bbe49e4992d4b7a26eb2408', 'request_id': 'req-05337d49-2369-4993-b77a-00c403cb6009'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:39.310073 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-05337d49-2369-4993-b77a-00c403cb6009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a77354a2bbe49e4992d4b7a26eb2408', 'request_id': 'req-05337d49-2369-4993-b77a-00c403cb6009'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:39.318587 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-05337d49-2369-4993-b77a-00c403cb6009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a77354a2bbe49e4992d4b7a26eb2408', 'request_id': 'req-05337d49-2369-4993-b77a-00c403cb6009'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:39.332230 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-05337d49-2369-4993-b77a-00c403cb6009 admin admin] The token cache is being invalidate because project 6a77354a2bbe49e4992d4b7a26eb2408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:58:39.332532 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-05337d49-2369-4993-b77a-00c403cb6009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:39.333255 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-05337d49-2369-4993-b77a-00c403cb6009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:39.338172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1143/2310] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:58:39 2022] DELETE /identity/v3/projects/6a77354a2bbe49e4992d4b7a26eb2408 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:39.339408 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114a7b9-d29f-407e-b2ec-820c32b72d1e service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:39.350461 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114a7b9-d29f-407e-b2ec-820c32b72d1e service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:39.360096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:39.410922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d633e-1e80-49ca-8589-8142a2acf5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:39.411576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d633e-1e80-49ca-8589-8142a2acf5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:39.411855 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d633e-1e80-49ca-8589-8142a2acf5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:39.412155 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d633e-1e80-49ca-8589-8142a2acf5c3 admin admin] PATH_INFO: `/v3/users/f01661e7d89f44e79476d34b7979eea9` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:39.413353 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d633e-1e80-49ca-8589-8142a2acf5c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01661e7d89f44e79476d34b7979eea9)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:39.415337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d633e-1e80-49ca-8589-8142a2acf5c3 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:39.471500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2a2d633e-1e80-49ca-8589-8142a2acf5c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01661e7d89f44e79476d34b7979eea9'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:39.483918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2a2d633e-1e80-49ca-8589-8142a2acf5c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01661e7d89f44e79476d34b7979eea9'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:39.498899 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2a2d633e-1e80-49ca-8589-8142a2acf5c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01661e7d89f44e79476d34b7979eea9'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:39.508200 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2a2d633e-1e80-49ca-8589-8142a2acf5c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01661e7d89f44e79476d34b7979eea9'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:39.508879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2a2d633e-1e80-49ca-8589-8142a2acf5c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01661e7d89f44e79476d34b7979eea9'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:39.516240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1168/2311] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:58:39 2022] DELETE /identity/v3/users/f01661e7d89f44e79476d34b7979eea9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:39.808688 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05337d49-2369-4993-b77a-00c403cb6009 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:39.810240 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-05337d49-2369-4993-b77a-00c403cb6009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:39.823629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05337d49-2369-4993-b77a-00c403cb6009 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:39.884258 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34cc84-541b-4d99-876a-cfd203fc44fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:39.884949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34cc84-541b-4d99-876a-cfd203fc44fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:39.885233 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34cc84-541b-4d99-876a-cfd203fc44fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:39.885548 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34cc84-541b-4d99-876a-cfd203fc44fe admin admin] PATH_INFO: `/v3/projects/32267317c5b64ac78f327b8eac1d736c` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:39.886724 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34cc84-541b-4d99-876a-cfd203fc44fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=32267317c5b64ac78f327b8eac1d736c)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:39.888762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34cc84-541b-4d99-876a-cfd203fc44fe admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:39.940316 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:39.942276 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cf34cc84-541b-4d99-876a-cfd203fc44fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32267317c5b64ac78f327b8eac1d736c', 'request_id': 'req-cf34cc84-541b-4d99-876a-cfd203fc44fe'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:39.951588 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cf34cc84-541b-4d99-876a-cfd203fc44fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32267317c5b64ac78f327b8eac1d736c', 'request_id': 'req-cf34cc84-541b-4d99-876a-cfd203fc44fe'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:39.963183 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cf34cc84-541b-4d99-876a-cfd203fc44fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32267317c5b64ac78f327b8eac1d736c', 'request_id': 'req-cf34cc84-541b-4d99-876a-cfd203fc44fe'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:39.983821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cf34cc84-541b-4d99-876a-cfd203fc44fe admin admin] The token cache is being invalidate because project 32267317c5b64ac78f327b8eac1d736c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:58:39.984347 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cf34cc84-541b-4d99-876a-cfd203fc44fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:39.985075 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cf34cc84-541b-4d99-876a-cfd203fc44fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:39.987234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1144/2312] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:58:39 2022] DELETE /identity/v3/projects/32267317c5b64ac78f327b8eac1d736c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:39.992164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3827c4-5613-4aae-8e03-9853b86502f0 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:39.992455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3827c4-5613-4aae-8e03-9853b86502f0 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:39.992729 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3827c4-5613-4aae-8e03-9853b86502f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:40.013887 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-bb3827c4-5613-4aae-8e03-9853b86502f0 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:40.015123 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-bb3827c4-5613-4aae-8e03-9853b86502f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:40.089563 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1169/2313] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:40.092328 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cce0c1-5794-4c68-8bf2-7a9d68620e12 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:40.092608 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cce0c1-5794-4c68-8bf2-7a9d68620e12 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:40.092880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cce0c1-5794-4c68-8bf2-7a9d68620e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:40.115368 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-f8cce0c1-5794-4c68-8bf2-7a9d68620e12 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:40.116703 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f8cce0c1-5794-4c68-8bf2-7a9d68620e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:40.125461 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1145/2314] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:40.129735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3827c4-5613-4aae-8e03-9853b86502f0 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:40.140425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3827c4-5613-4aae-8e03-9853b86502f0 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:40.145704 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedf6d5-49cb-417b-976c-da49453d328e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:40.146464 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf6d5-49cb-417b-976c-da49453d328e admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:40.146853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf6d5-49cb-417b-976c-da49453d328e admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:40.147353 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedf6d5-49cb-417b-976c-da49453d328e admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:40.148081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedf6d5-49cb-417b-976c-da49453d328e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:58:40.148568 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedf6d5-49cb-417b-976c-da49453d328e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:40.150315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acedf6d5-49cb-417b-976c-da49453d328e admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:40.168754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1170/2315] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:58:40.170350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cce0c1-5794-4c68-8bf2-7a9d68620e12 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:40.183313 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cce0c1-5794-4c68-8bf2-7a9d68620e12 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:40.189602 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ad9f9-93af-4f32-aead-6aebd8fb505d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:40.190292 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ad9f9-93af-4f32-aead-6aebd8fb505d admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:40.190573 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ad9f9-93af-4f32-aead-6aebd8fb505d admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:40.190841 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ad9f9-93af-4f32-aead-6aebd8fb505d admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:40.192242 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ad9f9-93af-4f32-aead-6aebd8fb505d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:40.194337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ad9f9-93af-4f32-aead-6aebd8fb505d admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:40.229476 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1146/2316] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:58:40 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:58:40.231060 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedf6d5-49cb-417b-976c-da49453d328e admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:40.244537 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedf6d5-49cb-417b-976c-da49453d328e admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:40.268065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:40.328142 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68798c4b-4de2-42a6-8a3c-0a63fa53aff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:40.328929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68798c4b-4de2-42a6-8a3c-0a63fa53aff7 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:40.329214 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68798c4b-4de2-42a6-8a3c-0a63fa53aff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:40.329513 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68798c4b-4de2-42a6-8a3c-0a63fa53aff7 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:40.330328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68798c4b-4de2-42a6-8a3c-0a63fa53aff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:40.332153 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68798c4b-4de2-42a6-8a3c-0a63fa53aff7 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:40.369121 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ad9f9-93af-4f32-aead-6aebd8fb505d admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:40.377513 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1171/2317] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:58:40 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:58:40.391198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ad9f9-93af-4f32-aead-6aebd8fb505d admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:40.395940 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fc376-f7e2-4254-935e-1229725e6979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:40.396564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fc376-f7e2-4254-935e-1229725e6979 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:40.396836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fc376-f7e2-4254-935e-1229725e6979 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:40.397256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fc376-f7e2-4254-935e-1229725e6979 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:40.397977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fc376-f7e2-4254-935e-1229725e6979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:40.399854 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fc376-f7e2-4254-935e-1229725e6979 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:40.411497 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1147/2318] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:58:40.415984 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68798c4b-4de2-42a6-8a3c-0a63fa53aff7 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:40.426728 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68798c4b-4de2-42a6-8a3c-0a63fa53aff7 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:40.440544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fa297-32c3-4380-93b3-6a7a1c16436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:40.441266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fa297-32c3-4380-93b3-6a7a1c16436c admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:40.441787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fa297-32c3-4380-93b3-6a7a1c16436c admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:40.442090 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fa297-32c3-4380-93b3-6a7a1c16436c admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:40.442831 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fa297-32c3-4380-93b3-6a7a1c16436c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:40.444539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fa297-32c3-4380-93b3-6a7a1c16436c admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:40.462633 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1172/2319] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:58:40.463326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fc376-f7e2-4254-935e-1229725e6979 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:40.475142 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fc376-f7e2-4254-935e-1229725e6979 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:40.483850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ebcd6-678b-4502-a3e9-f48c080629ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:40.484906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ebcd6-678b-4502-a3e9-f48c080629ef admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:40.485165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ebcd6-678b-4502-a3e9-f48c080629ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:40.485536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ebcd6-678b-4502-a3e9-f48c080629ef admin admin] PATH_INFO: `/v3/projects/53753429f63443808e745445ce87b30f/users/6c74fd82bc494f83b232c4d68480b4bb/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:40.509745 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ebcd6-678b-4502-a3e9-f48c080629ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=53753429f63443808e745445ce87b30f, user_id=6c74fd82bc494f83b232c4d68480b4bb, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:40.512603 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ebcd6-678b-4502-a3e9-f48c080629ef admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:40.527382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1148/2320] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:58:40 2022] PUT /identity/v3/projects/53753429f63443808e745445ce87b30f/users/6c74fd82bc494f83b232c4d68480b4bb/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:40.539180 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602ae0f-56aa-4bfd-9550-31440a801a56 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:40.539698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602ae0f-56aa-4bfd-9550-31440a801a56 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:40.539698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602ae0f-56aa-4bfd-9550-31440a801a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:40.573152 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-0602ae0f-56aa-4bfd-9550-31440a801a56 None None] MFA Rules not processed for user `6c74fd82bc494f83b232c4d68480b4bb`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:40.574428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0602ae0f-56aa-4bfd-9550-31440a801a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:40.643560 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1173/2321] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:40.648271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ebcd6-678b-4502-a3e9-f48c080629ef admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:40.715017 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ebcd6-678b-4502-a3e9-f48c080629ef admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:40.720047 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50616b3b-bb51-4146-8da1-6d056bb1b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:40.720705 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50616b3b-bb51-4146-8da1-6d056bb1b7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:40.720953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50616b3b-bb51-4146-8da1-6d056bb1b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:40.721238 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50616b3b-bb51-4146-8da1-6d056bb1b7e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:40.721978 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50616b3b-bb51-4146-8da1-6d056bb1b7e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:40.723899 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50616b3b-bb51-4146-8da1-6d056bb1b7e4 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:40.760730 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1149/2322] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:58:40 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:58:40.762051 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602ae0f-56aa-4bfd-9550-31440a801a56 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:40.773246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602ae0f-56aa-4bfd-9550-31440a801a56 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:40.834403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c2e1a-022d-49be-b9d4-b63e24211cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:40.835080 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c2e1a-022d-49be-b9d4-b63e24211cbf admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:40.835470 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c2e1a-022d-49be-b9d4-b63e24211cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:40.835746 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c2e1a-022d-49be-b9d4-b63e24211cbf admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:40.836403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c2e1a-022d-49be-b9d4-b63e24211cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:40.838434 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c2e1a-022d-49be-b9d4-b63e24211cbf admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:40.868420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1174/2323] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:58:40 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:58:40.869764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50616b3b-bb51-4146-8da1-6d056bb1b7e4 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:40.881761 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50616b3b-bb51-4146-8da1-6d056bb1b7e4 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:40.886680 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c859deb-e5f0-4a87-a360-2eb908f4e7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:40.887339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c859deb-e5f0-4a87-a360-2eb908f4e7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:40.887720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c859deb-e5f0-4a87-a360-2eb908f4e7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:40.887880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c859deb-e5f0-4a87-a360-2eb908f4e7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:40.888527 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c859deb-e5f0-4a87-a360-2eb908f4e7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:40.890209 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c859deb-e5f0-4a87-a360-2eb908f4e7f7 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:40.901465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1150/2324] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:58:40.906056 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c2e1a-022d-49be-b9d4-b63e24211cbf admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:40.916290 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c2e1a-022d-49be-b9d4-b63e24211cbf admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:40.920999 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770487f4-f55d-48c0-a3b7-535d392b75d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:40.921763 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770487f4-f55d-48c0-a3b7-535d392b75d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:40.922395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770487f4-f55d-48c0-a3b7-535d392b75d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:40.922663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770487f4-f55d-48c0-a3b7-535d392b75d1 admin admin] PATH_INFO: `/v3/projects/38cce4b273c548e5986678fddb4858e4/users/4b1ed17a2dc847a28b84248a42880166/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:40.940048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770487f4-f55d-48c0-a3b7-535d392b75d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38cce4b273c548e5986678fddb4858e4, user_id=4b1ed17a2dc847a28b84248a42880166, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:40.942896 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770487f4-f55d-48c0-a3b7-535d392b75d1 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:40.945152 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:40.957833 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1175/2325] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:58:40 2022] PUT /identity/v3/projects/38cce4b273c548e5986678fddb4858e4/users/4b1ed17a2dc847a28b84248a42880166/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:40.962014 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c859deb-e5f0-4a87-a360-2eb908f4e7f7 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:40.972278 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c859deb-e5f0-4a87-a360-2eb908f4e7f7 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:40.986111 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770487f4-f55d-48c0-a3b7-535d392b75d1 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:40.987872 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-770487f4-f55d-48c0-a3b7-535d392b75d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:41.022492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:41.039245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eea511-34cc-4fc1-a033-35635a1a4ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:41.040454 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eea511-34cc-4fc1-a033-35635a1a4ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:41.041007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eea511-34cc-4fc1-a033-35635a1a4ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:41.041504 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eea511-34cc-4fc1-a033-35635a1a4ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:41.042037 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eea511-34cc-4fc1-a033-35635a1a4ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:41.043746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eea511-34cc-4fc1-a033-35635a1a4ab5 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:41.057096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770487f4-f55d-48c0-a3b7-535d392b75d1 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:41.057632 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1151/2326] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:58:41.061125 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31827ec-d573-4aaf-b9c7-6b4ee9804250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:41.061510 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eea511-34cc-4fc1-a033-35635a1a4ab5 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:41.061781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31827ec-d573-4aaf-b9c7-6b4ee9804250 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:41.062061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31827ec-d573-4aaf-b9c7-6b4ee9804250 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:41.062334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31827ec-d573-4aaf-b9c7-6b4ee9804250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:41.064153 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a31827ec-d573-4aaf-b9c7-6b4ee9804250 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:41.074184 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eea511-34cc-4fc1-a033-35635a1a4ab5 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:41.074417 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31827ec-d573-4aaf-b9c7-6b4ee9804250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:41.075819 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31827ec-d573-4aaf-b9c7-6b4ee9804250 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:41.079778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680c237-bad5-49ba-a75c-87026070d93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:41.080773 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680c237-bad5-49ba-a75c-87026070d93a admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:41.080773 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680c237-bad5-49ba-a75c-87026070d93a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:41.080976 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680c237-bad5-49ba-a75c-87026070d93a admin admin] PATH_INFO: `/v3/projects/38cce4b273c548e5986678fddb4858e4/users/4b1ed17a2dc847a28b84248a42880166/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:41.083000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680c237-bad5-49ba-a75c-87026070d93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=38cce4b273c548e5986678fddb4858e4, user_id=4b1ed17a2dc847a28b84248a42880166, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:41.084540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1176/2327] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:58:41.085920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680c237-bad5-49ba-a75c-87026070d93a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:41.097707 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1152/2328] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:58:41 2022] PUT /identity/v3/projects/38cce4b273c548e5986678fddb4858e4/users/4b1ed17a2dc847a28b84248a42880166/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:58:41.108642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9880ce-fa9e-4a84-ad75-2804e97fa31e None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:41.108939 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9880ce-fa9e-4a84-ad75-2804e97fa31e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:41.109214 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9880ce-fa9e-4a84-ad75-2804e97fa31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:41.138428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-7e9880ce-fa9e-4a84-ad75-2804e97fa31e None None] MFA Rules not processed for user `4b1ed17a2dc847a28b84248a42880166`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:41.139691 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-7e9880ce-fa9e-4a84-ad75-2804e97fa31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:41.223580 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1177/2329] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:41.240599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680c237-bad5-49ba-a75c-87026070d93a admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:41.244282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e680c237-bad5-49ba-a75c-87026070d93a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:41.338533 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680c237-bad5-49ba-a75c-87026070d93a admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:41.344771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf797397-4beb-4a36-ad96-665c1b842469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:41.345710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf797397-4beb-4a36-ad96-665c1b842469 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:41.346130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf797397-4beb-4a36-ad96-665c1b842469 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:41.347101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf797397-4beb-4a36-ad96-665c1b842469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:41.364907 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf797397-4beb-4a36-ad96-665c1b842469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:41.367849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf797397-4beb-4a36-ad96-665c1b842469 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:41.386472 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1153/2330] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:41.469453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9880ce-fa9e-4a84-ad75-2804e97fa31e None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:41.486958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf797397-4beb-4a36-ad96-665c1b842469 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:41.488720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-bf797397-4beb-4a36-ad96-665c1b842469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:41.563668 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9880ce-fa9e-4a84-ad75-2804e97fa31e None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:41.569201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da8bd5-6c8b-4b9e-8af3-ef53fa976e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:41.570016 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da8bd5-6c8b-4b9e-8af3-ef53fa976e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:41.570413 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da8bd5-6c8b-4b9e-8af3-ef53fa976e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:41.570730 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da8bd5-6c8b-4b9e-8af3-ef53fa976e54 admin admin] PATH_INFO: `/v3/users/6c74fd82bc494f83b232c4d68480b4bb` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:41.571739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da8bd5-6c8b-4b9e-8af3-ef53fa976e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c74fd82bc494f83b232c4d68480b4bb)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:41.573932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da8bd5-6c8b-4b9e-8af3-ef53fa976e54 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:41.582467 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf797397-4beb-4a36-ad96-665c1b842469 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:41.589838 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ceffd-90fa-454a-a1b8-b4d8e6eee7d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4395ee0a00df41adacb55b4a8684786b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:41.590507 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ceffd-90fa-454a-a1b8-b4d8e6eee7d5 service placement] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:41.590871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ceffd-90fa-454a-a1b8-b4d8e6eee7d5 service placement] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:41.591143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ceffd-90fa-454a-a1b8-b4d8e6eee7d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:41.593736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ee6ceffd-90fa-454a-a1b8-b4d8e6eee7d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:41.604726 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:INSERT=1,keystone:SELECT=95,keystone:DELETE=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:41.611104 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ceffd-90fa-454a-a1b8-b4d8e6eee7d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:41.614009 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ceffd-90fa-454a-a1b8-b4d8e6eee7d5 service placement] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:41.626919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1154/2331] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:58:41.633617 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-52da8bd5-6c8b-4b9e-8af3-ef53fa976e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c74fd82bc494f83b232c4d68480b4bb'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:41.641564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-52da8bd5-6c8b-4b9e-8af3-ef53fa976e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c74fd82bc494f83b232c4d68480b4bb'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:41.658741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-52da8bd5-6c8b-4b9e-8af3-ef53fa976e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c74fd82bc494f83b232c4d68480b4bb'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:41.669543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-52da8bd5-6c8b-4b9e-8af3-ef53fa976e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c74fd82bc494f83b232c4d68480b4bb'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:41.670275 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-52da8bd5-6c8b-4b9e-8af3-ef53fa976e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c74fd82bc494f83b232c4d68480b4bb'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:41.677975 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1178/2332] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:58:41 2022] DELETE /identity/v3/users/6c74fd82bc494f83b232c4d68480b4bb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:41.683893 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f867a5-19ea-48fb-bf1a-553331f7a2ce None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:41.684984 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f867a5-19ea-48fb-bf1a-553331f7a2ce None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:41.685693 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f867a5-19ea-48fb-bf1a-553331f7a2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:41.710672 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-14f867a5-19ea-48fb-bf1a-553331f7a2ce None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:41.711909 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-14f867a5-19ea-48fb-bf1a-553331f7a2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:41.775069 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:41.785048 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1155/2333] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:41.795481 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da8bd5-6c8b-4b9e-8af3-ef53fa976e54 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:41.797468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-52da8bd5-6c8b-4b9e-8af3-ef53fa976e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:41.862670 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da8bd5-6c8b-4b9e-8af3-ef53fa976e54 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:41.866708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a424ed-80de-450f-8e00-4e52e995d068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:41.867341 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a424ed-80de-450f-8e00-4e52e995d068 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:41.867666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a424ed-80de-450f-8e00-4e52e995d068 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:41.867915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a424ed-80de-450f-8e00-4e52e995d068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:41.878199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a424ed-80de-450f-8e00-4e52e995d068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:41.879641 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a424ed-80de-450f-8e00-4e52e995d068 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:41.892055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1179/2334] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:42.362770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f867a5-19ea-48fb-bf1a-553331f7a2ce None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:42.364257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-14f867a5-19ea-48fb-bf1a-553331f7a2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:42.377366 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f867a5-19ea-48fb-bf1a-553331f7a2ce None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:42.383694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88724558-4969-48c3-a21f-79fa790c01a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:42.384595 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88724558-4969-48c3-a21f-79fa790c01a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:42.385204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88724558-4969-48c3-a21f-79fa790c01a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:42.385677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88724558-4969-48c3-a21f-79fa790c01a6 admin admin] PATH_INFO: `/v3/projects/53753429f63443808e745445ce87b30f` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:42.387262 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88724558-4969-48c3-a21f-79fa790c01a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53753429f63443808e745445ce87b30f)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:42.389761 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88724558-4969-48c3-a21f-79fa790c01a6 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:42.471442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-88724558-4969-48c3-a21f-79fa790c01a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53753429f63443808e745445ce87b30f', 'request_id': 'req-88724558-4969-48c3-a21f-79fa790c01a6'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:42.481286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-88724558-4969-48c3-a21f-79fa790c01a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53753429f63443808e745445ce87b30f', 'request_id': 'req-88724558-4969-48c3-a21f-79fa790c01a6'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:42.494130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-88724558-4969-48c3-a21f-79fa790c01a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53753429f63443808e745445ce87b30f', 'request_id': 'req-88724558-4969-48c3-a21f-79fa790c01a6'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:42.509585 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-88724558-4969-48c3-a21f-79fa790c01a6 admin admin] The token cache is being invalidate because project 53753429f63443808e745445ce87b30f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:58:42.509873 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-88724558-4969-48c3-a21f-79fa790c01a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:42.510637 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-88724558-4969-48c3-a21f-79fa790c01a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:42.513727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1156/2335] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:58:42 2022] DELETE /identity/v3/projects/53753429f63443808e745445ce87b30f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:42.517733 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a424ed-80de-450f-8e00-4e52e995d068 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:42.529043 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a424ed-80de-450f-8e00-4e52e995d068 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:42.648135 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e308a-ce25-4e34-805b-473022e4593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:42.648816 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e308a-ce25-4e34-805b-473022e4593e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:42.649278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e308a-ce25-4e34-805b-473022e4593e admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:42.649653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e308a-ce25-4e34-805b-473022e4593e admin admin] PATH_INFO: `/v3/users/4b1ed17a2dc847a28b84248a42880166` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:42.654255 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e308a-ce25-4e34-805b-473022e4593e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b1ed17a2dc847a28b84248a42880166)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:42.657284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e308a-ce25-4e34-805b-473022e4593e admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:42.749380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:42.753295 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-061e308a-ce25-4e34-805b-473022e4593e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b1ed17a2dc847a28b84248a42880166'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:42.771267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-061e308a-ce25-4e34-805b-473022e4593e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b1ed17a2dc847a28b84248a42880166'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:42.790140 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-061e308a-ce25-4e34-805b-473022e4593e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b1ed17a2dc847a28b84248a42880166'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:42.800130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-061e308a-ce25-4e34-805b-473022e4593e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b1ed17a2dc847a28b84248a42880166'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:42.800848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-061e308a-ce25-4e34-805b-473022e4593e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b1ed17a2dc847a28b84248a42880166'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:42.812384 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1180/2336] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:58:42 2022] DELETE /identity/v3/users/4b1ed17a2dc847a28b84248a42880166 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:43.521905 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88724558-4969-48c3-a21f-79fa790c01a6 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:43.524833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-88724558-4969-48c3-a21f-79fa790c01a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:43.544443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88724558-4969-48c3-a21f-79fa790c01a6 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:43.607183 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac105ae2-d85b-4cb3-9386-c524ecd5eafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:43.607823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac105ae2-d85b-4cb3-9386-c524ecd5eafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:43.608101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac105ae2-d85b-4cb3-9386-c524ecd5eafd admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:43.608372 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac105ae2-d85b-4cb3-9386-c524ecd5eafd admin admin] PATH_INFO: `/v3/projects/38cce4b273c548e5986678fddb4858e4` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:43.609534 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac105ae2-d85b-4cb3-9386-c524ecd5eafd admin admin] RBAC: Authorizing `identity:delete_project(project_id=38cce4b273c548e5986678fddb4858e4)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:43.611451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac105ae2-d85b-4cb3-9386-c524ecd5eafd admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:43.664127 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ac105ae2-d85b-4cb3-9386-c524ecd5eafd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38cce4b273c548e5986678fddb4858e4', 'request_id': 'req-ac105ae2-d85b-4cb3-9386-c524ecd5eafd'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:43.671297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ac105ae2-d85b-4cb3-9386-c524ecd5eafd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38cce4b273c548e5986678fddb4858e4', 'request_id': 'req-ac105ae2-d85b-4cb3-9386-c524ecd5eafd'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:43.681665 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ac105ae2-d85b-4cb3-9386-c524ecd5eafd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38cce4b273c548e5986678fddb4858e4', 'request_id': 'req-ac105ae2-d85b-4cb3-9386-c524ecd5eafd'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:43.697735 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ac105ae2-d85b-4cb3-9386-c524ecd5eafd admin admin] The token cache is being invalidate because project 38cce4b273c548e5986678fddb4858e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:58:43.698079 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ac105ae2-d85b-4cb3-9386-c524ecd5eafd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:43.698796 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ac105ae2-d85b-4cb3-9386-c524ecd5eafd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:43.700918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1157/2337] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:58:43 2022] DELETE /identity/v3/projects/38cce4b273c548e5986678fddb4858e4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:43.707250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52131f14-a633-4476-ac2f-e1da00bafc76 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:43.708110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52131f14-a633-4476-ac2f-e1da00bafc76 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:43.708110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52131f14-a633-4476-ac2f-e1da00bafc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:43.730616 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-52131f14-a633-4476-ac2f-e1da00bafc76 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:43.732853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-52131f14-a633-4476-ac2f-e1da00bafc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:43.843593 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1181/2338] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:43.851625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70fc88-5b5c-4e50-9fff-6cfcbdc41c10 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:43.852081 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70fc88-5b5c-4e50-9fff-6cfcbdc41c10 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:43.852461 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70fc88-5b5c-4e50-9fff-6cfcbdc41c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:43.880200 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-1a70fc88-5b5c-4e50-9fff-6cfcbdc41c10 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:43.881898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-1a70fc88-5b5c-4e50-9fff-6cfcbdc41c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:43.916947 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1158/2339] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:43.926220 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52131f14-a633-4476-ac2f-e1da00bafc76 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:43.948572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52131f14-a633-4476-ac2f-e1da00bafc76 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:43.964312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45541f3-c345-4948-b97e-b13de205e040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:43.965399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45541f3-c345-4948-b97e-b13de205e040 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:43.965944 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45541f3-c345-4948-b97e-b13de205e040 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:43.966498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45541f3-c345-4948-b97e-b13de205e040 admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:43.967613 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45541f3-c345-4948-b97e-b13de205e040 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:58:43.968041 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45541f3-c345-4948-b97e-b13de205e040 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:43.970500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45541f3-c345-4948-b97e-b13de205e040 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:43.971352 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ddc07-48a0-44df-9c35-c4a75863ef21 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:43.971744 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ddc07-48a0-44df-9c35-c4a75863ef21 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:43.972134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ddc07-48a0-44df-9c35-c4a75863ef21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:43.990545 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:44.014362 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-c50ddc07-48a0-44df-9c35-c4a75863ef21 None None] MFA Rules not processed for user `e1f49820de264982aeec97fa0be3c290`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:44.016752 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c50ddc07-48a0-44df-9c35-c4a75863ef21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:44.030245 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1182/2340] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:58:44.032519 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45541f3-c345-4948-b97e-b13de205e040 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:44.051041 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45541f3-c345-4948-b97e-b13de205e040 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:44.058317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201fcf8-223a-44dd-b6ae-aa72f522b6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:44.059488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201fcf8-223a-44dd-b6ae-aa72f522b6bf admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:44.059915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201fcf8-223a-44dd-b6ae-aa72f522b6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:44.060293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201fcf8-223a-44dd-b6ae-aa72f522b6bf admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:44.061311 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201fcf8-223a-44dd-b6ae-aa72f522b6bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:44.064050 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201fcf8-223a-44dd-b6ae-aa72f522b6bf admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:44.117060 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1183/2341] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:58:44 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:58:44.121435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201fcf8-223a-44dd-b6ae-aa72f522b6bf admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:44.179058 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1159/2342] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 23:58:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:58:44.195271 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ddc07-48a0-44df-9c35-c4a75863ef21 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:44.197290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c50ddc07-48a0-44df-9c35-c4a75863ef21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:44.224977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201fcf8-223a-44dd-b6ae-aa72f522b6bf admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:44.232723 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49110ef8-f37b-4590-a1d4-695d60bb2dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:44.233444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49110ef8-f37b-4590-a1d4-695d60bb2dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:44.233694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49110ef8-f37b-4590-a1d4-695d60bb2dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:44.234162 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49110ef8-f37b-4590-a1d4-695d60bb2dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:44.234825 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49110ef8-f37b-4590-a1d4-695d60bb2dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:44.237786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49110ef8-f37b-4590-a1d4-695d60bb2dc2 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:44.268967 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1184/2343] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:58:44 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:58:44.274237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49110ef8-f37b-4590-a1d4-695d60bb2dc2 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:44.288400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49110ef8-f37b-4590-a1d4-695d60bb2dc2 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:44.292544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ddc07-48a0-44df-9c35-c4a75863ef21 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:44.295506 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115f3d0-cf24-4ccd-b245-6f47637ca07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:44.296314 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115f3d0-cf24-4ccd-b245-6f47637ca07c admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:44.296667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115f3d0-cf24-4ccd-b245-6f47637ca07c admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:44.297691 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115f3d0-cf24-4ccd-b245-6f47637ca07c admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:44.298713 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115f3d0-cf24-4ccd-b245-6f47637ca07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:44.301238 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115f3d0-cf24-4ccd-b245-6f47637ca07c admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:44.322958 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1185/2344] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:58:44.329217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115f3d0-cf24-4ccd-b245-6f47637ca07c admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:44.342873 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115f3d0-cf24-4ccd-b245-6f47637ca07c admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:44.350241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc25ff-6b7b-443c-afb4-e8d9477837cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:44.350976 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc25ff-6b7b-443c-afb4-e8d9477837cc admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:44.351325 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc25ff-6b7b-443c-afb4-e8d9477837cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:44.351659 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc25ff-6b7b-443c-afb4-e8d9477837cc admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:44.352989 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc25ff-6b7b-443c-afb4-e8d9477837cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:44.359970 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc25ff-6b7b-443c-afb4-e8d9477837cc admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:44.376246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:44.412320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1186/2345] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:58:44.413825 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc25ff-6b7b-443c-afb4-e8d9477837cc admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:44.426505 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febae76-b0b7-4df1-8642-520f3ac190b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c45ae3144b4fe8ab4e921fda30164a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:44.427339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febae76-b0b7-4df1-8642-520f3ac190b7 service swift] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:44.427853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febae76-b0b7-4df1-8642-520f3ac190b7 service swift] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:44.428410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febae76-b0b7-4df1-8642-520f3ac190b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:44.441930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc25ff-6b7b-443c-afb4-e8d9477837cc admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:44.455731 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985785f-82c9-45c2-b7ea-50809f6fbe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:44.457191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985785f-82c9-45c2-b7ea-50809f6fbe20 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:44.457554 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985785f-82c9-45c2-b7ea-50809f6fbe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:44.457849 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985785f-82c9-45c2-b7ea-50809f6fbe20 admin admin] PATH_INFO: `/v3/projects/0b761d8683204db8abeca7d66a9468bd/users/5b6e0bcfc901456a9eea4dfa7f831f86/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:44.487565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985785f-82c9-45c2-b7ea-50809f6fbe20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b761d8683204db8abeca7d66a9468bd, user_id=5b6e0bcfc901456a9eea4dfa7f831f86, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:44.494214 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985785f-82c9-45c2-b7ea-50809f6fbe20 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:44.524404 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1187/2346] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:58:44 2022] PUT /identity/v3/projects/0b761d8683204db8abeca7d66a9468bd/users/5b6e0bcfc901456a9eea4dfa7f831f86/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:44.537990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:44.539518 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429287a1-498c-4a61-9b41-b3bff1b433d9 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:44.539940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429287a1-498c-4a61-9b41-b3bff1b433d9 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:44.540225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429287a1-498c-4a61-9b41-b3bff1b433d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:44.540420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febae76-b0b7-4df1-8642-520f3ac190b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:44.549481 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febae76-b0b7-4df1-8642-520f3ac190b7 service swift] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:44.571603 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1160/2347] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 23:58:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 12 23:58:44.585749 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-429287a1-498c-4a61-9b41-b3bff1b433d9 None None] MFA Rules not processed for user `5b6e0bcfc901456a9eea4dfa7f831f86`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:44.587266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-429287a1-498c-4a61-9b41-b3bff1b433d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:44.724973 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1188/2348] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:44.727977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febae76-b0b7-4df1-8642-520f3ac190b7 service swift] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:44.749760 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febae76-b0b7-4df1-8642-520f3ac190b7 service swift] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:44.872985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1256241-5a6d-4723-95c0-ef379295bf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:44.873675 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1256241-5a6d-4723-95c0-ef379295bf47 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:44.873990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1256241-5a6d-4723-95c0-ef379295bf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:44.874261 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1256241-5a6d-4723-95c0-ef379295bf47 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:44.875596 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1256241-5a6d-4723-95c0-ef379295bf47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:44.879160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1256241-5a6d-4723-95c0-ef379295bf47 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:44.930909 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1161/2349] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:58:44 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:58:44.937031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429287a1-498c-4a61-9b41-b3bff1b433d9 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:44.953778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429287a1-498c-4a61-9b41-b3bff1b433d9 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:45.063207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cd665-f1dd-441d-97f0-3df56d5309fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:45.065535 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cd665-f1dd-441d-97f0-3df56d5309fb admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:45.066141 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cd665-f1dd-441d-97f0-3df56d5309fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:45.066841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cd665-f1dd-441d-97f0-3df56d5309fb admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:45.068124 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728cd665-f1dd-441d-97f0-3df56d5309fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:45.072104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728cd665-f1dd-441d-97f0-3df56d5309fb admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:45.114657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1189/2350] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:58:44 2022] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:58:45.118660 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1256241-5a6d-4723-95c0-ef379295bf47 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:45.141565 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1256241-5a6d-4723-95c0-ef379295bf47 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:45.150610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7829f25-bc14-4881-b30e-5a4a17be1625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:45.152306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7829f25-bc14-4881-b30e-5a4a17be1625 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:45.152953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7829f25-bc14-4881-b30e-5a4a17be1625 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:45.153606 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7829f25-bc14-4881-b30e-5a4a17be1625 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:45.154878 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7829f25-bc14-4881-b30e-5a4a17be1625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:45.158659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7829f25-bc14-4881-b30e-5a4a17be1625 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:45.180203 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1162/2351] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:58:45.184593 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cd665-f1dd-441d-97f0-3df56d5309fb admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:45.201747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cd665-f1dd-441d-97f0-3df56d5309fb admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:45.214204 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70a625-baa4-4e0d-97a3-2403077bf070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:45.214894 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70a625-baa4-4e0d-97a3-2403077bf070 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:45.215173 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70a625-baa4-4e0d-97a3-2403077bf070 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:45.215491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70a625-baa4-4e0d-97a3-2403077bf070 admin admin] PATH_INFO: `/v3/projects/fc7a26bb1a544b408233f752fb33e5d9/users/b0b23d762d7e4f44aea3709907515d31/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:45.245977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70a625-baa4-4e0d-97a3-2403077bf070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7a26bb1a544b408233f752fb33e5d9, user_id=b0b23d762d7e4f44aea3709907515d31, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:45.248906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70a625-baa4-4e0d-97a3-2403077bf070 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:45.288154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1190/2352] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:58:45 2022] PUT /identity/v3/projects/fc7a26bb1a544b408233f752fb33e5d9/users/b0b23d762d7e4f44aea3709907515d31/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:45.292831 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7829f25-bc14-4881-b30e-5a4a17be1625 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:45.306770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7829f25-bc14-4881-b30e-5a4a17be1625 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:45.410796 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc327129-9df1-4c3c-b5c6-9520a3c9bb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:45.411945 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc327129-9df1-4c3c-b5c6-9520a3c9bb66 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:45.412373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc327129-9df1-4c3c-b5c6-9520a3c9bb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:45.412644 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc327129-9df1-4c3c-b5c6-9520a3c9bb66 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:45.413755 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc327129-9df1-4c3c-b5c6-9520a3c9bb66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:45.417080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc327129-9df1-4c3c-b5c6-9520a3c9bb66 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:45.441662 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1163/2353] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:58:45.446156 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70a625-baa4-4e0d-97a3-2403077bf070 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:45.458675 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70a625-baa4-4e0d-97a3-2403077bf070 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:45.465181 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9b1a4-e1b7-4ab2-b2b3-404128067f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:45.465656 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9b1a4-e1b7-4ab2-b2b3-404128067f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:45.466067 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9b1a4-e1b7-4ab2-b2b3-404128067f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:45.466436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9b1a4-e1b7-4ab2-b2b3-404128067f6d admin admin] PATH_INFO: `/v3/projects/fc7a26bb1a544b408233f752fb33e5d9/users/b0b23d762d7e4f44aea3709907515d31/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:45.468794 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9b1a4-e1b7-4ab2-b2b3-404128067f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7a26bb1a544b408233f752fb33e5d9, user_id=b0b23d762d7e4f44aea3709907515d31, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:45.472640 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9b1a4-e1b7-4ab2-b2b3-404128067f6d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:45.506057 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1191/2354] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:58:45 2022] PUT /identity/v3/projects/fc7a26bb1a544b408233f752fb33e5d9/users/b0b23d762d7e4f44aea3709907515d31/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:58:45.519735 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440848b-b80a-4f82-bedc-a1b680357227 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:45.520075 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440848b-b80a-4f82-bedc-a1b680357227 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:45.520420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440848b-b80a-4f82-bedc-a1b680357227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:45.586482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-f440848b-b80a-4f82-bedc-a1b680357227 None None] MFA Rules not processed for user `b0b23d762d7e4f44aea3709907515d31`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:45.588678 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f440848b-b80a-4f82-bedc-a1b680357227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:45.680169 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:45.706228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1164/2355] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:45.718169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9b1a4-e1b7-4ab2-b2b3-404128067f6d admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:45.720386 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-94c9b1a4-e1b7-4ab2-b2b3-404128067f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:45.740013 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:45.815916 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9b1a4-e1b7-4ab2-b2b3-404128067f6d admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:45.821827 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80999cb6-4d49-4e9b-bb8e-a050991f736c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:45.822774 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80999cb6-4d49-4e9b-bb8e-a050991f736c service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:45.823444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80999cb6-4d49-4e9b-bb8e-a050991f736c service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:45.823904 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80999cb6-4d49-4e9b-bb8e-a050991f736c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:45.837176 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80999cb6-4d49-4e9b-bb8e-a050991f736c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:45.839267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80999cb6-4d49-4e9b-bb8e-a050991f736c service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:45.864177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1192/2356] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:46.907708 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440848b-b80a-4f82-bedc-a1b680357227 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:47.003962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440848b-b80a-4f82-bedc-a1b680357227 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:47.011290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bfb50-fe0e-4bc7-86dd-14831b2a020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:47.012653 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bfb50-fe0e-4bc7-86dd-14831b2a020d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:47.013058 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bfb50-fe0e-4bc7-86dd-14831b2a020d admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:47.013362 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bfb50-fe0e-4bc7-86dd-14831b2a020d admin admin] PATH_INFO: `/v3/users/5b6e0bcfc901456a9eea4dfa7f831f86` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:47.015504 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bfb50-fe0e-4bc7-86dd-14831b2a020d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6e0bcfc901456a9eea4dfa7f831f86)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:47.018979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bfb50-fe0e-4bc7-86dd-14831b2a020d admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:47.130208 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ee1bfb50-fe0e-4bc7-86dd-14831b2a020d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6e0bcfc901456a9eea4dfa7f831f86'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:47.132388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ee1bfb50-fe0e-4bc7-86dd-14831b2a020d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6e0bcfc901456a9eea4dfa7f831f86'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:47.133843 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ee1bfb50-fe0e-4bc7-86dd-14831b2a020d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6e0bcfc901456a9eea4dfa7f831f86'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:47.189955 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ee1bfb50-fe0e-4bc7-86dd-14831b2a020d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6e0bcfc901456a9eea4dfa7f831f86'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:47.207331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ee1bfb50-fe0e-4bc7-86dd-14831b2a020d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6e0bcfc901456a9eea4dfa7f831f86'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:47.231409 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1165/2357] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:58:46 2022] DELETE /identity/v3/users/5b6e0bcfc901456a9eea4dfa7f831f86 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:47.237386 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40120de8-c1b6-4591-a7b1-225a3d2cb57b None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:47.238115 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40120de8-c1b6-4591-a7b1-225a3d2cb57b None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:47.238115 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40120de8-c1b6-4591-a7b1-225a3d2cb57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:47.265014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-40120de8-c1b6-4591-a7b1-225a3d2cb57b None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:47.267017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-40120de8-c1b6-4591-a7b1-225a3d2cb57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:47.370079 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1193/2358] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:58:47.380986 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bfb50-fe0e-4bc7-86dd-14831b2a020d admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:47.382916 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ee1bfb50-fe0e-4bc7-86dd-14831b2a020d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:47.498414 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bfb50-fe0e-4bc7-86dd-14831b2a020d admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:47.514696 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d98ace-664f-409a-8e9f-b3c1cd5fd903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:47.515034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d98ace-664f-409a-8e9f-b3c1cd5fd903 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:47.515196 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d98ace-664f-409a-8e9f-b3c1cd5fd903 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:47.515484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d98ace-664f-409a-8e9f-b3c1cd5fd903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:47.538246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d98ace-664f-409a-8e9f-b3c1cd5fd903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:47.540142 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d98ace-664f-409a-8e9f-b3c1cd5fd903 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:47.561167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af22100-d753-42ce-8377-479a1b9b61a8 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:47.561702 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af22100-d753-42ce-8377-479a1b9b61a8 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:47.562186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af22100-d753-42ce-8377-479a1b9b61a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:47.565244 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1166/2359] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:47.606652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-4af22100-d753-42ce-8377-479a1b9b61a8 None None] MFA Rules not processed for user `938c34cda5234812894863921ad14d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:47.608521 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4af22100-d753-42ce-8377-479a1b9b61a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:47.727453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1194/2360] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:48.014320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d98ace-664f-409a-8e9f-b3c1cd5fd903 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:48.015904 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f9d98ace-664f-409a-8e9f-b3c1cd5fd903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:48.040737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d98ace-664f-409a-8e9f-b3c1cd5fd903 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:48.051048 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee830e5-c1c2-466b-a30a-556400132bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:48.051825 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee830e5-c1c2-466b-a30a-556400132bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:48.054029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee830e5-c1c2-466b-a30a-556400132bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:48.054573 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee830e5-c1c2-466b-a30a-556400132bbe admin admin] PATH_INFO: `/v3/projects/0b761d8683204db8abeca7d66a9468bd` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:48.058228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee830e5-c1c2-466b-a30a-556400132bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b761d8683204db8abeca7d66a9468bd)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:48.060458 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee830e5-c1c2-466b-a30a-556400132bbe admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:48.094871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:48.263887 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-dee830e5-c1c2-466b-a30a-556400132bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b761d8683204db8abeca7d66a9468bd', 'request_id': 'req-dee830e5-c1c2-466b-a30a-556400132bbe'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:48.280296 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-dee830e5-c1c2-466b-a30a-556400132bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b761d8683204db8abeca7d66a9468bd', 'request_id': 'req-dee830e5-c1c2-466b-a30a-556400132bbe'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:48.298945 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-dee830e5-c1c2-466b-a30a-556400132bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b761d8683204db8abeca7d66a9468bd', 'request_id': 'req-dee830e5-c1c2-466b-a30a-556400132bbe'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:48.322168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-dee830e5-c1c2-466b-a30a-556400132bbe admin admin] The token cache is being invalidate because project 0b761d8683204db8abeca7d66a9468bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:58:48.322550 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-dee830e5-c1c2-466b-a30a-556400132bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:48.323722 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-dee830e5-c1c2-466b-a30a-556400132bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:48.326004 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1167/2361] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:58:48 2022] DELETE /identity/v3/projects/0b761d8683204db8abeca7d66a9468bd => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:48.333819 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af22100-d753-42ce-8377-479a1b9b61a8 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:48.350958 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af22100-d753-42ce-8377-479a1b9b61a8 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:48.517592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e727bfe-7467-4690-886b-761cf744008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:48.518182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727bfe-7467-4690-886b-761cf744008d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:48.518457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727bfe-7467-4690-886b-761cf744008d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:48.518726 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727bfe-7467-4690-886b-761cf744008d admin admin] PATH_INFO: `/v3/users/b0b23d762d7e4f44aea3709907515d31` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:48.523422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e727bfe-7467-4690-886b-761cf744008d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b23d762d7e4f44aea3709907515d31)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:48.525622 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e727bfe-7467-4690-886b-761cf744008d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:48.529123 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:48.617618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5e727bfe-7467-4690-886b-761cf744008d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b23d762d7e4f44aea3709907515d31'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:48.635902 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5e727bfe-7467-4690-886b-761cf744008d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b23d762d7e4f44aea3709907515d31'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:48.656160 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5e727bfe-7467-4690-886b-761cf744008d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b23d762d7e4f44aea3709907515d31'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:48.664611 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5e727bfe-7467-4690-886b-761cf744008d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b23d762d7e4f44aea3709907515d31'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:48.665613 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5e727bfe-7467-4690-886b-761cf744008d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b23d762d7e4f44aea3709907515d31'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:48.677774 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1195/2362] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:58:48 2022] DELETE /identity/v3/users/b0b23d762d7e4f44aea3709907515d31 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:49.150755 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee830e5-c1c2-466b-a30a-556400132bbe admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:49.152310 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-dee830e5-c1c2-466b-a30a-556400132bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:49.181561 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee830e5-c1c2-466b-a30a-556400132bbe admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:49.345151 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043050f-6e47-4562-9ad0-d0754249cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:49.346211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043050f-6e47-4562-9ad0-d0754249cb25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:49.347837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043050f-6e47-4562-9ad0-d0754249cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:49.348338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043050f-6e47-4562-9ad0-d0754249cb25 admin admin] PATH_INFO: `/v3/projects/fc7a26bb1a544b408233f752fb33e5d9` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:49.350525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043050f-6e47-4562-9ad0-d0754249cb25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7a26bb1a544b408233f752fb33e5d9)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:49.357424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043050f-6e47-4562-9ad0-d0754249cb25 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:49.441399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-6043050f-6e47-4562-9ad0-d0754249cb25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7a26bb1a544b408233f752fb33e5d9', 'request_id': 'req-6043050f-6e47-4562-9ad0-d0754249cb25'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:49.448910 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-6043050f-6e47-4562-9ad0-d0754249cb25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7a26bb1a544b408233f752fb33e5d9', 'request_id': 'req-6043050f-6e47-4562-9ad0-d0754249cb25'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:49.464308 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-6043050f-6e47-4562-9ad0-d0754249cb25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7a26bb1a544b408233f752fb33e5d9', 'request_id': 'req-6043050f-6e47-4562-9ad0-d0754249cb25'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:49.484187 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-6043050f-6e47-4562-9ad0-d0754249cb25 admin admin] The token cache is being invalidate because project fc7a26bb1a544b408233f752fb33e5d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:58:49.484624 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-6043050f-6e47-4562-9ad0-d0754249cb25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:49.485179 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-6043050f-6e47-4562-9ad0-d0754249cb25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:49.487488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1168/2363] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:58:49 2022] DELETE /identity/v3/projects/fc7a26bb1a544b408233f752fb33e5d9 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:49.492422 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c2f4f-5a28-4678-913a-b65d58275267 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:49.492993 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c2f4f-5a28-4678-913a-b65d58275267 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:49.492993 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c2f4f-5a28-4678-913a-b65d58275267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:49.536482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-fb2c2f4f-5a28-4678-913a-b65d58275267 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:49.540197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-fb2c2f4f-5a28-4678-913a-b65d58275267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:49.696369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1196/2364] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:49.699087 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb8455-8c2f-408d-8f90-f465a9a184b5 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:49.699589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb8455-8c2f-408d-8f90-f465a9a184b5 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:49.700251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb8455-8c2f-408d-8f90-f465a9a184b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:49.747085 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-cefb8455-8c2f-408d-8f90-f465a9a184b5 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:49.748558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-cefb8455-8c2f-408d-8f90-f465a9a184b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:49.757282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1169/2365] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:58:49.763325 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c2f4f-5a28-4678-913a-b65d58275267 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:49.789867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c2f4f-5a28-4678-913a-b65d58275267 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:49.798971 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98409b66-dd32-4f43-b408-48dbd5fbd060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:49.800277 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409b66-dd32-4f43-b408-48dbd5fbd060 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:49.800832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409b66-dd32-4f43-b408-48dbd5fbd060 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:49.801894 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409b66-dd32-4f43-b408-48dbd5fbd060 admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:49.804597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98409b66-dd32-4f43-b408-48dbd5fbd060 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:58:49.805011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98409b66-dd32-4f43-b408-48dbd5fbd060 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:49.806816 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98409b66-dd32-4f43-b408-48dbd5fbd060 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:49.820456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1197/2366] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:58:49.825218 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb8455-8c2f-408d-8f90-f465a9a184b5 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:49.837895 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb8455-8c2f-408d-8f90-f465a9a184b5 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:49.853161 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837247eb-bf9e-4b7d-9914-5616bf8d1f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:49.853877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837247eb-bf9e-4b7d-9914-5616bf8d1f33 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:49.854247 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837247eb-bf9e-4b7d-9914-5616bf8d1f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:49.854644 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837247eb-bf9e-4b7d-9914-5616bf8d1f33 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:49.855316 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837247eb-bf9e-4b7d-9914-5616bf8d1f33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:49.857490 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837247eb-bf9e-4b7d-9914-5616bf8d1f33 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:49.884097 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:49.893248 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1170/2367] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:58:49 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:58:49.899391 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98409b66-dd32-4f43-b408-48dbd5fbd060 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:49.911780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837247eb-bf9e-4b7d-9914-5616bf8d1f33 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:49.913615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-837247eb-bf9e-4b7d-9914-5616bf8d1f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:49.926036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98409b66-dd32-4f43-b408-48dbd5fbd060 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:50.014979 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765415e-78a9-4c53-a33d-0ee5c2c857d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:50.015674 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765415e-78a9-4c53-a33d-0ee5c2c857d0 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:50.015954 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765415e-78a9-4c53-a33d-0ee5c2c857d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:50.016222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765415e-78a9-4c53-a33d-0ee5c2c857d0 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:50.016876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765415e-78a9-4c53-a33d-0ee5c2c857d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:50.030094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765415e-78a9-4c53-a33d-0ee5c2c857d0 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:50.066335 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:50.076977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1198/2368] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:58:49 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:58:50.082415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837247eb-bf9e-4b7d-9914-5616bf8d1f33 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:50.091701 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c63db-3419-415b-9372-8035e93eaf98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:50.092958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c63db-3419-415b-9372-8035e93eaf98 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:50.093262 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c63db-3419-415b-9372-8035e93eaf98 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:50.093810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c63db-3419-415b-9372-8035e93eaf98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:50.097023 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-482c63db-3419-415b-9372-8035e93eaf98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:50.098453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765415e-78a9-4c53-a33d-0ee5c2c857d0 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:50.122640 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765415e-78a9-4c53-a33d-0ee5c2c857d0 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:50.135567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56883c87-ab9d-414b-8266-ac267e1dc117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:50.136303 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56883c87-ab9d-414b-8266-ac267e1dc117 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:50.136781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56883c87-ab9d-414b-8266-ac267e1dc117 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:50.137067 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56883c87-ab9d-414b-8266-ac267e1dc117 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:50.138204 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56883c87-ab9d-414b-8266-ac267e1dc117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:50.139889 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56883c87-ab9d-414b-8266-ac267e1dc117 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:50.168095 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1199/2369] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:58:50.169583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56883c87-ab9d-414b-8266-ac267e1dc117 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:50.190306 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56883c87-ab9d-414b-8266-ac267e1dc117 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:50.198196 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a215e-702a-4dd5-b72a-b5783a074e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:50.199005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a215e-702a-4dd5-b72a-b5783a074e16 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:50.199283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a215e-702a-4dd5-b72a-b5783a074e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:50.199556 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a215e-702a-4dd5-b72a-b5783a074e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:50.200382 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a215e-702a-4dd5-b72a-b5783a074e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:50.202250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a215e-702a-4dd5-b72a-b5783a074e16 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:50.225141 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1200/2370] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:58:50.227146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a215e-702a-4dd5-b72a-b5783a074e16 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:50.247675 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a215e-702a-4dd5-b72a-b5783a074e16 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:50.254617 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e59037-89ff-4fba-85fc-bd001cad2a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:50.256075 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e59037-89ff-4fba-85fc-bd001cad2a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:50.256362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e59037-89ff-4fba-85fc-bd001cad2a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:50.256917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e59037-89ff-4fba-85fc-bd001cad2a96 admin admin] PATH_INFO: `/v3/projects/dbf2fb6bfed542b6b3937fe8b0892911/users/6f12529c9f21471e9132e541a30272d1/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:50.285830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c63db-3419-415b-9372-8035e93eaf98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:50.292234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c63db-3419-415b-9372-8035e93eaf98 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:50.310136 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e59037-89ff-4fba-85fc-bd001cad2a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbf2fb6bfed542b6b3937fe8b0892911, user_id=6f12529c9f21471e9132e541a30272d1, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:50.316692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e59037-89ff-4fba-85fc-bd001cad2a96 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:50.324791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1171/2371] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:50.346680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1201/2372] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:58:50 2022] PUT /identity/v3/projects/dbf2fb6bfed542b6b3937fe8b0892911/users/6f12529c9f21471e9132e541a30272d1/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:58:50.348780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d993-d230-48ca-928b-34f5caba7ad3 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:50.349052 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d993-d230-48ca-928b-34f5caba7ad3 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:50.349323 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d993-d230-48ca-928b-34f5caba7ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:50.384536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-9cc8d993-d230-48ca-928b-34f5caba7ad3 None None] MFA Rules not processed for user `6f12529c9f21471e9132e541a30272d1`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:50.386288 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9cc8d993-d230-48ca-928b-34f5caba7ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:50.518208 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1172/2373] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:58:50.532374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e59037-89ff-4fba-85fc-bd001cad2a96 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:50.534425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-96e59037-89ff-4fba-85fc-bd001cad2a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:50.638069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e59037-89ff-4fba-85fc-bd001cad2a96 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:50.645932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213590e-1109-4f37-9822-f93d379be59a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:50.646577 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213590e-1109-4f37-9822-f93d379be59a service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:50.646856 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213590e-1109-4f37-9822-f93d379be59a service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:50.647124 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213590e-1109-4f37-9822-f93d379be59a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:50.672797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213590e-1109-4f37-9822-f93d379be59a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:50.674478 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213590e-1109-4f37-9822-f93d379be59a service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:50.696826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1202/2374] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:50.737029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8d993-d230-48ca-928b-34f5caba7ad3 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:50.816338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:50.932818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8d993-d230-48ca-928b-34f5caba7ad3 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:50.947128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659561f1-3bc1-48cf-a55f-2f20f0112123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:50.949219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659561f1-3bc1-48cf-a55f-2f20f0112123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:50.949565 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659561f1-3bc1-48cf-a55f-2f20f0112123 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:50.951001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659561f1-3bc1-48cf-a55f-2f20f0112123 admin admin] PATH_INFO: `/v3/users/6f12529c9f21471e9132e541a30272d1` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:50.956938 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659561f1-3bc1-48cf-a55f-2f20f0112123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f12529c9f21471e9132e541a30272d1)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:50.959121 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659561f1-3bc1-48cf-a55f-2f20f0112123 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:51.082563 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-659561f1-3bc1-48cf-a55f-2f20f0112123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f12529c9f21471e9132e541a30272d1'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:51.084067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-659561f1-3bc1-48cf-a55f-2f20f0112123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f12529c9f21471e9132e541a30272d1'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:51.087285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-659561f1-3bc1-48cf-a55f-2f20f0112123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f12529c9f21471e9132e541a30272d1'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:51.114791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-659561f1-3bc1-48cf-a55f-2f20f0112123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f12529c9f21471e9132e541a30272d1'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:51.129610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-659561f1-3bc1-48cf-a55f-2f20f0112123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f12529c9f21471e9132e541a30272d1'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:51.188758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1173/2375] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:58:50 2022] DELETE /identity/v3/users/6f12529c9f21471e9132e541a30272d1 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:51.191553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd80608-ba87-4b70-965a-42815cb76fce None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:51.198164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd80608-ba87-4b70-965a-42815cb76fce None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:51.199249 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd80608-ba87-4b70-965a-42815cb76fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:51.267354 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-2dd80608-ba87-4b70-965a-42815cb76fce None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:51.270030 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2dd80608-ba87-4b70-965a-42815cb76fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:51.432151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1203/2376] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:51.446749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659561f1-3bc1-48cf-a55f-2f20f0112123 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:51.448837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-659561f1-3bc1-48cf-a55f-2f20f0112123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:51.533211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659561f1-3bc1-48cf-a55f-2f20f0112123 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:51.537475 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b56f6f-5c99-43da-91b5-e8d44283f77d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:51.538138 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b56f6f-5c99-43da-91b5-e8d44283f77d service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:51.538402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b56f6f-5c99-43da-91b5-e8d44283f77d service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:51.538737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b56f6f-5c99-43da-91b5-e8d44283f77d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:51.550100 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b56f6f-5c99-43da-91b5-e8d44283f77d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:51.551572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b56f6f-5c99-43da-91b5-e8d44283f77d service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:51.567693 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1174/2377] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:51.981249 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd80608-ba87-4b70-965a-42815cb76fce None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:51.985772 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2dd80608-ba87-4b70-965a-42815cb76fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:52.051865 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd80608-ba87-4b70-965a-42815cb76fce None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:52.064356 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7ace1-137d-4c37-85bd-ff06a4f09215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:52.065885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7ace1-137d-4c37-85bd-ff06a4f09215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:52.067970 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7ace1-137d-4c37-85bd-ff06a4f09215 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:52.071110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7ace1-137d-4c37-85bd-ff06a4f09215 admin admin] PATH_INFO: `/v3/projects/dbf2fb6bfed542b6b3937fe8b0892911` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:52.075023 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7ace1-137d-4c37-85bd-ff06a4f09215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbf2fb6bfed542b6b3937fe8b0892911)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:52.080014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7ace1-137d-4c37-85bd-ff06a4f09215 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:52.195498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a4d7ace1-137d-4c37-85bd-ff06a4f09215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbf2fb6bfed542b6b3937fe8b0892911', 'request_id': 'req-a4d7ace1-137d-4c37-85bd-ff06a4f09215'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:52.205621 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:52.223151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a4d7ace1-137d-4c37-85bd-ff06a4f09215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbf2fb6bfed542b6b3937fe8b0892911', 'request_id': 'req-a4d7ace1-137d-4c37-85bd-ff06a4f09215'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:52.249479 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a4d7ace1-137d-4c37-85bd-ff06a4f09215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbf2fb6bfed542b6b3937fe8b0892911', 'request_id': 'req-a4d7ace1-137d-4c37-85bd-ff06a4f09215'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:52.293210 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a4d7ace1-137d-4c37-85bd-ff06a4f09215 admin admin] The token cache is being invalidate because project dbf2fb6bfed542b6b3937fe8b0892911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:58:52.293749 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a4d7ace1-137d-4c37-85bd-ff06a4f09215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:52.294877 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-a4d7ace1-137d-4c37-85bd-ff06a4f09215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:58:52.298679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1204/2378] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:58:51 2022] DELETE /identity/v3/projects/dbf2fb6bfed542b6b3937fe8b0892911 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:58:52.304535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93ab49-1c3f-4e09-b539-c4df918fbacc None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:52.305044 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93ab49-1c3f-4e09-b539-c4df918fbacc None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:52.305572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93ab49-1c3f-4e09-b539-c4df918fbacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:52.355119 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-8a93ab49-1c3f-4e09-b539-c4df918fbacc None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:52.357989 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-8a93ab49-1c3f-4e09-b539-c4df918fbacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:52.531053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:52.562479 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1175/2379] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:52.570274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718aa5e-b154-4020-877c-a470f91aae9e None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:52.570785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718aa5e-b154-4020-877c-a470f91aae9e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:52.571271 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718aa5e-b154-4020-877c-a470f91aae9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:52.607669 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-1718aa5e-b154-4020-877c-a470f91aae9e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:52.610094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1718aa5e-b154-4020-877c-a470f91aae9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:52.625923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1205/2380] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:52.632109 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93ab49-1c3f-4e09-b539-c4df918fbacc None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:52.647652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93ab49-1c3f-4e09-b539-c4df918fbacc None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:52.653148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882fd49-8742-4838-971a-b5bb043c1a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:52.653824 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882fd49-8742-4838-971a-b5bb043c1a76 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:52.654106 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882fd49-8742-4838-971a-b5bb043c1a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:52.654382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882fd49-8742-4838-971a-b5bb043c1a76 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:52.655059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882fd49-8742-4838-971a-b5bb043c1a76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:58:52.655365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882fd49-8742-4838-971a-b5bb043c1a76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:52.657015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882fd49-8742-4838-971a-b5bb043c1a76 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:52.677727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1176/2381] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:58:52.680144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718aa5e-b154-4020-877c-a470f91aae9e None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:52.690317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718aa5e-b154-4020-877c-a470f91aae9e None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:52.695513 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfa291-649e-4551-86b0-01d7b5360564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:52.696141 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfa291-649e-4551-86b0-01d7b5360564 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:52.696436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfa291-649e-4551-86b0-01d7b5360564 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:52.696709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfa291-649e-4551-86b0-01d7b5360564 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:52.697318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfa291-649e-4551-86b0-01d7b5360564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:52.699322 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfa291-649e-4551-86b0-01d7b5360564 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:52.737868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1206/2382] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:58:52 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:58:52.743458 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882fd49-8742-4838-971a-b5bb043c1a76 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:52.757330 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882fd49-8742-4838-971a-b5bb043c1a76 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:52.823564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62820be8-847c-4739-aa0e-b159aae1ebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:52.824255 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62820be8-847c-4739-aa0e-b159aae1ebc0 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:52.824712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62820be8-847c-4739-aa0e-b159aae1ebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:52.825047 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62820be8-847c-4739-aa0e-b159aae1ebc0 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:52.825812 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62820be8-847c-4739-aa0e-b159aae1ebc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:52.827838 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62820be8-847c-4739-aa0e-b159aae1ebc0 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:52.851547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1177/2383] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:58:52 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:58:52.856197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfa291-649e-4551-86b0-01d7b5360564 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:52.867210 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfa291-649e-4551-86b0-01d7b5360564 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:52.872168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303d876-b86c-4378-bbfb-283cb1f7d711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:52.872810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303d876-b86c-4378-bbfb-283cb1f7d711 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:52.873105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303d876-b86c-4378-bbfb-283cb1f7d711 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:52.873398 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303d876-b86c-4378-bbfb-283cb1f7d711 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:52.874068 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303d876-b86c-4378-bbfb-283cb1f7d711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:52.875747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303d876-b86c-4378-bbfb-283cb1f7d711 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:52.891738 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1207/2384] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:58:52.896569 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62820be8-847c-4739-aa0e-b159aae1ebc0 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:52.907619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62820be8-847c-4739-aa0e-b159aae1ebc0 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:52.912457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8bb95-0593-4728-bf75-e9b8b1b59777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:52.913082 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8bb95-0593-4728-bf75-e9b8b1b59777 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:52.913386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8bb95-0593-4728-bf75-e9b8b1b59777 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:52.913680 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8bb95-0593-4728-bf75-e9b8b1b59777 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:52.914319 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8bb95-0593-4728-bf75-e9b8b1b59777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:52.915953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8bb95-0593-4728-bf75-e9b8b1b59777 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:52.928753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1178/2385] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:58:52.933253 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303d876-b86c-4378-bbfb-283cb1f7d711 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:52.944197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303d876-b86c-4378-bbfb-283cb1f7d711 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:52.950088 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d08b6-66eb-4db6-906a-f258d33b2ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:52.950781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d08b6-66eb-4db6-906a-f258d33b2ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:52.951062 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d08b6-66eb-4db6-906a-f258d33b2ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:52.951372 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d08b6-66eb-4db6-906a-f258d33b2ecb admin admin] PATH_INFO: `/v3/projects/ca2e40a507874cc8abea1298474c428a/users/894528f128af4b9cb0199bcba094d467/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:52.969608 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d08b6-66eb-4db6-906a-f258d33b2ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2e40a507874cc8abea1298474c428a, user_id=894528f128af4b9cb0199bcba094d467, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:52.972325 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d08b6-66eb-4db6-906a-f258d33b2ecb admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:52.988882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1208/2386] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:58:52 2022] PUT /identity/v3/projects/ca2e40a507874cc8abea1298474c428a/users/894528f128af4b9cb0199bcba094d467/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:58:53.001619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c274dd-8ba4-4988-8588-71b329c4e233 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:53.001963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c274dd-8ba4-4988-8588-71b329c4e233 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:53.002316 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c274dd-8ba4-4988-8588-71b329c4e233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:53.038752 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-31c274dd-8ba4-4988-8588-71b329c4e233 None None] MFA Rules not processed for user `894528f128af4b9cb0199bcba094d467`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:58:53.040114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-31c274dd-8ba4-4988-8588-71b329c4e233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:53.120208 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1179/2387] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:58:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:58:53.133319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d08b6-66eb-4db6-906a-f258d33b2ecb admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:53.135216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-914d08b6-66eb-4db6-906a-f258d33b2ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:53.208740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d08b6-66eb-4db6-906a-f258d33b2ecb admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:53.212759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4ca2f-4af0-42df-bc2c-0bcb24495b4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21a0c72223417d92e3d8b30ef6bc3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:53.213430 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ca2f-4af0-42df-bc2c-0bcb24495b4c service glance] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:53.213716 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ca2f-4af0-42df-bc2c-0bcb24495b4c service glance] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:53.213995 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ca2f-4af0-42df-bc2c-0bcb24495b4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:53.223577 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4ca2f-4af0-42df-bc2c-0bcb24495b4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:53.225039 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4ca2f-4af0-42df-bc2c-0bcb24495b4c service glance] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:53.235172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1209/2388] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:56.336255 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c274dd-8ba4-4988-8588-71b329c4e233 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:56.339998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-31c274dd-8ba4-4988-8588-71b329c4e233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:56.530368 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:56.554299 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c274dd-8ba4-4988-8588-71b329c4e233 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:56.575969 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e999e2-586c-44bd-98ec-1a48525f7d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:56.576762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e999e2-586c-44bd-98ec-1a48525f7d78 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:56.577150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e999e2-586c-44bd-98ec-1a48525f7d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:56.577525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e999e2-586c-44bd-98ec-1a48525f7d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:56.583859 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c0e999e2-586c-44bd-98ec-1a48525f7d78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:56.607738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e999e2-586c-44bd-98ec-1a48525f7d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:56.610485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e999e2-586c-44bd-98ec-1a48525f7d78 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:56.632272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1180/2389] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:58:57.822678 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4ca2f-4af0-42df-bc2c-0bcb24495b4c service glance] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:58:57.825228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-66c4ca2f-4af0-42df-bc2c-0bcb24495b4c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:57.944338 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4ca2f-4af0-42df-bc2c-0bcb24495b4c service glance] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:58:57.955734 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fe107-783d-46cd-8d15-69640cf192c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:58:57.956791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fe107-783d-46cd-8d15-69640cf192c3 service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:58:57.957328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fe107-783d-46cd-8d15-69640cf192c3 service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:58:57.957942 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fe107-783d-46cd-8d15-69640cf192c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:58:57.961282 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-e37fe107-783d-46cd-8d15-69640cf192c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:58:57.986505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fe107-783d-46cd-8d15-69640cf192c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:58:57.988802 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fe107-783d-46cd-8d15-69640cf192c3 service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:58:58.005264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1210/2390] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:58:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:59:01.347133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ef456-2d4c-4c73-9308-115a153d9ce9 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:01.347747 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ef456-2d4c-4c73-9308-115a153d9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:01.348015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ef456-2d4c-4c73-9308-115a153d9ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:01.400980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-1e4ef456-2d4c-4c73-9308-115a153d9ce9 None None] MFA Rules not processed for user `e1f49820de264982aeec97fa0be3c290`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:01.409562 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-1e4ef456-2d4c-4c73-9308-115a153d9ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:01.517468 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1181/2391] 10.222.0.23 () {58 vars in 967 bytes} [Mon Sep 12 23:59:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:01.538212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fe107-783d-46cd-8d15-69640cf192c3 service nova] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:01.539745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-e37fe107-783d-46cd-8d15-69640cf192c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:01.545098 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:01.644558 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fe107-783d-46cd-8d15-69640cf192c3 service nova] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:01.649695 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bde51-bdb2-424e-8109-b02112d12284 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c45ae3144b4fe8ab4e921fda30164a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:01.650337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bde51-bdb2-424e-8109-b02112d12284 service swift] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:01.650612 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bde51-bdb2-424e-8109-b02112d12284 service swift] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:01.650879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bde51-bdb2-424e-8109-b02112d12284 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:01.660452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6bde51-bdb2-424e-8109-b02112d12284 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:01.663556 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6bde51-bdb2-424e-8109-b02112d12284 service swift] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:01.679979 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1211/2392] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 23:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 12 23:59:10.513799 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ef456-2d4c-4c73-9308-115a153d9ce9 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:10.515402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-1e4ef456-2d4c-4c73-9308-115a153d9ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:10.539886 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ef456-2d4c-4c73-9308-115a153d9ce9 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:10.546396 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ddea8d-210d-4e2b-8391-67ddc0d5bb0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:10.547389 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddea8d-210d-4e2b-8391-67ddc0d5bb0e service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:10.547662 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddea8d-210d-4e2b-8391-67ddc0d5bb0e service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:10.548128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ddea8d-210d-4e2b-8391-67ddc0d5bb0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:10.550168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-68ddea8d-210d-4e2b-8391-67ddc0d5bb0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:10.564196 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddea8d-210d-4e2b-8391-67ddc0d5bb0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:10.565937 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ddea8d-210d-4e2b-8391-67ddc0d5bb0e service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:10.580253 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1182/2393] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:59:11.673539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=31 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:15.916705 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bde51-bdb2-424e-8109-b02112d12284 service swift] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:16.017363 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bde51-bdb2-424e-8109-b02112d12284 service swift] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:16.024965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df199121-9f89-4f50-bb19-ba158b839a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:16.026105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df199121-9f89-4f50-bb19-ba158b839a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:16.026584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df199121-9f89-4f50-bb19-ba158b839a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:16.027048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df199121-9f89-4f50-bb19-ba158b839a41 admin admin] PATH_INFO: `/v3/users/894528f128af4b9cb0199bcba094d467` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:16.029159 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df199121-9f89-4f50-bb19-ba158b839a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=894528f128af4b9cb0199bcba094d467)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:16.032903 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df199121-9f89-4f50-bb19-ba158b839a41 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:16.117745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-df199121-9f89-4f50-bb19-ba158b839a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '894528f128af4b9cb0199bcba094d467'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:16.130797 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-df199121-9f89-4f50-bb19-ba158b839a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '894528f128af4b9cb0199bcba094d467'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:16.149481 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-df199121-9f89-4f50-bb19-ba158b839a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '894528f128af4b9cb0199bcba094d467'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:16.159482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-df199121-9f89-4f50-bb19-ba158b839a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '894528f128af4b9cb0199bcba094d467'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:16.160608 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-df199121-9f89-4f50-bb19-ba158b839a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '894528f128af4b9cb0199bcba094d467'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:16.169026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1212/2394] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:59:15 2022] DELETE /identity/v3/users/894528f128af4b9cb0199bcba094d467 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:16.174997 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f8ea4-e9fc-4a1b-b154-6f4339e16d24 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:16.175832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f8ea4-e9fc-4a1b-b154-6f4339e16d24 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:16.175832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f8ea4-e9fc-4a1b-b154-6f4339e16d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:16.199247 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-4c9f8ea4-e9fc-4a1b-b154-6f4339e16d24 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:16.200519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4c9f8ea4-e9fc-4a1b-b154-6f4339e16d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:16.268770 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1183/2395] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:59:16.279906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df199121-9f89-4f50-bb19-ba158b839a41 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:16.281780 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-df199121-9f89-4f50-bb19-ba158b839a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:16.348410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df199121-9f89-4f50-bb19-ba158b839a41 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:16.352270 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d456b-e89b-4d89-b6ea-6c01f27f745f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:16.352907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d456b-e89b-4d89-b6ea-6c01f27f745f service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:16.353183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d456b-e89b-4d89-b6ea-6c01f27f745f service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:16.353486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d456b-e89b-4d89-b6ea-6c01f27f745f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:16.363865 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d456b-e89b-4d89-b6ea-6c01f27f745f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:16.365311 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d456b-e89b-4d89-b6ea-6c01f27f745f service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:16.376279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1213/2396] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:59:16.727104 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f8ea4-e9fc-4a1b-b154-6f4339e16d24 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:16.728775 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4c9f8ea4-e9fc-4a1b-b154-6f4339e16d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:16.748177 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f8ea4-e9fc-4a1b-b154-6f4339e16d24 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:16.756702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eee297-3fc8-4ed0-98b2-5c9128dc7597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:16.757789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eee297-3fc8-4ed0-98b2-5c9128dc7597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:16.758251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eee297-3fc8-4ed0-98b2-5c9128dc7597 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:16.758649 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eee297-3fc8-4ed0-98b2-5c9128dc7597 admin admin] PATH_INFO: `/v3/projects/ca2e40a507874cc8abea1298474c428a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:16.760485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eee297-3fc8-4ed0-98b2-5c9128dc7597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca2e40a507874cc8abea1298474c428a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:16.762703 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eee297-3fc8-4ed0-98b2-5c9128dc7597 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:16.819023 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d8eee297-3fc8-4ed0-98b2-5c9128dc7597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2e40a507874cc8abea1298474c428a', 'request_id': 'req-d8eee297-3fc8-4ed0-98b2-5c9128dc7597'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:16.828580 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d8eee297-3fc8-4ed0-98b2-5c9128dc7597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2e40a507874cc8abea1298474c428a', 'request_id': 'req-d8eee297-3fc8-4ed0-98b2-5c9128dc7597'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:16.841067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d8eee297-3fc8-4ed0-98b2-5c9128dc7597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2e40a507874cc8abea1298474c428a', 'request_id': 'req-d8eee297-3fc8-4ed0-98b2-5c9128dc7597'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:16.855860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:16.862924 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d8eee297-3fc8-4ed0-98b2-5c9128dc7597 admin admin] The token cache is being invalidate because project ca2e40a507874cc8abea1298474c428a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:59:16.863721 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d8eee297-3fc8-4ed0-98b2-5c9128dc7597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:16.865440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d8eee297-3fc8-4ed0-98b2-5c9128dc7597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:16.868407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1184/2397] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:59:16 2022] DELETE /identity/v3/projects/ca2e40a507874cc8abea1298474c428a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:59:16.874588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db21999-6560-4e36-8216-e004d41f673e None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:16.875200 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db21999-6560-4e36-8216-e004d41f673e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:16.875481 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db21999-6560-4e36-8216-e004d41f673e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:16.900530 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-0db21999-6560-4e36-8216-e004d41f673e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:16.901886 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0db21999-6560-4e36-8216-e004d41f673e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:16.923480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:16.996059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1214/2398] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:17.002958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b85a95-5bf0-48a7-939d-6f6355b5e0c7 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:17.003402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b85a95-5bf0-48a7-939d-6f6355b5e0c7 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:17.003829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b85a95-5bf0-48a7-939d-6f6355b5e0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:17.036465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-84b85a95-5bf0-48a7-939d-6f6355b5e0c7 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:17.038618 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-84b85a95-5bf0-48a7-939d-6f6355b5e0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:17.052123 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1185/2399] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:17.058990 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db21999-6560-4e36-8216-e004d41f673e None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:17.076623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db21999-6560-4e36-8216-e004d41f673e None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:17.084749 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dc37a-6627-46c8-88f5-40f6b39f3d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:17.085897 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dc37a-6627-46c8-88f5-40f6b39f3d03 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:17.085897 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dc37a-6627-46c8-88f5-40f6b39f3d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:17.086379 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dc37a-6627-46c8-88f5-40f6b39f3d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:17.087036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dc37a-6627-46c8-88f5-40f6b39f3d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:59:17.087396 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dc37a-6627-46c8-88f5-40f6b39f3d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:17.089745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dc37a-6627-46c8-88f5-40f6b39f3d03 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:17.106177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1215/2400] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:59:17.111013 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b85a95-5bf0-48a7-939d-6f6355b5e0c7 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:17.126304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b85a95-5bf0-48a7-939d-6f6355b5e0c7 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:17.130216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dc37a-6627-46c8-88f5-40f6b39f3d03 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:17.132215 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d469aba-bcaf-49c3-a074-6a4fa4ee7d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:17.132843 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d469aba-bcaf-49c3-a074-6a4fa4ee7d0a admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:17.133118 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d469aba-bcaf-49c3-a074-6a4fa4ee7d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:17.133431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d469aba-bcaf-49c3-a074-6a4fa4ee7d0a admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:17.133746 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ac5dc37a-6627-46c8-88f5-40f6b39f3d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:17.134100 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d469aba-bcaf-49c3-a074-6a4fa4ee7d0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:17.136090 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d469aba-bcaf-49c3-a074-6a4fa4ee7d0a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:17.177402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1186/2401] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:59:17 2022] POST /identity/v3/projects => generated 391 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:59:17.179565 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d469aba-bcaf-49c3-a074-6a4fa4ee7d0a admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:17.225186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dc37a-6627-46c8-88f5-40f6b39f3d03 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:17.264782 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d469aba-bcaf-49c3-a074-6a4fa4ee7d0a admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:17.270956 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab7ac6-c2c3-43ce-9389-700e521068fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:17.271604 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab7ac6-c2c3-43ce-9389-700e521068fe admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:17.271891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab7ac6-c2c3-43ce-9389-700e521068fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:17.272158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab7ac6-c2c3-43ce-9389-700e521068fe admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:17.272812 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab7ac6-c2c3-43ce-9389-700e521068fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:17.274850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab7ac6-c2c3-43ce-9389-700e521068fe admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:17.294469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a589c7-e938-46e0-8c0f-bf61509333fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:17.295583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a589c7-e938-46e0-8c0f-bf61509333fc service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:17.296087 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a589c7-e938-46e0-8c0f-bf61509333fc service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:17.296923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a589c7-e938-46e0-8c0f-bf61509333fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:17.300231 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-08a589c7-e938-46e0-8c0f-bf61509333fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:17.303896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1187/2402] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:59:17 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:59:17.310197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab7ac6-c2c3-43ce-9389-700e521068fe admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:17.317735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a589c7-e938-46e0-8c0f-bf61509333fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:17.319403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a589c7-e938-46e0-8c0f-bf61509333fc service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:17.324082 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab7ac6-c2c3-43ce-9389-700e521068fe admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:17.330081 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10206c00-994d-4560-823b-59a0dba5c344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:17.330728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10206c00-994d-4560-823b-59a0dba5c344 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:17.331008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10206c00-994d-4560-823b-59a0dba5c344 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:17.331282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10206c00-994d-4560-823b-59a0dba5c344 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:17.331966 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10206c00-994d-4560-823b-59a0dba5c344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:17.332316 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1216/2403] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:59:17.333844 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10206c00-994d-4560-823b-59a0dba5c344 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:17.346092 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1188/2404] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:17.352223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a589c7-e938-46e0-8c0f-bf61509333fc service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:17.363435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a589c7-e938-46e0-8c0f-bf61509333fc service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:17.369759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b299fa-86c8-49f2-b01d-df18ab9b88e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:17.370621 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b299fa-86c8-49f2-b01d-df18ab9b88e3 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:17.371464 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b299fa-86c8-49f2-b01d-df18ab9b88e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:17.371464 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b299fa-86c8-49f2-b01d-df18ab9b88e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:17.372285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b299fa-86c8-49f2-b01d-df18ab9b88e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:17.374239 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b299fa-86c8-49f2-b01d-df18ab9b88e3 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:17.390865 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1217/2405] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:59:17.395953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10206c00-994d-4560-823b-59a0dba5c344 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:17.411941 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10206c00-994d-4560-823b-59a0dba5c344 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:17.417140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb348f-7e90-42cc-8473-ac4ed1fdfea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:17.417858 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb348f-7e90-42cc-8473-ac4ed1fdfea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:17.418140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb348f-7e90-42cc-8473-ac4ed1fdfea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:17.418920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb348f-7e90-42cc-8473-ac4ed1fdfea8 admin admin] PATH_INFO: `/v3/projects/0815957aec1f4b1989a47a9bdddc082f/users/b4d68ec580654a68ad88e863ca380979/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:17.437257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb348f-7e90-42cc-8473-ac4ed1fdfea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0815957aec1f4b1989a47a9bdddc082f, user_id=b4d68ec580654a68ad88e863ca380979, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:17.440232 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb348f-7e90-42cc-8473-ac4ed1fdfea8 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:17.456137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1189/2406] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:17 2022] PUT /identity/v3/projects/0815957aec1f4b1989a47a9bdddc082f/users/b4d68ec580654a68ad88e863ca380979/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:59:17.467004 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65f6a1-70ef-4145-9641-edb02d789c18 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:17.467386 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65f6a1-70ef-4145-9641-edb02d789c18 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:17.467666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65f6a1-70ef-4145-9641-edb02d789c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:17.507410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-cc65f6a1-70ef-4145-9641-edb02d789c18 None None] MFA Rules not processed for user `b4d68ec580654a68ad88e863ca380979`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:17.509474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-cc65f6a1-70ef-4145-9641-edb02d789c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:17.569234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:17.603439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1218/2407] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:17.608490 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb348f-7e90-42cc-8473-ac4ed1fdfea8 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:17.610402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7efb348f-7e90-42cc-8473-ac4ed1fdfea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:17.683029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb348f-7e90-42cc-8473-ac4ed1fdfea8 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:17.687730 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c742c-21c9-484d-8654-7c5452a3b3ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:17.688445 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c742c-21c9-484d-8654-7c5452a3b3ad service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:17.688727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c742c-21c9-484d-8654-7c5452a3b3ad service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:17.689061 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c742c-21c9-484d-8654-7c5452a3b3ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:17.698886 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c742c-21c9-484d-8654-7c5452a3b3ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:17.700447 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c742c-21c9-484d-8654-7c5452a3b3ad service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:17.710835 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1190/2408] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:59:21.205524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65f6a1-70ef-4145-9641-edb02d789c18 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:21.207812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-cc65f6a1-70ef-4145-9641-edb02d789c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:21.276432 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c742c-21c9-484d-8654-7c5452a3b3ad service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:21.278020 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-276c742c-21c9-484d-8654-7c5452a3b3ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:21.311621 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65f6a1-70ef-4145-9641-edb02d789c18 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:21.317228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4fc2d-54a6-4c7b-8467-0ba82d20a227 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4395ee0a00df41adacb55b4a8684786b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:21.318332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4fc2d-54a6-4c7b-8467-0ba82d20a227 service placement] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:21.318792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4fc2d-54a6-4c7b-8467-0ba82d20a227 service placement] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:21.319223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4fc2d-54a6-4c7b-8467-0ba82d20a227 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:21.321625 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-e9b4fc2d-54a6-4c7b-8467-0ba82d20a227 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:21.322290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:21.336806 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4fc2d-54a6-4c7b-8467-0ba82d20a227 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:21.338576 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4fc2d-54a6-4c7b-8467-0ba82d20a227 service placement] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:21.352871 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1219/2409] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:59:21.373282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c742c-21c9-484d-8654-7c5452a3b3ad service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:21.378583 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fd5df-7b7e-4bee-aba8-bda235d0f981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:21.381273 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fd5df-7b7e-4bee-aba8-bda235d0f981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:21.382871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fd5df-7b7e-4bee-aba8-bda235d0f981 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:21.390697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fd5df-7b7e-4bee-aba8-bda235d0f981 admin admin] PATH_INFO: `/v3/users/a3caf53b684542ac87474ab807b5fdcc` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:21.392717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fd5df-7b7e-4bee-aba8-bda235d0f981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3caf53b684542ac87474ab807b5fdcc)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:21.395903 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fd5df-7b7e-4bee-aba8-bda235d0f981 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:21.464767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0e9fd5df-7b7e-4bee-aba8-bda235d0f981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3caf53b684542ac87474ab807b5fdcc'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:21.465692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0e9fd5df-7b7e-4bee-aba8-bda235d0f981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3caf53b684542ac87474ab807b5fdcc'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:21.466388 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0e9fd5df-7b7e-4bee-aba8-bda235d0f981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3caf53b684542ac87474ab807b5fdcc'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:21.480706 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0e9fd5df-7b7e-4bee-aba8-bda235d0f981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3caf53b684542ac87474ab807b5fdcc'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:21.487904 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0e9fd5df-7b7e-4bee-aba8-bda235d0f981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3caf53b684542ac87474ab807b5fdcc'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:21.502278 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1191/2410] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:59:21 2022] DELETE /identity/v3/users/a3caf53b684542ac87474ab807b5fdcc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:59:21.696795 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4fc2d-54a6-4c7b-8467-0ba82d20a227 service placement] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:21.717686 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4fc2d-54a6-4c7b-8467-0ba82d20a227 service placement] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:21.801491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f9efe-31d7-4d49-b825-c64b3608fa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:21.802977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f9efe-31d7-4d49-b825-c64b3608fa02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:21.803625 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f9efe-31d7-4d49-b825-c64b3608fa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:21.804143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f9efe-31d7-4d49-b825-c64b3608fa02 admin admin] PATH_INFO: `/v3/projects/61cc23b70e5c4c9fba8cae710001ae70` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:21.807753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f9efe-31d7-4d49-b825-c64b3608fa02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61cc23b70e5c4c9fba8cae710001ae70)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:21.811734 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f9efe-31d7-4d49-b825-c64b3608fa02 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:21.890748 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-9d1f9efe-31d7-4d49-b825-c64b3608fa02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61cc23b70e5c4c9fba8cae710001ae70', 'request_id': 'req-9d1f9efe-31d7-4d49-b825-c64b3608fa02'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:21.901488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-9d1f9efe-31d7-4d49-b825-c64b3608fa02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61cc23b70e5c4c9fba8cae710001ae70', 'request_id': 'req-9d1f9efe-31d7-4d49-b825-c64b3608fa02'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:21.910480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-9d1f9efe-31d7-4d49-b825-c64b3608fa02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61cc23b70e5c4c9fba8cae710001ae70', 'request_id': 'req-9d1f9efe-31d7-4d49-b825-c64b3608fa02'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:21.926320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-9d1f9efe-31d7-4d49-b825-c64b3608fa02 admin admin] The token cache is being invalidate because project 61cc23b70e5c4c9fba8cae710001ae70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:59:21.926615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-9d1f9efe-31d7-4d49-b825-c64b3608fa02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:21.927312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-9d1f9efe-31d7-4d49-b825-c64b3608fa02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:21.928914 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1220/2411] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:59:21 2022] DELETE /identity/v3/projects/61cc23b70e5c4c9fba8cae710001ae70 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:21.935809 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2ddb3-0c28-4bd7-bba7-d790c8355452 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:21.936233 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2ddb3-0c28-4bd7-bba7-d790c8355452 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:21.936599 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2ddb3-0c28-4bd7-bba7-d790c8355452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:21.961100 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-8ec2ddb3-0c28-4bd7-bba7-d790c8355452 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:21.962636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-8ec2ddb3-0c28-4bd7-bba7-d790c8355452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:22.069089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1192/2412] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:22.077661 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98c5a7-616a-4bef-82f1-3e64b90b1a7c None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:22.077943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98c5a7-616a-4bef-82f1-3e64b90b1a7c None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:22.078203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98c5a7-616a-4bef-82f1-3e64b90b1a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:22.094961 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:22.101869 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-3d98c5a7-616a-4bef-82f1-3e64b90b1a7c None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:22.104419 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3d98c5a7-616a-4bef-82f1-3e64b90b1a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:22.118611 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1221/2413] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:22.123539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2ddb3-0c28-4bd7-bba7-d790c8355452 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:22.137246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2ddb3-0c28-4bd7-bba7-d790c8355452 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:22.142444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2407c-3c31-40f5-a95d-22fda4f7b613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:22.142970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2407c-3c31-40f5-a95d-22fda4f7b613 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:22.143259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2407c-3c31-40f5-a95d-22fda4f7b613 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:22.143819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2407c-3c31-40f5-a95d-22fda4f7b613 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:22.144539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2407c-3c31-40f5-a95d-22fda4f7b613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:59:22.144849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2407c-3c31-40f5-a95d-22fda4f7b613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:22.146567 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2407c-3c31-40f5-a95d-22fda4f7b613 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:22.162645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1193/2414] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:59:22.169065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98c5a7-616a-4bef-82f1-3e64b90b1a7c None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:22.185290 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98c5a7-616a-4bef-82f1-3e64b90b1a7c None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:22.192687 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f18793-e553-4354-88e5-a725afc324db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:22.193728 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f18793-e553-4354-88e5-a725afc324db admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:22.194214 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f18793-e553-4354-88e5-a725afc324db admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:22.194671 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f18793-e553-4354-88e5-a725afc324db admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:22.195721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f18793-e553-4354-88e5-a725afc324db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:22.199301 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f18793-e553-4354-88e5-a725afc324db admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:22.232850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1222/2415] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:59:22 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:22.237935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2407c-3c31-40f5-a95d-22fda4f7b613 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:22.249034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2407c-3c31-40f5-a95d-22fda4f7b613 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:22.291867 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:22.322824 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763a1eb-0bcb-4389-a93f-9d61baa8dc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:22.323451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763a1eb-0bcb-4389-a93f-9d61baa8dc10 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:22.323732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763a1eb-0bcb-4389-a93f-9d61baa8dc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:22.324000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763a1eb-0bcb-4389-a93f-9d61baa8dc10 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:22.324653 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763a1eb-0bcb-4389-a93f-9d61baa8dc10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:22.326665 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763a1eb-0bcb-4389-a93f-9d61baa8dc10 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:22.350379 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1194/2416] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:59:22 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:59:22.355170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f18793-e553-4354-88e5-a725afc324db admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:22.366808 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f18793-e553-4354-88e5-a725afc324db admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:22.372900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97faf26-55ae-4f40-a05f-9e11a202be88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:22.373561 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97faf26-55ae-4f40-a05f-9e11a202be88 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:22.373828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97faf26-55ae-4f40-a05f-9e11a202be88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:22.374104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97faf26-55ae-4f40-a05f-9e11a202be88 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:22.374761 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97faf26-55ae-4f40-a05f-9e11a202be88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:22.376395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97faf26-55ae-4f40-a05f-9e11a202be88 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:22.387833 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1223/2417] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:22.392114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763a1eb-0bcb-4389-a93f-9d61baa8dc10 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:22.403566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763a1eb-0bcb-4389-a93f-9d61baa8dc10 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:22.409332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf95a95-b4a6-4757-a2e5-cf85dcf9f87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:22.410004 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf95a95-b4a6-4757-a2e5-cf85dcf9f87f admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:22.410279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf95a95-b4a6-4757-a2e5-cf85dcf9f87f admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:22.411264 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf95a95-b4a6-4757-a2e5-cf85dcf9f87f admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:22.411494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf95a95-b4a6-4757-a2e5-cf85dcf9f87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:22.413131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf95a95-b4a6-4757-a2e5-cf85dcf9f87f admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:22.425600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1195/2418] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:22.430050 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97faf26-55ae-4f40-a05f-9e11a202be88 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:22.440937 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97faf26-55ae-4f40-a05f-9e11a202be88 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:22.445728 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9840e6-d52a-4999-b0d9-3b6c8393183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:22.446406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9840e6-d52a-4999-b0d9-3b6c8393183f admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:22.446681 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9840e6-d52a-4999-b0d9-3b6c8393183f admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:22.446986 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9840e6-d52a-4999-b0d9-3b6c8393183f admin admin] PATH_INFO: `/v3/projects/7f3dd9d7780442f6a55cfc9552a300e8/users/6caa52bf72fe423f9567ca24cf1617ac/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:22.463585 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9840e6-d52a-4999-b0d9-3b6c8393183f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f3dd9d7780442f6a55cfc9552a300e8, user_id=6caa52bf72fe423f9567ca24cf1617ac, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:22.466358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9840e6-d52a-4999-b0d9-3b6c8393183f admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:22.481885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1224/2419] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:22 2022] PUT /identity/v3/projects/7f3dd9d7780442f6a55cfc9552a300e8/users/6caa52bf72fe423f9567ca24cf1617ac/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:59:22.494137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb52617-ca4e-49d6-8300-1f436619f9f2 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:22.494716 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb52617-ca4e-49d6-8300-1f436619f9f2 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:22.495198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb52617-ca4e-49d6-8300-1f436619f9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:22.539062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-feb52617-ca4e-49d6-8300-1f436619f9f2 None None] MFA Rules not processed for user `6caa52bf72fe423f9567ca24cf1617ac`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:22.540344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-feb52617-ca4e-49d6-8300-1f436619f9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:22.615050 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1196/2420] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:22.627058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9840e6-d52a-4999-b0d9-3b6c8393183f admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:22.628825 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-df9840e6-d52a-4999-b0d9-3b6c8393183f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:22.734667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9840e6-d52a-4999-b0d9-3b6c8393183f admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:22.744833 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31f617-7758-4523-93af-ea87a6ccdd0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:22.745925 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31f617-7758-4523-93af-ea87a6ccdd0a service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:22.746449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31f617-7758-4523-93af-ea87a6ccdd0a service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:22.746953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31f617-7758-4523-93af-ea87a6ccdd0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:22.756891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31f617-7758-4523-93af-ea87a6ccdd0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:22.758550 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31f617-7758-4523-93af-ea87a6ccdd0a service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:22.769239 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1225/2421] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:59:25.629862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb52617-ca4e-49d6-8300-1f436619f9f2 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:25.702824 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb52617-ca4e-49d6-8300-1f436619f9f2 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:25.707518 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fc492-09e9-4400-94bd-1e812ec90736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:25.708156 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fc492-09e9-4400-94bd-1e812ec90736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:25.708432 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fc492-09e9-4400-94bd-1e812ec90736 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:25.708761 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fc492-09e9-4400-94bd-1e812ec90736 admin admin] PATH_INFO: `/v3/users/6caa52bf72fe423f9567ca24cf1617ac` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:25.709847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fc492-09e9-4400-94bd-1e812ec90736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6caa52bf72fe423f9567ca24cf1617ac)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:25.711869 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fc492-09e9-4400-94bd-1e812ec90736 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:25.764833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:25.766808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-118fc492-09e9-4400-94bd-1e812ec90736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6caa52bf72fe423f9567ca24cf1617ac'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:25.767590 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-118fc492-09e9-4400-94bd-1e812ec90736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6caa52bf72fe423f9567ca24cf1617ac'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:25.768321 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-118fc492-09e9-4400-94bd-1e812ec90736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6caa52bf72fe423f9567ca24cf1617ac'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:25.785474 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-118fc492-09e9-4400-94bd-1e812ec90736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6caa52bf72fe423f9567ca24cf1617ac'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:25.798526 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-118fc492-09e9-4400-94bd-1e812ec90736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6caa52bf72fe423f9567ca24cf1617ac'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:25.813638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1197/2422] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:59:25 2022] DELETE /identity/v3/users/6caa52bf72fe423f9567ca24cf1617ac => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:25.818644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b08b6-e057-4b63-81f1-e18798c06e83 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:25.819232 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b08b6-e057-4b63-81f1-e18798c06e83 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:25.819232 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b08b6-e057-4b63-81f1-e18798c06e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:25.840338 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-300b08b6-e057-4b63-81f1-e18798c06e83 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:25.841629 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-300b08b6-e057-4b63-81f1-e18798c06e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:25.910237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1226/2423] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:59:25.922141 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fc492-09e9-4400-94bd-1e812ec90736 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:25.923714 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-118fc492-09e9-4400-94bd-1e812ec90736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:25.989048 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fc492-09e9-4400-94bd-1e812ec90736 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:25.993250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd94e2a-4f78-40cc-9d9f-48b085b8c3a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:25.993952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd94e2a-4f78-40cc-9d9f-48b085b8c3a4 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:25.994231 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd94e2a-4f78-40cc-9d9f-48b085b8c3a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:25.994503 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd94e2a-4f78-40cc-9d9f-48b085b8c3a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:26.007067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd94e2a-4f78-40cc-9d9f-48b085b8c3a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:26.008601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd94e2a-4f78-40cc-9d9f-48b085b8c3a4 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:26.020375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1198/2424] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:59:26.338242 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b08b6-e057-4b63-81f1-e18798c06e83 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:26.341252 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-300b08b6-e057-4b63-81f1-e18798c06e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:26.367380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b08b6-e057-4b63-81f1-e18798c06e83 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:26.379486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c313aaf-d92d-4112-b40c-99d2ebd56bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:26.382742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c313aaf-d92d-4112-b40c-99d2ebd56bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:26.383198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c313aaf-d92d-4112-b40c-99d2ebd56bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:26.383680 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c313aaf-d92d-4112-b40c-99d2ebd56bf8 admin admin] PATH_INFO: `/v3/projects/7f3dd9d7780442f6a55cfc9552a300e8` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:26.385324 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c313aaf-d92d-4112-b40c-99d2ebd56bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f3dd9d7780442f6a55cfc9552a300e8)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:26.388048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c313aaf-d92d-4112-b40c-99d2ebd56bf8 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:26.430000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:26.459586 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5c313aaf-d92d-4112-b40c-99d2ebd56bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f3dd9d7780442f6a55cfc9552a300e8', 'request_id': 'req-5c313aaf-d92d-4112-b40c-99d2ebd56bf8'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:26.468204 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5c313aaf-d92d-4112-b40c-99d2ebd56bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f3dd9d7780442f6a55cfc9552a300e8', 'request_id': 'req-5c313aaf-d92d-4112-b40c-99d2ebd56bf8'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:26.474696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5c313aaf-d92d-4112-b40c-99d2ebd56bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f3dd9d7780442f6a55cfc9552a300e8', 'request_id': 'req-5c313aaf-d92d-4112-b40c-99d2ebd56bf8'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:26.486909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5c313aaf-d92d-4112-b40c-99d2ebd56bf8 admin admin] The token cache is being invalidate because project 7f3dd9d7780442f6a55cfc9552a300e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:59:26.487198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5c313aaf-d92d-4112-b40c-99d2ebd56bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:26.487881 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5c313aaf-d92d-4112-b40c-99d2ebd56bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:26.489440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1227/2425] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:59:26 2022] DELETE /identity/v3/projects/7f3dd9d7780442f6a55cfc9552a300e8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:26.494721 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23655aa-d37b-495a-8f83-1724af1b1c80 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:26.495030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23655aa-d37b-495a-8f83-1724af1b1c80 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:26.495411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23655aa-d37b-495a-8f83-1724af1b1c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:26.516172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-d23655aa-d37b-495a-8f83-1724af1b1c80 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:26.517427 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-d23655aa-d37b-495a-8f83-1724af1b1c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:26.588304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1199/2426] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:26.598636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb023c2-c167-431c-a31c-16cb5d4affb4 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:26.599082 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb023c2-c167-431c-a31c-16cb5d4affb4 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:26.599532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb023c2-c167-431c-a31c-16cb5d4affb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:26.624753 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-8eb023c2-c167-431c-a31c-16cb5d4affb4 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:26.626003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-8eb023c2-c167-431c-a31c-16cb5d4affb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:26.635045 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1228/2427] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:26.639648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23655aa-d37b-495a-8f83-1724af1b1c80 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:26.651677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23655aa-d37b-495a-8f83-1724af1b1c80 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:26.657846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136450ca-375a-4002-a263-fd1e597f1c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:26.658458 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136450ca-375a-4002-a263-fd1e597f1c5f admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:26.658730 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136450ca-375a-4002-a263-fd1e597f1c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:26.658994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136450ca-375a-4002-a263-fd1e597f1c5f admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:26.659651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136450ca-375a-4002-a263-fd1e597f1c5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:59:26.659945 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136450ca-375a-4002-a263-fd1e597f1c5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:26.661586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136450ca-375a-4002-a263-fd1e597f1c5f admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:26.674487 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1200/2428] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:59:26.679185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb023c2-c167-431c-a31c-16cb5d4affb4 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:26.690065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb023c2-c167-431c-a31c-16cb5d4affb4 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:26.695560 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb61b1-2891-408f-9b1d-b50f7695c89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:26.696186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb61b1-2891-408f-9b1d-b50f7695c89e admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:26.696472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb61b1-2891-408f-9b1d-b50f7695c89e admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:26.696747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb61b1-2891-408f-9b1d-b50f7695c89e admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:26.697431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb61b1-2891-408f-9b1d-b50f7695c89e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:26.699380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb61b1-2891-408f-9b1d-b50f7695c89e admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:26.729052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1229/2429] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:59:26 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:26.734134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136450ca-375a-4002-a263-fd1e597f1c5f admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:26.746663 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136450ca-375a-4002-a263-fd1e597f1c5f admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:26.800544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:26.813457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45613675-4dca-419e-aae8-4cbd70271fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:26.814071 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45613675-4dca-419e-aae8-4cbd70271fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:26.814357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45613675-4dca-419e-aae8-4cbd70271fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:26.814657 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45613675-4dca-419e-aae8-4cbd70271fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:26.815297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45613675-4dca-419e-aae8-4cbd70271fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:26.817229 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45613675-4dca-419e-aae8-4cbd70271fb6 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:26.841669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1201/2430] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:59:26 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:26.846148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb61b1-2891-408f-9b1d-b50f7695c89e admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:26.856779 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb61b1-2891-408f-9b1d-b50f7695c89e admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:26.861698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b7d8d-44fe-4cfd-9988-3cbcbb356953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:26.862333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b7d8d-44fe-4cfd-9988-3cbcbb356953 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:26.862612 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b7d8d-44fe-4cfd-9988-3cbcbb356953 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:26.862882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b7d8d-44fe-4cfd-9988-3cbcbb356953 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:26.863531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b7d8d-44fe-4cfd-9988-3cbcbb356953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:26.865146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b7d8d-44fe-4cfd-9988-3cbcbb356953 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:26.875312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1230/2431] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:26.879494 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45613675-4dca-419e-aae8-4cbd70271fb6 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:26.889542 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45613675-4dca-419e-aae8-4cbd70271fb6 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:26.894633 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d18411-868d-4fc4-ad73-4b0a99ccebb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:26.895236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d18411-868d-4fc4-ad73-4b0a99ccebb2 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:26.895523 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d18411-868d-4fc4-ad73-4b0a99ccebb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:26.895792 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d18411-868d-4fc4-ad73-4b0a99ccebb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:26.896446 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d18411-868d-4fc4-ad73-4b0a99ccebb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:26.898110 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d18411-868d-4fc4-ad73-4b0a99ccebb2 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:26.910555 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1202/2432] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:26.915072 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b7d8d-44fe-4cfd-9988-3cbcbb356953 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:26.926480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b7d8d-44fe-4cfd-9988-3cbcbb356953 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:26.932097 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248ed30-edfc-40c9-a29f-71a5d4d0c747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:26.932807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248ed30-edfc-40c9-a29f-71a5d4d0c747 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:26.933108 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248ed30-edfc-40c9-a29f-71a5d4d0c747 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:26.933368 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248ed30-edfc-40c9-a29f-71a5d4d0c747 admin admin] PATH_INFO: `/v3/projects/8661118fb5fb4d878becbd596636ad74/users/4e8a6cd3309a448081bdad3625dcf44f/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:26.949499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248ed30-edfc-40c9-a29f-71a5d4d0c747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8661118fb5fb4d878becbd596636ad74, user_id=4e8a6cd3309a448081bdad3625dcf44f, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:26.952172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248ed30-edfc-40c9-a29f-71a5d4d0c747 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:26.966841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1231/2433] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:26 2022] PUT /identity/v3/projects/8661118fb5fb4d878becbd596636ad74/users/4e8a6cd3309a448081bdad3625dcf44f/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:26.978302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d0625-d815-4d8f-bd31-25de211a1247 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:26.978576 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d0625-d815-4d8f-bd31-25de211a1247 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:26.978723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d0625-d815-4d8f-bd31-25de211a1247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:27.015424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-722d0625-d815-4d8f-bd31-25de211a1247 None None] MFA Rules not processed for user `4e8a6cd3309a448081bdad3625dcf44f`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:27.016564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-722d0625-d815-4d8f-bd31-25de211a1247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:27.092143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1203/2434] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:27.097062 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248ed30-edfc-40c9-a29f-71a5d4d0c747 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:27.164233 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248ed30-edfc-40c9-a29f-71a5d4d0c747 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:27.169166 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ce2c9-ab8e-4416-914f-0377a724a40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:27.169828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ce2c9-ab8e-4416-914f-0377a724a40c admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:27.170107 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ce2c9-ab8e-4416-914f-0377a724a40c admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:27.170379 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ce2c9-ab8e-4416-914f-0377a724a40c admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:27.171031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ce2c9-ab8e-4416-914f-0377a724a40c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:27.173294 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ce2c9-ab8e-4416-914f-0377a724a40c admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:27.203151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1232/2435] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:59:27 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:27.207728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d0625-d815-4d8f-bd31-25de211a1247 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:27.219029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d0625-d815-4d8f-bd31-25de211a1247 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:27.282516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab313189-ab27-4558-82e6-10ea3fe7904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:27.283147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab313189-ab27-4558-82e6-10ea3fe7904f admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:27.283422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab313189-ab27-4558-82e6-10ea3fe7904f admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:27.283699 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab313189-ab27-4558-82e6-10ea3fe7904f admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:27.284336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab313189-ab27-4558-82e6-10ea3fe7904f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:27.286329 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab313189-ab27-4558-82e6-10ea3fe7904f admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:27.312464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1204/2436] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:59:27 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:27.316929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ce2c9-ab8e-4416-914f-0377a724a40c admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:27.328180 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ce2c9-ab8e-4416-914f-0377a724a40c admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:27.334425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23150054-f7a0-4231-bd80-28b92b44e584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:27.335079 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23150054-f7a0-4231-bd80-28b92b44e584 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:27.335360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23150054-f7a0-4231-bd80-28b92b44e584 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:27.335643 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23150054-f7a0-4231-bd80-28b92b44e584 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:27.336300 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23150054-f7a0-4231-bd80-28b92b44e584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:27.337932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23150054-f7a0-4231-bd80-28b92b44e584 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:27.358965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1233/2437] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:27.360153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab313189-ab27-4558-82e6-10ea3fe7904f admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:27.372620 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab313189-ab27-4558-82e6-10ea3fe7904f admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:27.379441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd91ae-fbc6-4cd5-a61a-560631e7c8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:27.380219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd91ae-fbc6-4cd5-a61a-560631e7c8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:27.380488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd91ae-fbc6-4cd5-a61a-560631e7c8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:27.380764 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd91ae-fbc6-4cd5-a61a-560631e7c8e3 admin admin] PATH_INFO: `/v3/projects/81ddfa52ddd8489cb84fb6f8650269a9/users/9db9c501bc1749bda8a814193c8b6136/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:27.398848 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd91ae-fbc6-4cd5-a61a-560631e7c8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ddfa52ddd8489cb84fb6f8650269a9, user_id=9db9c501bc1749bda8a814193c8b6136, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:27.401744 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd91ae-fbc6-4cd5-a61a-560631e7c8e3 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:27.419617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1205/2438] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:27 2022] PUT /identity/v3/projects/81ddfa52ddd8489cb84fb6f8650269a9/users/9db9c501bc1749bda8a814193c8b6136/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:27.424321 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23150054-f7a0-4231-bd80-28b92b44e584 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:27.435229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23150054-f7a0-4231-bd80-28b92b44e584 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:27.460737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:27.507984 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edb1e6-5e3f-473b-9fe5-ec4fbd3d24c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:27.508622 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edb1e6-5e3f-473b-9fe5-ec4fbd3d24c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:27.508900 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edb1e6-5e3f-473b-9fe5-ec4fbd3d24c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:27.509178 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edb1e6-5e3f-473b-9fe5-ec4fbd3d24c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:27.509876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edb1e6-5e3f-473b-9fe5-ec4fbd3d24c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:27.511503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edb1e6-5e3f-473b-9fe5-ec4fbd3d24c6 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:27.524014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1234/2439] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:27.529309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd91ae-fbc6-4cd5-a61a-560631e7c8e3 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:27.541382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd91ae-fbc6-4cd5-a61a-560631e7c8e3 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:27.548341 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b625bff-d2a2-42ae-9031-3c459901005c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:27.549106 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b625bff-d2a2-42ae-9031-3c459901005c admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:27.549421 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b625bff-d2a2-42ae-9031-3c459901005c admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:27.549694 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b625bff-d2a2-42ae-9031-3c459901005c admin admin] PATH_INFO: `/v3/projects/81ddfa52ddd8489cb84fb6f8650269a9/users/9db9c501bc1749bda8a814193c8b6136/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:27.552175 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b625bff-d2a2-42ae-9031-3c459901005c admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ddfa52ddd8489cb84fb6f8650269a9, user_id=9db9c501bc1749bda8a814193c8b6136, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:27.555165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b625bff-d2a2-42ae-9031-3c459901005c admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:27.567126 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1206/2440] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:27 2022] PUT /identity/v3/projects/81ddfa52ddd8489cb84fb6f8650269a9/users/9db9c501bc1749bda8a814193c8b6136/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:59:27.578928 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1ab5c-c090-4818-baee-40f43688b70d None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:27.579409 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1ab5c-c090-4818-baee-40f43688b70d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:27.579886 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1ab5c-c090-4818-baee-40f43688b70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:27.623692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-8ea1ab5c-c090-4818-baee-40f43688b70d None None] MFA Rules not processed for user `9db9c501bc1749bda8a814193c8b6136`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:27.625469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-8ea1ab5c-c090-4818-baee-40f43688b70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:27.704435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1235/2441] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:27.718400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b625bff-d2a2-42ae-9031-3c459901005c admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:27.720270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5b625bff-d2a2-42ae-9031-3c459901005c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:27.737285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:27.790520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b625bff-d2a2-42ae-9031-3c459901005c admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:27.794513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4a04d-fd4d-4b2a-928c-f80f58e2ab78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:27.795143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4a04d-fd4d-4b2a-928c-f80f58e2ab78 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:27.795439 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4a04d-fd4d-4b2a-928c-f80f58e2ab78 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:27.795685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4a04d-fd4d-4b2a-928c-f80f58e2ab78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:27.806247 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4a04d-fd4d-4b2a-928c-f80f58e2ab78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:27.807810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4a04d-fd4d-4b2a-928c-f80f58e2ab78 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:27.819078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1207/2442] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:59:27.917088 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1ab5c-c090-4818-baee-40f43688b70d None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:27.931319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1ab5c-c090-4818-baee-40f43688b70d None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:27.938492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd85750-91cb-4b0a-b4ca-13d40ab0ad85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:27.939581 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd85750-91cb-4b0a-b4ca-13d40ab0ad85 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:27.940052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd85750-91cb-4b0a-b4ca-13d40ab0ad85 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:27.940676 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd85750-91cb-4b0a-b4ca-13d40ab0ad85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:28.038210 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd85750-91cb-4b0a-b4ca-13d40ab0ad85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:28.039588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd85750-91cb-4b0a-b4ca-13d40ab0ad85 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:28.050327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1236/2443] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:59:28.441191 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4a04d-fd4d-4b2a-928c-f80f58e2ab78 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:28.446410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-05a4a04d-fd4d-4b2a-928c-f80f58e2ab78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:28.525259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4a04d-fd4d-4b2a-928c-f80f58e2ab78 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:28.531174 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a79a18-61a6-4a60-b60f-84f63b9a1aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:28.531967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a79a18-61a6-4a60-b60f-84f63b9a1aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:28.532289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a79a18-61a6-4a60-b60f-84f63b9a1aec admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:28.532596 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a79a18-61a6-4a60-b60f-84f63b9a1aec admin admin] PATH_INFO: `/v3/users/b4d68ec580654a68ad88e863ca380979` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:28.534093 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a79a18-61a6-4a60-b60f-84f63b9a1aec admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d68ec580654a68ad88e863ca380979)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:28.536147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a79a18-61a6-4a60-b60f-84f63b9a1aec admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:28.597215 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-32a79a18-61a6-4a60-b60f-84f63b9a1aec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d68ec580654a68ad88e863ca380979'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:28.598290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-32a79a18-61a6-4a60-b60f-84f63b9a1aec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d68ec580654a68ad88e863ca380979'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:28.599280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-32a79a18-61a6-4a60-b60f-84f63b9a1aec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d68ec580654a68ad88e863ca380979'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:28.621785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-32a79a18-61a6-4a60-b60f-84f63b9a1aec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d68ec580654a68ad88e863ca380979'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:28.633769 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-32a79a18-61a6-4a60-b60f-84f63b9a1aec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d68ec580654a68ad88e863ca380979'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:28.653191 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1208/2444] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:59:28 2022] DELETE /identity/v3/users/b4d68ec580654a68ad88e863ca380979 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:28.658283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b348e4d-6d18-42d3-b488-202d99083903 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:28.658674 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b348e4d-6d18-42d3-b488-202d99083903 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:28.659000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b348e4d-6d18-42d3-b488-202d99083903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:28.682610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-8b348e4d-6d18-42d3-b488-202d99083903 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:28.683867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-8b348e4d-6d18-42d3-b488-202d99083903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:28.728769 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:28.752372 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1237/2445] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:28.763847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a79a18-61a6-4a60-b60f-84f63b9a1aec admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:28.765594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-32a79a18-61a6-4a60-b60f-84f63b9a1aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:28.812480 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:28.835972 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a79a18-61a6-4a60-b60f-84f63b9a1aec admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:28.841077 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17497428-f96c-408a-aff9-464884b41654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:28.841846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17497428-f96c-408a-aff9-464884b41654 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:28.842319 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17497428-f96c-408a-aff9-464884b41654 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:28.842591 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17497428-f96c-408a-aff9-464884b41654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:28.853114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17497428-f96c-408a-aff9-464884b41654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:28.854639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17497428-f96c-408a-aff9-464884b41654 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:28.864840 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1209/2446] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:59:29.170474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b348e4d-6d18-42d3-b488-202d99083903 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:29.172538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-8b348e4d-6d18-42d3-b488-202d99083903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:29.186761 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b348e4d-6d18-42d3-b488-202d99083903 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:29.192365 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104a8c7-856d-4520-aaeb-45fba58fede9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:29.193038 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104a8c7-856d-4520-aaeb-45fba58fede9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:29.193313 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104a8c7-856d-4520-aaeb-45fba58fede9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:29.193625 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104a8c7-856d-4520-aaeb-45fba58fede9 admin admin] PATH_INFO: `/v3/projects/0815957aec1f4b1989a47a9bdddc082f` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:29.194975 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104a8c7-856d-4520-aaeb-45fba58fede9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0815957aec1f4b1989a47a9bdddc082f)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:29.196919 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104a8c7-856d-4520-aaeb-45fba58fede9 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:29.250865 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8104a8c7-856d-4520-aaeb-45fba58fede9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0815957aec1f4b1989a47a9bdddc082f', 'request_id': 'req-8104a8c7-856d-4520-aaeb-45fba58fede9'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:29.262166 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8104a8c7-856d-4520-aaeb-45fba58fede9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0815957aec1f4b1989a47a9bdddc082f', 'request_id': 'req-8104a8c7-856d-4520-aaeb-45fba58fede9'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:29.270232 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8104a8c7-856d-4520-aaeb-45fba58fede9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0815957aec1f4b1989a47a9bdddc082f', 'request_id': 'req-8104a8c7-856d-4520-aaeb-45fba58fede9'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:29.284141 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8104a8c7-856d-4520-aaeb-45fba58fede9 admin admin] The token cache is being invalidate because project 0815957aec1f4b1989a47a9bdddc082f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:59:29.284473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8104a8c7-856d-4520-aaeb-45fba58fede9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:29.285226 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8104a8c7-856d-4520-aaeb-45fba58fede9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:29.286854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1238/2447] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:59:29 2022] DELETE /identity/v3/projects/0815957aec1f4b1989a47a9bdddc082f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:29.293333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593687f-ae0f-4e82-b236-d805748c4ebb None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:29.293333 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593687f-ae0f-4e82-b236-d805748c4ebb None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:29.294169 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593687f-ae0f-4e82-b236-d805748c4ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:29.320802 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-1593687f-ae0f-4e82-b236-d805748c4ebb None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:29.322074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-1593687f-ae0f-4e82-b236-d805748c4ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:29.390984 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1210/2448] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:29.399449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cdcf3-2bc3-4dd3-aa37-087d9087e705 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:29.399735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cdcf3-2bc3-4dd3-aa37-087d9087e705 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:29.399984 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cdcf3-2bc3-4dd3-aa37-087d9087e705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:29.423661 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-983cdcf3-2bc3-4dd3-aa37-087d9087e705 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:29.424733 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-983cdcf3-2bc3-4dd3-aa37-087d9087e705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:29.433243 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1239/2449] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:29.437819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593687f-ae0f-4e82-b236-d805748c4ebb None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:29.449790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593687f-ae0f-4e82-b236-d805748c4ebb None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:29.454929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32678531-9e41-4bcd-b95e-14b86bb2ac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:29.455644 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678531-9e41-4bcd-b95e-14b86bb2ac83 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:29.456031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678531-9e41-4bcd-b95e-14b86bb2ac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:29.456266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678531-9e41-4bcd-b95e-14b86bb2ac83 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:29.457384 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32678531-9e41-4bcd-b95e-14b86bb2ac83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:59:29.458059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32678531-9e41-4bcd-b95e-14b86bb2ac83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:29.459755 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32678531-9e41-4bcd-b95e-14b86bb2ac83 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:29.473416 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1211/2450] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:59:29.477417 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cdcf3-2bc3-4dd3-aa37-087d9087e705 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:29.488120 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cdcf3-2bc3-4dd3-aa37-087d9087e705 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:29.493031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d54a1a-37d1-4d03-9b89-d4bd7ac0caf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:29.493704 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d54a1a-37d1-4d03-9b89-d4bd7ac0caf3 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:29.493981 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d54a1a-37d1-4d03-9b89-d4bd7ac0caf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:29.494249 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d54a1a-37d1-4d03-9b89-d4bd7ac0caf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:29.494913 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d54a1a-37d1-4d03-9b89-d4bd7ac0caf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:29.496993 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d54a1a-37d1-4d03-9b89-d4bd7ac0caf3 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:29.537440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1240/2451] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:59:29 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:29.539714 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32678531-9e41-4bcd-b95e-14b86bb2ac83 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:29.554874 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32678531-9e41-4bcd-b95e-14b86bb2ac83 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:29.625049 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98a30d-838d-468e-84e5-e256023ac2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:29.625817 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98a30d-838d-468e-84e5-e256023ac2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:29.626165 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98a30d-838d-468e-84e5-e256023ac2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:29.626435 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98a30d-838d-468e-84e5-e256023ac2c9 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:29.627072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98a30d-838d-468e-84e5-e256023ac2c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:29.629068 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c98a30d-838d-468e-84e5-e256023ac2c9 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:29.658736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1212/2452] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:59:29 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:29.664492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d54a1a-37d1-4d03-9b89-d4bd7ac0caf3 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:29.677194 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d54a1a-37d1-4d03-9b89-d4bd7ac0caf3 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:29.683272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69236a8-2c19-42cc-b149-9a89446d7147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:29.684100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69236a8-2c19-42cc-b149-9a89446d7147 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:29.684439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69236a8-2c19-42cc-b149-9a89446d7147 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:29.684777 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69236a8-2c19-42cc-b149-9a89446d7147 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:29.685640 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69236a8-2c19-42cc-b149-9a89446d7147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:29.687356 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69236a8-2c19-42cc-b149-9a89446d7147 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:29.699178 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1241/2453] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:29.703590 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98a30d-838d-468e-84e5-e256023ac2c9 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:29.716525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98a30d-838d-468e-84e5-e256023ac2c9 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:29.721115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a35a04-0e11-4110-8c89-3c6c0f1ca635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:29.721849 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a35a04-0e11-4110-8c89-3c6c0f1ca635 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:29.722135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a35a04-0e11-4110-8c89-3c6c0f1ca635 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:29.722408 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a35a04-0e11-4110-8c89-3c6c0f1ca635 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:29.723326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a35a04-0e11-4110-8c89-3c6c0f1ca635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:29.725785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a35a04-0e11-4110-8c89-3c6c0f1ca635 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:29.740285 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1213/2454] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:59:29.749061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69236a8-2c19-42cc-b149-9a89446d7147 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:29.760663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69236a8-2c19-42cc-b149-9a89446d7147 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:29.774036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3315f87-6400-43fc-a868-de6ad8e12329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:29.774036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3315f87-6400-43fc-a868-de6ad8e12329 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:29.774036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3315f87-6400-43fc-a868-de6ad8e12329 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:29.774036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3315f87-6400-43fc-a868-de6ad8e12329 admin admin] PATH_INFO: `/v3/projects/2a00b5186a78428f82fe12d67213a216/users/4020e53710354715b9c8a21d08618834/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:29.803344 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3315f87-6400-43fc-a868-de6ad8e12329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a00b5186a78428f82fe12d67213a216, user_id=4020e53710354715b9c8a21d08618834, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:29.808659 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3315f87-6400-43fc-a868-de6ad8e12329 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:29.829820 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1242/2455] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:29 2022] PUT /identity/v3/projects/2a00b5186a78428f82fe12d67213a216/users/4020e53710354715b9c8a21d08618834/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:29.835685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cd8af-d594-4a0a-b040-90c7b48ad488 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:29.836362 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cd8af-d594-4a0a-b040-90c7b48ad488 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:29.836362 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cd8af-d594-4a0a-b040-90c7b48ad488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:29.863190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-d10cd8af-d594-4a0a-b040-90c7b48ad488 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:29.864641 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-d10cd8af-d594-4a0a-b040-90c7b48ad488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:29.909483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:29.941714 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1214/2456] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:59:29.955033 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3315f87-6400-43fc-a868-de6ad8e12329 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:29.957270 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c3315f87-6400-43fc-a868-de6ad8e12329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:30.031681 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3315f87-6400-43fc-a868-de6ad8e12329 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:30.036198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935db656-d92f-4962-8bb5-177bd60fd3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:30.036865 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935db656-d92f-4962-8bb5-177bd60fd3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:30.037144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935db656-d92f-4962-8bb5-177bd60fd3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:30.037442 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935db656-d92f-4962-8bb5-177bd60fd3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:30.048480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935db656-d92f-4962-8bb5-177bd60fd3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:30.050132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935db656-d92f-4962-8bb5-177bd60fd3b9 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:30.062627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1243/2457] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:59:34.603786 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7964b-c13f-4df8-9e7b-56ba956c1f27 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:34.604552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7964b-c13f-4df8-9e7b-56ba956c1f27 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:34.604864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7964b-c13f-4df8-9e7b-56ba956c1f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:34.641117 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-e9a7964b-c13f-4df8-9e7b-56ba956c1f27 None None] MFA Rules not processed for user `4020e53710354715b9c8a21d08618834`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:34.642689 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e9a7964b-c13f-4df8-9e7b-56ba956c1f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:34.730446 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1215/2458] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:34.735672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935db656-d92f-4962-8bb5-177bd60fd3b9 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:34.742632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:34.748456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935db656-d92f-4962-8bb5-177bd60fd3b9 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:34.759594 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f10deb-a744-41cd-8a6d-2aa0581f9ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:34.760427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f10deb-a744-41cd-8a6d-2aa0581f9ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:34.760810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f10deb-a744-41cd-8a6d-2aa0581f9ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:34.761179 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f10deb-a744-41cd-8a6d-2aa0581f9ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:34.762050 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f10deb-a744-41cd-8a6d-2aa0581f9ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:34.767338 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f10deb-a744-41cd-8a6d-2aa0581f9ee5 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:34.814829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1244/2459] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:59:34 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:34.820209 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7964b-c13f-4df8-9e7b-56ba956c1f27 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:34.837473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7964b-c13f-4df8-9e7b-56ba956c1f27 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:34.930404 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f341f64-11a2-47c0-9bb1-761c316ab90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:34.931328 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f341f64-11a2-47c0-9bb1-761c316ab90a admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:34.931759 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f341f64-11a2-47c0-9bb1-761c316ab90a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:34.932213 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f341f64-11a2-47c0-9bb1-761c316ab90a admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:34.932868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f341f64-11a2-47c0-9bb1-761c316ab90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:34.935023 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f341f64-11a2-47c0-9bb1-761c316ab90a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:34.968485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1216/2460] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:59:34 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:34.976323 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f10deb-a744-41cd-8a6d-2aa0581f9ee5 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:34.980154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f341f64-11a2-47c0-9bb1-761c316ab90a admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:34.981935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9f341f64-11a2-47c0-9bb1-761c316ab90a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:34.988639 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f10deb-a744-41cd-8a6d-2aa0581f9ee5 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:34.995523 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f775fce-df43-4745-8bba-3df939cb5806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:34.996220 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f775fce-df43-4745-8bba-3df939cb5806 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:34.996535 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f775fce-df43-4745-8bba-3df939cb5806 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:34.996805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f775fce-df43-4745-8bba-3df939cb5806 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:34.997547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f775fce-df43-4745-8bba-3df939cb5806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:34.999163 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f775fce-df43-4745-8bba-3df939cb5806 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:34.999990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f341f64-11a2-47c0-9bb1-761c316ab90a admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:35.004966 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c4ed5-ef5b-4d15-a28c-cfda4134e06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:35.006081 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c4ed5-ef5b-4d15-a28c-cfda4134e06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:35.006081 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c4ed5-ef5b-4d15-a28c-cfda4134e06d admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:35.006449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c4ed5-ef5b-4d15-a28c-cfda4134e06d admin admin] PATH_INFO: `/v3/users/4e8a6cd3309a448081bdad3625dcf44f` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:35.007696 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c4ed5-ef5b-4d15-a28c-cfda4134e06d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8a6cd3309a448081bdad3625dcf44f)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:35.009964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c4ed5-ef5b-4d15-a28c-cfda4134e06d admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:35.021385 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1245/2461] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:35.024336 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f775fce-df43-4745-8bba-3df939cb5806 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:35.041821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f775fce-df43-4745-8bba-3df939cb5806 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:35.041821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849389f8-f603-4c60-97ef-64412ac9b5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:35.041821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849389f8-f603-4c60-97ef-64412ac9b5c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:35.042283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849389f8-f603-4c60-97ef-64412ac9b5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:35.042719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849389f8-f603-4c60-97ef-64412ac9b5c2 admin admin] PATH_INFO: `/v3/projects/6e9db264fb1348f3bdde0aeb6d263b60/users/45df91959e6b4a7091c6092cf6a6f4e9/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:35.068458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849389f8-f603-4c60-97ef-64412ac9b5c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9db264fb1348f3bdde0aeb6d263b60, user_id=45df91959e6b4a7091c6092cf6a6f4e9, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:35.072402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849389f8-f603-4c60-97ef-64412ac9b5c2 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:35.086073 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2c2c4ed5-ef5b-4d15-a28c-cfda4134e06d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8a6cd3309a448081bdad3625dcf44f'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:35.087149 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2c2c4ed5-ef5b-4d15-a28c-cfda4134e06d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8a6cd3309a448081bdad3625dcf44f'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:35.087995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2c2c4ed5-ef5b-4d15-a28c-cfda4134e06d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8a6cd3309a448081bdad3625dcf44f'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:35.101391 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1246/2462] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:35 2022] PUT /identity/v3/projects/6e9db264fb1348f3bdde0aeb6d263b60/users/45df91959e6b4a7091c6092cf6a6f4e9/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:59:35.104559 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:35.109243 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849389f8-f603-4c60-97ef-64412ac9b5c2 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:35.111286 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-849389f8-f603-4c60-97ef-64412ac9b5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:35.117491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2c2c4ed5-ef5b-4d15-a28c-cfda4134e06d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8a6cd3309a448081bdad3625dcf44f'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:35.126980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-2c2c4ed5-ef5b-4d15-a28c-cfda4134e06d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8a6cd3309a448081bdad3625dcf44f'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:35.154237 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1217/2463] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:59:34 2022] DELETE /identity/v3/users/4e8a6cd3309a448081bdad3625dcf44f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:35.158626 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c12cd-38dd-4b0a-8f19-087e9d1bb63d None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:35.159018 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c12cd-38dd-4b0a-8f19-087e9d1bb63d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:35.159368 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c12cd-38dd-4b0a-8f19-087e9d1bb63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:35.220499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849389f8-f603-4c60-97ef-64412ac9b5c2 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:35.308598 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6689b-a0f0-4a5d-aa8d-8e5be601dbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:35.309288 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6689b-a0f0-4a5d-aa8d-8e5be601dbbb admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:35.310443 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6689b-a0f0-4a5d-aa8d-8e5be601dbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:35.310715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6689b-a0f0-4a5d-aa8d-8e5be601dbbb admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:35.311395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6689b-a0f0-4a5d-aa8d-8e5be601dbbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:35.311752 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-634c12cd-38dd-4b0a-8f19-087e9d1bb63d None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:35.313038 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-634c12cd-38dd-4b0a-8f19-087e9d1bb63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:35.313130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6689b-a0f0-4a5d-aa8d-8e5be601dbbb admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:35.321855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1218/2464] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:35.332837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c12cd-38dd-4b0a-8f19-087e9d1bb63d None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:35.334381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-634c12cd-38dd-4b0a-8f19-087e9d1bb63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:35.337804 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1247/2465] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:35.347500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6689b-a0f0-4a5d-aa8d-8e5be601dbbb admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:35.368218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6689b-a0f0-4a5d-aa8d-8e5be601dbbb admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:35.376922 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f8544-82bb-44fa-a38a-71169a8b4ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:35.378111 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f8544-82bb-44fa-a38a-71169a8b4ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:35.378609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f8544-82bb-44fa-a38a-71169a8b4ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:35.379091 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f8544-82bb-44fa-a38a-71169a8b4ac0 admin admin] PATH_INFO: `/v3/projects/6e9db264fb1348f3bdde0aeb6d263b60/users/45df91959e6b4a7091c6092cf6a6f4e9/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:35.382872 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f8544-82bb-44fa-a38a-71169a8b4ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9db264fb1348f3bdde0aeb6d263b60, user_id=45df91959e6b4a7091c6092cf6a6f4e9, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:35.388399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f8544-82bb-44fa-a38a-71169a8b4ac0 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:35.406794 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c12cd-38dd-4b0a-8f19-087e9d1bb63d None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:35.412390 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1248/2466] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:35 2022] PUT /identity/v3/projects/6e9db264fb1348f3bdde0aeb6d263b60/users/45df91959e6b4a7091c6092cf6a6f4e9/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:35.468972 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc88f14-12cb-4f55-8b1c-1b2289131fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:35.469846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc88f14-12cb-4f55-8b1c-1b2289131fca service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:35.470120 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc88f14-12cb-4f55-8b1c-1b2289131fca service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:35.470517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc88f14-12cb-4f55-8b1c-1b2289131fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:35.562311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc88f14-12cb-4f55-8b1c-1b2289131fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:35.564938 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc88f14-12cb-4f55-8b1c-1b2289131fca service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:35.578737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1219/2467] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:59:36.143828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f8544-82bb-44fa-a38a-71169a8b4ac0 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:36.146653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1d2f8544-82bb-44fa-a38a-71169a8b4ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:36.166060 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f8544-82bb-44fa-a38a-71169a8b4ac0 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:36.172115 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:36.172989 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:36.173427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:36.173902 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf admin admin] PATH_INFO: `/v3/projects/8661118fb5fb4d878becbd596636ad74` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:36.175266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8661118fb5fb4d878becbd596636ad74)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:36.177856 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:36.227623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:36.244491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8661118fb5fb4d878becbd596636ad74', 'request_id': 'req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:36.258312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8661118fb5fb4d878becbd596636ad74', 'request_id': 'req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:36.271071 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8661118fb5fb4d878becbd596636ad74', 'request_id': 'req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:36.292029 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf admin admin] The token cache is being invalidate because project 8661118fb5fb4d878becbd596636ad74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:59:36.292474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:36.293374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:36.295472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1249/2468] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:59:36 2022] DELETE /identity/v3/projects/8661118fb5fb4d878becbd596636ad74 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:36.302229 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc88f14-12cb-4f55-8b1c-1b2289131fca service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:36.329560 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc88f14-12cb-4f55-8b1c-1b2289131fca service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:36.422301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:36.476987 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38b015-f78b-458f-8e00-f0f9a3d0d331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:36.477944 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38b015-f78b-458f-8e00-f0f9a3d0d331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:36.478270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38b015-f78b-458f-8e00-f0f9a3d0d331 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:36.478521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38b015-f78b-458f-8e00-f0f9a3d0d331 admin admin] PATH_INFO: `/v3/users/9db9c501bc1749bda8a814193c8b6136` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:36.480458 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38b015-f78b-458f-8e00-f0f9a3d0d331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db9c501bc1749bda8a814193c8b6136)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:36.487132 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38b015-f78b-458f-8e00-f0f9a3d0d331 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:36.630237 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3b38b015-f78b-458f-8e00-f0f9a3d0d331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db9c501bc1749bda8a814193c8b6136'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:36.631090 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3b38b015-f78b-458f-8e00-f0f9a3d0d331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db9c501bc1749bda8a814193c8b6136'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:36.631955 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3b38b015-f78b-458f-8e00-f0f9a3d0d331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db9c501bc1749bda8a814193c8b6136'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:36.651099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3b38b015-f78b-458f-8e00-f0f9a3d0d331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db9c501bc1749bda8a814193c8b6136'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:36.665464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3b38b015-f78b-458f-8e00-f0f9a3d0d331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db9c501bc1749bda8a814193c8b6136'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:36.688428 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1220/2469] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:59:36 2022] DELETE /identity/v3/users/9db9c501bc1749bda8a814193c8b6136 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:37.069781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:37.069781 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:37.093778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f9ba4-31b4-429a-9c6a-72522c3651bf admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:37.169228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797ae77-a063-486d-abe8-88b56b2862d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:37.172154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797ae77-a063-486d-abe8-88b56b2862d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:37.173106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797ae77-a063-486d-abe8-88b56b2862d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:37.173244 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797ae77-a063-486d-abe8-88b56b2862d2 admin admin] PATH_INFO: `/v3/projects/81ddfa52ddd8489cb84fb6f8650269a9` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:37.175661 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797ae77-a063-486d-abe8-88b56b2862d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ddfa52ddd8489cb84fb6f8650269a9)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:37.181324 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797ae77-a063-486d-abe8-88b56b2862d2 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:37.240930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8797ae77-a063-486d-abe8-88b56b2862d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ddfa52ddd8489cb84fb6f8650269a9', 'request_id': 'req-8797ae77-a063-486d-abe8-88b56b2862d2'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:37.251396 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8797ae77-a063-486d-abe8-88b56b2862d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ddfa52ddd8489cb84fb6f8650269a9', 'request_id': 'req-8797ae77-a063-486d-abe8-88b56b2862d2'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:37.261587 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8797ae77-a063-486d-abe8-88b56b2862d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ddfa52ddd8489cb84fb6f8650269a9', 'request_id': 'req-8797ae77-a063-486d-abe8-88b56b2862d2'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:37.279092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8797ae77-a063-486d-abe8-88b56b2862d2 admin admin] The token cache is being invalidate because project 81ddfa52ddd8489cb84fb6f8650269a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:59:37.279543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8797ae77-a063-486d-abe8-88b56b2862d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:37.280427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-8797ae77-a063-486d-abe8-88b56b2862d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:37.282206 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1250/2470] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:59:37 2022] DELETE /identity/v3/projects/81ddfa52ddd8489cb84fb6f8650269a9 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:37.289040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c8089-449a-4e0a-a503-beef0db8ecfe None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:37.289924 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c8089-449a-4e0a-a503-beef0db8ecfe None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:37.290808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c8089-449a-4e0a-a503-beef0db8ecfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:37.319894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-152c8089-449a-4e0a-a503-beef0db8ecfe None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:37.321187 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-152c8089-449a-4e0a-a503-beef0db8ecfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:37.409074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1221/2471] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:59:37.417721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbda4ea-0638-4642-99af-69d9efe0af14 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:37.418399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbda4ea-0638-4642-99af-69d9efe0af14 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:37.418777 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbda4ea-0638-4642-99af-69d9efe0af14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:37.443724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-abbda4ea-0638-4642-99af-69d9efe0af14 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:37.445126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-abbda4ea-0638-4642-99af-69d9efe0af14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:37.456794 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1251/2472] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:37.461626 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c8089-449a-4e0a-a503-beef0db8ecfe None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:37.472059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c8089-449a-4e0a-a503-beef0db8ecfe None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:37.477445 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254f9ef-5cba-4e1c-8eb6-db855d49db40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:37.478813 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f9ef-5cba-4e1c-8eb6-db855d49db40 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:37.478991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f9ef-5cba-4e1c-8eb6-db855d49db40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:37.479223 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f9ef-5cba-4e1c-8eb6-db855d49db40 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:37.480105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254f9ef-5cba-4e1c-8eb6-db855d49db40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:59:37.480654 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254f9ef-5cba-4e1c-8eb6-db855d49db40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:37.482331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254f9ef-5cba-4e1c-8eb6-db855d49db40 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:37.496859 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1222/2473] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:59:37.501307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbda4ea-0638-4642-99af-69d9efe0af14 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:37.510877 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbda4ea-0638-4642-99af-69d9efe0af14 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:37.516887 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955908e2-ac37-42ac-9c43-4a76b9d6cb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:37.517793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955908e2-ac37-42ac-9c43-4a76b9d6cb3b admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:37.518217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955908e2-ac37-42ac-9c43-4a76b9d6cb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:37.518769 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955908e2-ac37-42ac-9c43-4a76b9d6cb3b admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:37.519577 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955908e2-ac37-42ac-9c43-4a76b9d6cb3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:37.521703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955908e2-ac37-42ac-9c43-4a76b9d6cb3b admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:37.554564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1252/2474] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:59:37 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:59:37.558962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254f9ef-5cba-4e1c-8eb6-db855d49db40 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:37.574451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254f9ef-5cba-4e1c-8eb6-db855d49db40 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:37.631223 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:37.651986 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda11fb-cfa8-49df-ba7e-f41f7169fc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:37.652281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda11fb-cfa8-49df-ba7e-f41f7169fc40 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:37.652590 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda11fb-cfa8-49df-ba7e-f41f7169fc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:37.652861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda11fb-cfa8-49df-ba7e-f41f7169fc40 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:37.653677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda11fb-cfa8-49df-ba7e-f41f7169fc40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:37.656348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda11fb-cfa8-49df-ba7e-f41f7169fc40 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:37.685728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1223/2475] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:59:37 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:59:37.690931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955908e2-ac37-42ac-9c43-4a76b9d6cb3b admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:37.704124 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955908e2-ac37-42ac-9c43-4a76b9d6cb3b admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:37.712345 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8b91a-2dbe-4819-b18a-e48de752c6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:37.713167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8b91a-2dbe-4819-b18a-e48de752c6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:37.713641 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8b91a-2dbe-4819-b18a-e48de752c6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:37.714047 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8b91a-2dbe-4819-b18a-e48de752c6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:37.714881 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8b91a-2dbe-4819-b18a-e48de752c6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:37.716930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8b91a-2dbe-4819-b18a-e48de752c6b1 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:37.731542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1253/2476] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:37.735886 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda11fb-cfa8-49df-ba7e-f41f7169fc40 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:37.746973 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda11fb-cfa8-49df-ba7e-f41f7169fc40 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:37.751948 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc90727-a0c6-4ee5-80e7-28f8353cee5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:37.752802 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc90727-a0c6-4ee5-80e7-28f8353cee5e admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:37.753580 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc90727-a0c6-4ee5-80e7-28f8353cee5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:37.753999 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc90727-a0c6-4ee5-80e7-28f8353cee5e admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:37.754795 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc90727-a0c6-4ee5-80e7-28f8353cee5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:37.756674 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc90727-a0c6-4ee5-80e7-28f8353cee5e admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:37.768732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1224/2477] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:59:37.773110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8b91a-2dbe-4819-b18a-e48de752c6b1 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:37.789169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8b91a-2dbe-4819-b18a-e48de752c6b1 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:37.795558 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e03ce-a7be-49b9-b9c0-16aaf6b0d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:37.796159 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e03ce-a7be-49b9-b9c0-16aaf6b0d542 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:37.796929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e03ce-a7be-49b9-b9c0-16aaf6b0d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:37.797216 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e03ce-a7be-49b9-b9c0-16aaf6b0d542 admin admin] PATH_INFO: `/v3/projects/218613f0510d413d9072bbbe8542962f/users/a26caf964565437c8b8ccbd6fd472a9d/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:37.808412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:37.819513 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e03ce-a7be-49b9-b9c0-16aaf6b0d542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=218613f0510d413d9072bbbe8542962f, user_id=a26caf964565437c8b8ccbd6fd472a9d, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:37.824476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e03ce-a7be-49b9-b9c0-16aaf6b0d542 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:37.841976 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1254/2478] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:37 2022] PUT /identity/v3/projects/218613f0510d413d9072bbbe8542962f/users/a26caf964565437c8b8ccbd6fd472a9d/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:59:37.853742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c649f-b074-497d-8247-9e14f519ec1f None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:37.854196 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c649f-b074-497d-8247-9e14f519ec1f None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:37.854554 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c649f-b074-497d-8247-9e14f519ec1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:37.893635 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-862c649f-b074-497d-8247-9e14f519ec1f None None] MFA Rules not processed for user `a26caf964565437c8b8ccbd6fd472a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:37.895142 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-862c649f-b074-497d-8247-9e14f519ec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:37.986639 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e03ce-a7be-49b9-b9c0-16aaf6b0d542 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:37.987467 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1225/2479] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:38.127938 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e03ce-a7be-49b9-b9c0-16aaf6b0d542 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:38.142259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe8730-7b87-4a89-9880-8d8d207e6cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:38.143882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe8730-7b87-4a89-9880-8d8d207e6cfe admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:38.144447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe8730-7b87-4a89-9880-8d8d207e6cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:38.145066 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe8730-7b87-4a89-9880-8d8d207e6cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:38.146044 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe8730-7b87-4a89-9880-8d8d207e6cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:38.149148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe8730-7b87-4a89-9880-8d8d207e6cfe admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:38.234879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1255/2480] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:59:37 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:38.238417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c649f-b074-497d-8247-9e14f519ec1f None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:38.257858 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c649f-b074-497d-8247-9e14f519ec1f None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:38.429574 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286268e4-efea-4cc3-a530-984b2a09ef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:38.435672 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286268e4-efea-4cc3-a530-984b2a09ef90 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:38.436093 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286268e4-efea-4cc3-a530-984b2a09ef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:38.436359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286268e4-efea-4cc3-a530-984b2a09ef90 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:38.437056 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286268e4-efea-4cc3-a530-984b2a09ef90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:38.440163 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286268e4-efea-4cc3-a530-984b2a09ef90 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:38.496674 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1226/2481] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:59:38 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:38.500639 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe8730-7b87-4a89-9880-8d8d207e6cfe admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:38.515286 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe8730-7b87-4a89-9880-8d8d207e6cfe admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:38.521253 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddb7f4-9e79-4003-8e1e-f4a702b763e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:38.522560 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddb7f4-9e79-4003-8e1e-f4a702b763e3 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:38.522899 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddb7f4-9e79-4003-8e1e-f4a702b763e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:38.523169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddb7f4-9e79-4003-8e1e-f4a702b763e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:38.523856 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddb7f4-9e79-4003-8e1e-f4a702b763e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:38.527287 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddb7f4-9e79-4003-8e1e-f4a702b763e3 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:38.545065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1256/2482] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:59:38.549657 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286268e4-efea-4cc3-a530-984b2a09ef90 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:38.562865 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286268e4-efea-4cc3-a530-984b2a09ef90 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:38.573935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27615b47-c960-4853-b7c1-2241f571cfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:38.576674 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27615b47-c960-4853-b7c1-2241f571cfa7 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:38.577381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27615b47-c960-4853-b7c1-2241f571cfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:38.577381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27615b47-c960-4853-b7c1-2241f571cfa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:38.578231 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27615b47-c960-4853-b7c1-2241f571cfa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:38.582105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27615b47-c960-4853-b7c1-2241f571cfa7 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:38.594579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1227/2483] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:59:38.599010 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddb7f4-9e79-4003-8e1e-f4a702b763e3 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:38.623042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddb7f4-9e79-4003-8e1e-f4a702b763e3 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:38.629436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805e767-4e2f-4338-abff-597155028230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:38.630505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805e767-4e2f-4338-abff-597155028230 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:38.630966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805e767-4e2f-4338-abff-597155028230 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:38.632991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805e767-4e2f-4338-abff-597155028230 admin admin] PATH_INFO: `/v3/projects/542d2291931b429481b89ba54a91ff13/users/802eaa07193645c1837ad5c72161f09a/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:38.686370 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805e767-4e2f-4338-abff-597155028230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=542d2291931b429481b89ba54a91ff13, user_id=802eaa07193645c1837ad5c72161f09a, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:38.689113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805e767-4e2f-4338-abff-597155028230 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:38.729108 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cac858-3241-465b-b337-431cd2c1c34d None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:38.729386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cac858-3241-465b-b337-431cd2c1c34d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:38.730651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cac858-3241-465b-b337-431cd2c1c34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:38.733543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1257/2484] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:38 2022] PUT /identity/v3/projects/542d2291931b429481b89ba54a91ff13/users/802eaa07193645c1837ad5c72161f09a/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:38.801948 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-c4cac858-3241-465b-b337-431cd2c1c34d None None] MFA Rules not processed for user `802eaa07193645c1837ad5c72161f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:38.803662 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c4cac858-3241-465b-b337-431cd2c1c34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:38.850679 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:38.959132 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1228/2485] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:38.963421 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805e767-4e2f-4338-abff-597155028230 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:39.060047 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805e767-4e2f-4338-abff-597155028230 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:39.079028 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf30e68-52e4-49ae-b80b-268ccfebd57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:39.080425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf30e68-52e4-49ae-b80b-268ccfebd57d admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:39.087420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf30e68-52e4-49ae-b80b-268ccfebd57d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:39.087420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf30e68-52e4-49ae-b80b-268ccfebd57d admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:39.087420 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf30e68-52e4-49ae-b80b-268ccfebd57d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:39.103673 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf30e68-52e4-49ae-b80b-268ccfebd57d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:39.168527 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1258/2486] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:59:38 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:39.168745 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cac858-3241-465b-b337-431cd2c1c34d None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:39.199468 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cac858-3241-465b-b337-431cd2c1c34d None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:39.304001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a85992-4172-4550-8f43-0bb3fd7ed520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:39.304950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a85992-4172-4550-8f43-0bb3fd7ed520 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:39.305305 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a85992-4172-4550-8f43-0bb3fd7ed520 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:39.305605 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a85992-4172-4550-8f43-0bb3fd7ed520 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:39.306280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a85992-4172-4550-8f43-0bb3fd7ed520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:39.308357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a85992-4172-4550-8f43-0bb3fd7ed520 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:39.352791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1229/2487] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:59:39 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:39.357103 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf30e68-52e4-49ae-b80b-268ccfebd57d admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:39.374995 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf30e68-52e4-49ae-b80b-268ccfebd57d admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:39.382923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fb80b-46a3-4562-a65b-70e544f5e2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:39.383881 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fb80b-46a3-4562-a65b-70e544f5e2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:39.384651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fb80b-46a3-4562-a65b-70e544f5e2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:39.385276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fb80b-46a3-4562-a65b-70e544f5e2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:39.386669 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fb80b-46a3-4562-a65b-70e544f5e2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:39.389177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fb80b-46a3-4562-a65b-70e544f5e2f5 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:39.420338 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1259/2488] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:39.426191 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a85992-4172-4550-8f43-0bb3fd7ed520 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:39.450600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a85992-4172-4550-8f43-0bb3fd7ed520 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:39.467680 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112a2ce-6d0d-47ab-a6a9-9782d0e93a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:39.468541 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112a2ce-6d0d-47ab-a6a9-9782d0e93a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:39.468920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112a2ce-6d0d-47ab-a6a9-9782d0e93a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:39.469296 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112a2ce-6d0d-47ab-a6a9-9782d0e93a1a admin admin] PATH_INFO: `/v3/projects/435b82c3daa34001b46df1e8937c0679/users/f3f2dc8e0b7e4dd797a21323147ffab0/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:39.501900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112a2ce-6d0d-47ab-a6a9-9782d0e93a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=435b82c3daa34001b46df1e8937c0679, user_id=f3f2dc8e0b7e4dd797a21323147ffab0, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:39.504914 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112a2ce-6d0d-47ab-a6a9-9782d0e93a1a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:39.533844 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1230/2489] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:39 2022] PUT /identity/v3/projects/435b82c3daa34001b46df1e8937c0679/users/f3f2dc8e0b7e4dd797a21323147ffab0/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:39.539062 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fb80b-46a3-4562-a65b-70e544f5e2f5 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:39.565105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fb80b-46a3-4562-a65b-70e544f5e2f5 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:39.583245 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:39.694466 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4f939-8c54-4778-8e1b-225fb3d926bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:39.695036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4f939-8c54-4778-8e1b-225fb3d926bd admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:39.695224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4f939-8c54-4778-8e1b-225fb3d926bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:39.695481 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4f939-8c54-4778-8e1b-225fb3d926bd admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:39.696158 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4f939-8c54-4778-8e1b-225fb3d926bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:39.702835 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4f939-8c54-4778-8e1b-225fb3d926bd admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:39.716682 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1260/2490] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:39.720786 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112a2ce-6d0d-47ab-a6a9-9782d0e93a1a admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:39.736659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112a2ce-6d0d-47ab-a6a9-9782d0e93a1a admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:39.775980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5ac86-94b8-42b5-bdc2-2a3e1b86d57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:39.777129 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5ac86-94b8-42b5-bdc2-2a3e1b86d57f admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:39.777732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5ac86-94b8-42b5-bdc2-2a3e1b86d57f admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:39.778226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5ac86-94b8-42b5-bdc2-2a3e1b86d57f admin admin] PATH_INFO: `/v3/projects/435b82c3daa34001b46df1e8937c0679/users/f3f2dc8e0b7e4dd797a21323147ffab0/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:39.780644 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5ac86-94b8-42b5-bdc2-2a3e1b86d57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=435b82c3daa34001b46df1e8937c0679, user_id=f3f2dc8e0b7e4dd797a21323147ffab0, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:39.786800 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5ac86-94b8-42b5-bdc2-2a3e1b86d57f admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:39.812469 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1231/2491] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:39 2022] PUT /identity/v3/projects/435b82c3daa34001b46df1e8937c0679/users/f3f2dc8e0b7e4dd797a21323147ffab0/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:39.822752 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31873a25-5a07-4374-9e94-078bc1f04bba None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:39.823036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31873a25-5a07-4374-9e94-078bc1f04bba None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:39.823312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31873a25-5a07-4374-9e94-078bc1f04bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:39.883222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-31873a25-5a07-4374-9e94-078bc1f04bba None None] MFA Rules not processed for user `f3f2dc8e0b7e4dd797a21323147ffab0`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:39.884808 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-31873a25-5a07-4374-9e94-078bc1f04bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:40.035176 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1261/2492] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:40.053892 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5ac86-94b8-42b5-bdc2-2a3e1b86d57f admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:40.056664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7cf5ac86-94b8-42b5-bdc2-2a3e1b86d57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:40.199495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5ac86-94b8-42b5-bdc2-2a3e1b86d57f admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:40.208509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2f013-ca0b-4de5-b921-4073329ddf9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:40.209973 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2f013-ca0b-4de5-b921-4073329ddf9b service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:40.210463 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2f013-ca0b-4de5-b921-4073329ddf9b service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:40.211943 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2f013-ca0b-4de5-b921-4073329ddf9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:40.245520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2f013-ca0b-4de5-b921-4073329ddf9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:40.252329 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2f013-ca0b-4de5-b921-4073329ddf9b service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:40.300509 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1232/2493] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:59:41.497327 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31873a25-5a07-4374-9e94-078bc1f04bba None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:41.500689 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-31873a25-5a07-4374-9e94-078bc1f04bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:41.535084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31873a25-5a07-4374-9e94-078bc1f04bba None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:41.540842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db61b1f-c5a7-4394-9cb1-9e46237ccf61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:41.541870 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db61b1f-c5a7-4394-9cb1-9e46237ccf61 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:41.542377 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db61b1f-c5a7-4394-9cb1-9e46237ccf61 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:41.542817 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db61b1f-c5a7-4394-9cb1-9e46237ccf61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:41.667609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db61b1f-c5a7-4394-9cb1-9e46237ccf61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:41.671788 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db61b1f-c5a7-4394-9cb1-9e46237ccf61 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:41.690739 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1262/2494] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:59:43.023847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf69115-3094-480d-9235-04cfe6ea4698 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:43.024402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf69115-3094-480d-9235-04cfe6ea4698 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:43.024402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf69115-3094-480d-9235-04cfe6ea4698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:43.133420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:43.139331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-bcf69115-3094-480d-9235-04cfe6ea4698 None None] MFA Rules not processed for user `45df91959e6b4a7091c6092cf6a6f4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:43.142084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-bcf69115-3094-480d-9235-04cfe6ea4698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:43.270465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1233/2495] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:43.287637 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db61b1f-c5a7-4394-9cb1-9e46237ccf61 service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:43.290560 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-7db61b1f-c5a7-4394-9cb1-9e46237ccf61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:43.431853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:43.469150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db61b1f-c5a7-4394-9cb1-9e46237ccf61 service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:43.479139 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef51344-03a0-4880-b6f1-2fdbe810a17a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d21a0c72223417d92e3d8b30ef6bc3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:43.480266 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51344-03a0-4880-b6f1-2fdbe810a17a service glance] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:43.480527 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51344-03a0-4880-b6f1-2fdbe810a17a service glance] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:43.481019 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51344-03a0-4880-b6f1-2fdbe810a17a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:43.483357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-fef51344-03a0-4880-b6f1-2fdbe810a17a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:43.591406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef51344-03a0-4880-b6f1-2fdbe810a17a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:43.592861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef51344-03a0-4880-b6f1-2fdbe810a17a service glance] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:43.606416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1263/2496] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:59:43.789220 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10b4a2-a8a1-4331-96ad-8ee61b8bd220 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:43.789812 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10b4a2-a8a1-4331-96ad-8ee61b8bd220 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:43.790082 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10b4a2-a8a1-4331-96ad-8ee61b8bd220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:43.811784 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-ec10b4a2-a8a1-4331-96ad-8ee61b8bd220 None None] MFA Rules not processed for user `e1f49820de264982aeec97fa0be3c290`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:43.812990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ec10b4a2-a8a1-4331-96ad-8ee61b8bd220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:43.889938 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1234/2497] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 12 23:59:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:43.919628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef51344-03a0-4880-b6f1-2fdbe810a17a service glance] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:43.921943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-fef51344-03a0-4880-b6f1-2fdbe810a17a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:43.996189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef51344-03a0-4880-b6f1-2fdbe810a17a service glance] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:44.001598 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca95255-cced-4dff-8ad3-cb2cbc142718 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c45ae3144b4fe8ab4e921fda30164a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:44.002233 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca95255-cced-4dff-8ad3-cb2cbc142718 service swift] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:44.002513 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca95255-cced-4dff-8ad3-cb2cbc142718 service swift] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:44.002782 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca95255-cced-4dff-8ad3-cb2cbc142718 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:44.011943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca95255-cced-4dff-8ad3-cb2cbc142718 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:44.013516 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca95255-cced-4dff-8ad3-cb2cbc142718 service swift] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:44.022468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1264/2498] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 12 23:59:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 12 23:59:46.532755 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10b4a2-a8a1-4331-96ad-8ee61b8bd220 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:46.537096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ec10b4a2-a8a1-4331-96ad-8ee61b8bd220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:46.675893 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10b4a2-a8a1-4331-96ad-8ee61b8bd220 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:46.687197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6b5ca-86de-40bc-b964-824d9734f1db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:46.688113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b5ca-86de-40bc-b964-824d9734f1db service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:46.688654 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b5ca-86de-40bc-b964-824d9734f1db service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:46.689121 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b5ca-86de-40bc-b964-824d9734f1db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:46.691114 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca95255-cced-4dff-8ad3-cb2cbc142718 service swift] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:46.692012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a8b6b5ca-86de-40bc-b964-824d9734f1db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:46.706729 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca95255-cced-4dff-8ad3-cb2cbc142718 service swift] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:46.735195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54fdb8-427d-4503-b517-aadb009e7058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:46.735821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54fdb8-427d-4503-b517-aadb009e7058 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:46.736098 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54fdb8-427d-4503-b517-aadb009e7058 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:46.736365 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54fdb8-427d-4503-b517-aadb009e7058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:46.790153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:46.794734 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6b5ca-86de-40bc-b964-824d9734f1db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:46.797067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6b5ca-86de-40bc-b964-824d9734f1db service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:46.821819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1235/2499] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:59:46.844214 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54fdb8-427d-4503-b517-aadb009e7058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:46.845627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54fdb8-427d-4503-b517-aadb009e7058 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:46.855966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1265/2500] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:59:50.191615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6b5ca-86de-40bc-b964-824d9734f1db service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:50.205565 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6b5ca-86de-40bc-b964-824d9734f1db service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:50.220840 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1403b71-10a2-47bd-8699-81e335b25301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:50.221874 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1403b71-10a2-47bd-8699-81e335b25301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:50.222402 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1403b71-10a2-47bd-8699-81e335b25301 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:50.222873 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1403b71-10a2-47bd-8699-81e335b25301 admin admin] PATH_INFO: `/v3/users/a26caf964565437c8b8ccbd6fd472a9d` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:50.225521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1403b71-10a2-47bd-8699-81e335b25301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a26caf964565437c8b8ccbd6fd472a9d)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:50.228057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1403b71-10a2-47bd-8699-81e335b25301 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:50.333880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d1403b71-10a2-47bd-8699-81e335b25301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a26caf964565437c8b8ccbd6fd472a9d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:50.336035 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d1403b71-10a2-47bd-8699-81e335b25301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a26caf964565437c8b8ccbd6fd472a9d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:50.337026 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d1403b71-10a2-47bd-8699-81e335b25301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a26caf964565437c8b8ccbd6fd472a9d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:50.375450 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d1403b71-10a2-47bd-8699-81e335b25301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a26caf964565437c8b8ccbd6fd472a9d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:50.389001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-d1403b71-10a2-47bd-8699-81e335b25301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a26caf964565437c8b8ccbd6fd472a9d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:50.421813 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1236/2501] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:59:50 2022] DELETE /identity/v3/users/a26caf964565437c8b8ccbd6fd472a9d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:50.426477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c56ac-22ff-4aa7-9e98-0e00ad98b236 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:50.427033 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c56ac-22ff-4aa7-9e98-0e00ad98b236 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:50.427033 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c56ac-22ff-4aa7-9e98-0e00ad98b236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:50.487480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-225c56ac-22ff-4aa7-9e98-0e00ad98b236 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:50.488761 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-225c56ac-22ff-4aa7-9e98-0e00ad98b236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:50.499480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:50.593466 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1266/2502] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:59:50.603665 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1403b71-10a2-47bd-8699-81e335b25301 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:50.605446 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-d1403b71-10a2-47bd-8699-81e335b25301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:50.793266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1403b71-10a2-47bd-8699-81e335b25301 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:50.801457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71e55c-25b6-4032-996a-4f9ef822a3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:50.802626 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71e55c-25b6-4032-996a-4f9ef822a3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:50.803351 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71e55c-25b6-4032-996a-4f9ef822a3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:50.803810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71e55c-25b6-4032-996a-4f9ef822a3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:50.852993 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71e55c-25b6-4032-996a-4f9ef822a3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:50.864514 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71e55c-25b6-4032-996a-4f9ef822a3e8 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:50.911736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1237/2503] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:59:51.120783 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c56ac-22ff-4aa7-9e98-0e00ad98b236 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:51.133368 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71e55c-25b6-4032-996a-4f9ef822a3e8 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:51.134855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6c71e55c-25b6-4032-996a-4f9ef822a3e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:51.136037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c56ac-22ff-4aa7-9e98-0e00ad98b236 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:51.141498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5141aa2-7b18-479a-8dd7-3a997c046b5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:51.142548 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5141aa2-7b18-479a-8dd7-3a997c046b5c service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:51.142960 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5141aa2-7b18-479a-8dd7-3a997c046b5c service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:51.143478 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5141aa2-7b18-479a-8dd7-3a997c046b5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:51.149632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-b5141aa2-7b18-479a-8dd7-3a997c046b5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:51.156468 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71e55c-25b6-4032-996a-4f9ef822a3e8 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:51.162722 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae8139-cc65-4cd0-a152-eecf8c2fa917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:51.163718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae8139-cc65-4cd0-a152-eecf8c2fa917 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:51.164040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae8139-cc65-4cd0-a152-eecf8c2fa917 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:51.164315 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae8139-cc65-4cd0-a152-eecf8c2fa917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:51.166556 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-24ae8139-cc65-4cd0-a152-eecf8c2fa917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:51.343364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae8139-cc65-4cd0-a152-eecf8c2fa917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:51.345292 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae8139-cc65-4cd0-a152-eecf8c2fa917 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:51.382200 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5141aa2-7b18-479a-8dd7-3a997c046b5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:51.387942 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5141aa2-7b18-479a-8dd7-3a997c046b5c service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:51.391062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1238/2504] 10.222.0.23 () {60 vars in 1396 bytes} [Mon Sep 12 23:59:51 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:59:51.418820 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1267/2505] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:59:51.640266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae8139-cc65-4cd0-a152-eecf8c2fa917 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:51.641862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-24ae8139-cc65-4cd0-a152-eecf8c2fa917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:51.665562 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae8139-cc65-4cd0-a152-eecf8c2fa917 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:51.673206 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:51.674324 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:51.675192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:51.675610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928 admin admin] PATH_INFO: `/v3/projects/218613f0510d413d9072bbbe8542962f` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:51.693315 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=218613f0510d413d9072bbbe8542962f)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:51.695980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:51.700128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:51.799773 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '218613f0510d413d9072bbbe8542962f', 'request_id': 'req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:51.807962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '218613f0510d413d9072bbbe8542962f', 'request_id': 'req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:51.822082 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '218613f0510d413d9072bbbe8542962f', 'request_id': 'req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:51.837731 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928 admin admin] The token cache is being invalidate because project 218613f0510d413d9072bbbe8542962f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:59:51.837731 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:51.841155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:51.841155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1239/2506] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:59:51 2022] DELETE /identity/v3/projects/218613f0510d413d9072bbbe8542962f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:51.845320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5141aa2-7b18-479a-8dd7-3a997c046b5c service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:51.860736 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5141aa2-7b18-479a-8dd7-3a997c046b5c service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:51.987711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c2ba6-8c1c-42a3-902e-ed290c6131ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:51.988565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c2ba6-8c1c-42a3-902e-ed290c6131ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:51.988849 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c2ba6-8c1c-42a3-902e-ed290c6131ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:51.989256 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c2ba6-8c1c-42a3-902e-ed290c6131ef admin admin] PATH_INFO: `/v3/users/802eaa07193645c1837ad5c72161f09a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:51.993998 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c2ba6-8c1c-42a3-902e-ed290c6131ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=802eaa07193645c1837ad5c72161f09a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:51.996092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c2ba6-8c1c-42a3-902e-ed290c6131ef admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:52.119568 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c34c2ba6-8c1c-42a3-902e-ed290c6131ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '802eaa07193645c1837ad5c72161f09a'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:52.144516 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:52.148885 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c34c2ba6-8c1c-42a3-902e-ed290c6131ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '802eaa07193645c1837ad5c72161f09a'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:52.191302 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c34c2ba6-8c1c-42a3-902e-ed290c6131ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '802eaa07193645c1837ad5c72161f09a'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:52.207374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c34c2ba6-8c1c-42a3-902e-ed290c6131ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '802eaa07193645c1837ad5c72161f09a'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:52.208250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c34c2ba6-8c1c-42a3-902e-ed290c6131ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '802eaa07193645c1837ad5c72161f09a'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:52.221447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1268/2507] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:59:51 2022] DELETE /identity/v3/users/802eaa07193645c1837ad5c72161f09a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:53.097182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:53.099318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:53.131116 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0793fa-2e7a-4ad6-b775-ab89fef1e928 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:53.295593 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644887a-cf9d-4f30-ba31-4e3893ae10bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:53.296772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644887a-cf9d-4f30-ba31-4e3893ae10bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:53.297119 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644887a-cf9d-4f30-ba31-4e3893ae10bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:53.297426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644887a-cf9d-4f30-ba31-4e3893ae10bb admin admin] PATH_INFO: `/v3/projects/542d2291931b429481b89ba54a91ff13` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:53.300336 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644887a-cf9d-4f30-ba31-4e3893ae10bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=542d2291931b429481b89ba54a91ff13)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:53.302995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644887a-cf9d-4f30-ba31-4e3893ae10bb admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:53.375848 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c2ba6-8c1c-42a3-902e-ed290c6131ef admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:53.378559 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c34c2ba6-8c1c-42a3-902e-ed290c6131ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:53.452970 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c2ba6-8c1c-42a3-902e-ed290c6131ef admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:53.467453 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a644887a-cf9d-4f30-ba31-4e3893ae10bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542d2291931b429481b89ba54a91ff13', 'request_id': 'req-a644887a-cf9d-4f30-ba31-4e3893ae10bb'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:53.483992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a644887a-cf9d-4f30-ba31-4e3893ae10bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542d2291931b429481b89ba54a91ff13', 'request_id': 'req-a644887a-cf9d-4f30-ba31-4e3893ae10bb'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:53.503524 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a644887a-cf9d-4f30-ba31-4e3893ae10bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542d2291931b429481b89ba54a91ff13', 'request_id': 'req-a644887a-cf9d-4f30-ba31-4e3893ae10bb'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:53.524326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a644887a-cf9d-4f30-ba31-4e3893ae10bb admin admin] The token cache is being invalidate because project 542d2291931b429481b89ba54a91ff13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:59:53.525284 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a644887a-cf9d-4f30-ba31-4e3893ae10bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:53.528995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a644887a-cf9d-4f30-ba31-4e3893ae10bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:53.533793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1240/2508] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:59:53 2022] DELETE /identity/v3/projects/542d2291931b429481b89ba54a91ff13 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:53.538601 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644887a-cf9d-4f30-ba31-4e3893ae10bb admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:53.546000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a644887a-cf9d-4f30-ba31-4e3893ae10bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:53.606107 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:53.609000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a3e73-eb01-4851-887c-0b371adbed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:53.611963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a3e73-eb01-4851-887c-0b371adbed25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:53.612295 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a3e73-eb01-4851-887c-0b371adbed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:53.612522 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a3e73-eb01-4851-887c-0b371adbed25 admin admin] PATH_INFO: `/v3/users/1f69ab01440e406f86f50bedc7e02fa4` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:53.615815 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a3e73-eb01-4851-887c-0b371adbed25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f69ab01440e406f86f50bedc7e02fa4)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:53.618095 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a3e73-eb01-4851-887c-0b371adbed25 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:53.705123 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644887a-cf9d-4f30-ba31-4e3893ae10bb admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:53.715653 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee04b45-14bb-4f66-9d0c-b77f7c9d5679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:53.717370 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee04b45-14bb-4f66-9d0c-b77f7c9d5679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:53.717900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee04b45-14bb-4f66-9d0c-b77f7c9d5679 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:53.718176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee04b45-14bb-4f66-9d0c-b77f7c9d5679 admin admin] PATH_INFO: `/v3/users/f3f2dc8e0b7e4dd797a21323147ffab0` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:53.719563 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee04b45-14bb-4f66-9d0c-b77f7c9d5679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3f2dc8e0b7e4dd797a21323147ffab0)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:53.721636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee04b45-14bb-4f66-9d0c-b77f7c9d5679 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:53.806584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5b0a3e73-eb01-4851-887c-0b371adbed25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f69ab01440e406f86f50bedc7e02fa4'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:53.809134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-6ee04b45-14bb-4f66-9d0c-b77f7c9d5679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3f2dc8e0b7e4dd797a21323147ffab0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:53.810914 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-6ee04b45-14bb-4f66-9d0c-b77f7c9d5679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3f2dc8e0b7e4dd797a21323147ffab0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:53.811919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-6ee04b45-14bb-4f66-9d0c-b77f7c9d5679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3f2dc8e0b7e4dd797a21323147ffab0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:53.847747 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-6ee04b45-14bb-4f66-9d0c-b77f7c9d5679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3f2dc8e0b7e4dd797a21323147ffab0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:53.849334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5b0a3e73-eb01-4851-887c-0b371adbed25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f69ab01440e406f86f50bedc7e02fa4'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:53.870608 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-6ee04b45-14bb-4f66-9d0c-b77f7c9d5679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3f2dc8e0b7e4dd797a21323147ffab0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:53.876094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5b0a3e73-eb01-4851-887c-0b371adbed25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f69ab01440e406f86f50bedc7e02fa4'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:53.913425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5b0a3e73-eb01-4851-887c-0b371adbed25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f69ab01440e406f86f50bedc7e02fa4'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:53.914398 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-5b0a3e73-eb01-4851-887c-0b371adbed25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f69ab01440e406f86f50bedc7e02fa4'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:53.921722 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1241/2509] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:59:53 2022] DELETE /identity/v3/users/f3f2dc8e0b7e4dd797a21323147ffab0 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:59:53.934754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1269/2510] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 12 23:59:53 2022] DELETE /identity/v3/users/1f69ab01440e406f86f50bedc7e02fa4 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:54.675536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee04b45-14bb-4f66-9d0c-b77f7c9d5679 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:54.677866 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6ee04b45-14bb-4f66-9d0c-b77f7c9d5679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:54.816677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee04b45-14bb-4f66-9d0c-b77f7c9d5679 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:54.930811 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:54.953518 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a3e73-eb01-4851-887c-0b371adbed25 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:54.956468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5b0a3e73-eb01-4851-887c-0b371adbed25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:54.970128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f613b2a-2a35-49f2-b264-77fe00ab5d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:54.970799 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f613b2a-2a35-49f2-b264-77fe00ab5d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:54.971122 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f613b2a-2a35-49f2-b264-77fe00ab5d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:54.971399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f613b2a-2a35-49f2-b264-77fe00ab5d5d admin admin] PATH_INFO: `/v3/projects/0c5b0898583d4508b8f7449aa16c0656` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:54.973045 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f613b2a-2a35-49f2-b264-77fe00ab5d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5b0898583d4508b8f7449aa16c0656)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:54.975131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f613b2a-2a35-49f2-b264-77fe00ab5d5d admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:55.045963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:55.058591 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3f613b2a-2a35-49f2-b264-77fe00ab5d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5b0898583d4508b8f7449aa16c0656', 'request_id': 'req-3f613b2a-2a35-49f2-b264-77fe00ab5d5d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:55.067818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3f613b2a-2a35-49f2-b264-77fe00ab5d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5b0898583d4508b8f7449aa16c0656', 'request_id': 'req-3f613b2a-2a35-49f2-b264-77fe00ab5d5d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:55.069642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a3e73-eb01-4851-887c-0b371adbed25 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:55.082586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3f613b2a-2a35-49f2-b264-77fe00ab5d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5b0898583d4508b8f7449aa16c0656', 'request_id': 'req-3f613b2a-2a35-49f2-b264-77fe00ab5d5d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:55.101801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3f613b2a-2a35-49f2-b264-77fe00ab5d5d admin admin] The token cache is being invalidate because project 0c5b0898583d4508b8f7449aa16c0656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:59:55.102401 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3f613b2a-2a35-49f2-b264-77fe00ab5d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:55.103279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3f613b2a-2a35-49f2-b264-77fe00ab5d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:55.105818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1242/2511] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:59:54 2022] DELETE /identity/v3/projects/0c5b0898583d4508b8f7449aa16c0656 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:55.111049 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f934e-ad35-4b93-b8a6-a4c51e5a77bd None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:55.111586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f934e-ad35-4b93-b8a6-a4c51e5a77bd None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:55.112031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f934e-ad35-4b93-b8a6-a4c51e5a77bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:55.141958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-e25f934e-ad35-4b93-b8a6-a4c51e5a77bd None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:55.144082 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e25f934e-ad35-4b93-b8a6-a4c51e5a77bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:55.182685 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f4675-ef6c-4bfa-90d2-6b1f6280cc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:55.183552 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f4675-ef6c-4bfa-90d2-6b1f6280cc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:55.183872 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f4675-ef6c-4bfa-90d2-6b1f6280cc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:55.184403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f4675-ef6c-4bfa-90d2-6b1f6280cc68 admin admin] PATH_INFO: `/v3/projects/435b82c3daa34001b46df1e8937c0679` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:55.185918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f4675-ef6c-4bfa-90d2-6b1f6280cc68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=435b82c3daa34001b46df1e8937c0679)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:55.188209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f4675-ef6c-4bfa-90d2-6b1f6280cc68 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:55.240737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1243/2512] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:55.251829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179c4cf-75b4-4d0b-9d36-5ffa02eb2d81 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:55.252154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179c4cf-75b4-4d0b-9d36-5ffa02eb2d81 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:55.252423 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179c4cf-75b4-4d0b-9d36-5ffa02eb2d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:55.287057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-b179c4cf-75b4-4d0b-9d36-5ffa02eb2d81 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:55.289909 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-b179c4cf-75b4-4d0b-9d36-5ffa02eb2d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:55.313465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-059f4675-ef6c-4bfa-90d2-6b1f6280cc68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435b82c3daa34001b46df1e8937c0679', 'request_id': 'req-059f4675-ef6c-4bfa-90d2-6b1f6280cc68'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:55.329017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-059f4675-ef6c-4bfa-90d2-6b1f6280cc68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435b82c3daa34001b46df1e8937c0679', 'request_id': 'req-059f4675-ef6c-4bfa-90d2-6b1f6280cc68'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:55.338657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-059f4675-ef6c-4bfa-90d2-6b1f6280cc68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435b82c3daa34001b46df1e8937c0679', 'request_id': 'req-059f4675-ef6c-4bfa-90d2-6b1f6280cc68'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:55.354431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-059f4675-ef6c-4bfa-90d2-6b1f6280cc68 admin admin] The token cache is being invalidate because project 435b82c3daa34001b46df1e8937c0679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 12 23:59:55.354839 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-059f4675-ef6c-4bfa-90d2-6b1f6280cc68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:55.355601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-059f4675-ef6c-4bfa-90d2-6b1f6280cc68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 12 23:59:55.362513 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1270/2513] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 12 23:59:54 2022] DELETE /identity/v3/projects/435b82c3daa34001b46df1e8937c0679 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:55.366404 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd853aa3-e8e1-4879-988f-27221661dde9 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:55.368648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd853aa3-e8e1-4879-988f-27221661dde9 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:55.368648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd853aa3-e8e1-4879-988f-27221661dde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:55.407697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1244/2514] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:55.411991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179c4cf-75b4-4d0b-9d36-5ffa02eb2d81 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:55.417268 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-bd853aa3-e8e1-4879-988f-27221661dde9 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:55.419178 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-bd853aa3-e8e1-4879-988f-27221661dde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:55.428119 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179c4cf-75b4-4d0b-9d36-5ffa02eb2d81 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:55.440604 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6a11b-b43f-44c4-9a75-db33aed9a184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:55.441005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1271/2515] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:59:55.448551 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6a11b-b43f-44c4-9a75-db33aed9a184 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:55.448891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6a11b-b43f-44c4-9a75-db33aed9a184 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:55.449205 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6a11b-b43f-44c4-9a75-db33aed9a184 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:55.449595 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b729ca-852b-4fee-bab8-8ff95b66d822 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:55.449890 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b729ca-852b-4fee-bab8-8ff95b66d822 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:55.450101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6a11b-b43f-44c4-9a75-db33aed9a184 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:59:55.450338 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b729ca-852b-4fee-bab8-8ff95b66d822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:55.450440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6a11b-b43f-44c4-9a75-db33aed9a184 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:55.452047 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6a11b-b43f-44c4-9a75-db33aed9a184 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:55.476195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1245/2516] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 12 23:59:55.477499 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6a11b-b43f-44c4-9a75-db33aed9a184 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:55.486113 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:55.497295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6a11b-b43f-44c4-9a75-db33aed9a184 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:55.497840 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-43b729ca-852b-4fee-bab8-8ff95b66d822 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:55.499169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-43b729ca-852b-4fee-bab8-8ff95b66d822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:55.516051 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1272/2517] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:59:55.517373 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b729ca-852b-4fee-bab8-8ff95b66d822 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:55.531392 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb6c05-027a-45a4-98fc-4503ab819533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:55.532239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb6c05-027a-45a4-98fc-4503ab819533 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:55.532532 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb6c05-027a-45a4-98fc-4503ab819533 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:55.532810 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb6c05-027a-45a4-98fc-4503ab819533 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:55.533657 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb6c05-027a-45a4-98fc-4503ab819533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:55.535634 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb6c05-027a-45a4-98fc-4503ab819533 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:55.541387 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b729ca-852b-4fee-bab8-8ff95b66d822 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:55.551067 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119054fe-57ab-4af7-bfea-20578f3c84c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:55.551719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119054fe-57ab-4af7-bfea-20578f3c84c7 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:55.552003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119054fe-57ab-4af7-bfea-20578f3c84c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:55.553708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119054fe-57ab-4af7-bfea-20578f3c84c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:55.555688 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119054fe-57ab-4af7-bfea-20578f3c84c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 12 23:59:55.557052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119054fe-57ab-4af7-bfea-20578f3c84c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:55.564109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119054fe-57ab-4af7-bfea-20578f3c84c7 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:55.593800 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1246/2518] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:59:55 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:55.594838 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb6c05-027a-45a4-98fc-4503ab819533 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:55.603951 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1273/2519] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 12 23:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 12 23:59:55.610326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119054fe-57ab-4af7-bfea-20578f3c84c7 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:55.631086 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119054fe-57ab-4af7-bfea-20578f3c84c7 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:55.725545 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb6c05-027a-45a4-98fc-4503ab819533 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:55.727002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087722e-ecf0-4a61-a2e2-4488efd6bb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:55.727741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087722e-ecf0-4a61-a2e2-4488efd6bb4a admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:55.728023 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087722e-ecf0-4a61-a2e2-4488efd6bb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:55.728298 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087722e-ecf0-4a61-a2e2-4488efd6bb4a admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:55.729107 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087722e-ecf0-4a61-a2e2-4488efd6bb4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:55.731794 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087722e-ecf0-4a61-a2e2-4488efd6bb4a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:55.735665 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898f48e-1970-4633-8170-2f7ca1f9f48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:55.737542 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898f48e-1970-4633-8170-2f7ca1f9f48b admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:55.738442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898f48e-1970-4633-8170-2f7ca1f9f48b admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:55.738702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898f48e-1970-4633-8170-2f7ca1f9f48b admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:55.741883 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898f48e-1970-4633-8170-2f7ca1f9f48b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:55.743115 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:55.749393 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898f48e-1970-4633-8170-2f7ca1f9f48b admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:55.787790 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1274/2520] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:59:55 2022] POST /identity/v3/projects => generated 393 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:55.790401 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087722e-ecf0-4a61-a2e2-4488efd6bb4a admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:55.793801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1247/2521] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:59:55 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:55.800754 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898f48e-1970-4633-8170-2f7ca1f9f48b admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:55.814803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898f48e-1970-4633-8170-2f7ca1f9f48b admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:55.909306 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087722e-ecf0-4a61-a2e2-4488efd6bb4a admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:55.916569 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d312868-d359-4541-97dc-10475c9ea1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:55.921905 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d312868-d359-4541-97dc-10475c9ea1b1 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:55.922312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d312868-d359-4541-97dc-10475c9ea1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:55.922659 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d312868-d359-4541-97dc-10475c9ea1b1 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:55.924288 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d312868-d359-4541-97dc-10475c9ea1b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:55.927220 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d312868-d359-4541-97dc-10475c9ea1b1 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:55.952990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe3067-10cd-445d-a83d-a31908bb44b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:55.954000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe3067-10cd-445d-a83d-a31908bb44b8 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:55.954525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe3067-10cd-445d-a83d-a31908bb44b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:55.955004 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe3067-10cd-445d-a83d-a31908bb44b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:55.955891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe3067-10cd-445d-a83d-a31908bb44b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:55.960567 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe3067-10cd-445d-a83d-a31908bb44b8 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:55.966873 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1275/2522] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:59:55 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:55.973002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d312868-d359-4541-97dc-10475c9ea1b1 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:55.976922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1248/2523] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:55.982479 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe3067-10cd-445d-a83d-a31908bb44b8 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:55.985958 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d312868-d359-4541-97dc-10475c9ea1b1 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:55.991873 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86eec2-59a6-4128-b4a2-debd624ef349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:55.992639 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86eec2-59a6-4128-b4a2-debd624ef349 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:55.993029 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86eec2-59a6-4128-b4a2-debd624ef349 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:55.993209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86eec2-59a6-4128-b4a2-debd624ef349 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:55.993899 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86eec2-59a6-4128-b4a2-debd624ef349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:55.995829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86eec2-59a6-4128-b4a2-debd624ef349 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:55.996574 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe3067-10cd-445d-a83d-a31908bb44b8 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:56.003024 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e11e3-0fe0-430a-9edb-77f4fb8dbf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:56.003758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e11e3-0fe0-430a-9edb-77f4fb8dbf7d admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:56.004119 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e11e3-0fe0-430a-9edb-77f4fb8dbf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:56.004449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e11e3-0fe0-430a-9edb-77f4fb8dbf7d admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:56.005328 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e11e3-0fe0-430a-9edb-77f4fb8dbf7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:56.007115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e11e3-0fe0-430a-9edb-77f4fb8dbf7d admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:56.012202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1276/2524] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:56.020250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1249/2525] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:59:56.026380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e11e3-0fe0-430a-9edb-77f4fb8dbf7d admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:56.036046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86eec2-59a6-4128-b4a2-debd624ef349 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:56.038907 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e11e3-0fe0-430a-9edb-77f4fb8dbf7d admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:56.047820 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac773c-c106-4689-acae-4be57d868a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:56.048656 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac773c-c106-4689-acae-4be57d868a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:56.049041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac773c-c106-4689-acae-4be57d868a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:56.049484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac773c-c106-4689-acae-4be57d868a95 admin admin] PATH_INFO: `/v3/projects/813843b6231c48139399993a7ebde7f2/users/5932656ef0ca4186a1a3498e8a1ad279/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:56.050005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86eec2-59a6-4128-b4a2-debd624ef349 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:56.059316 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b5de1-7908-43b2-92f2-b7647becb214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:56.060231 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b5de1-7908-43b2-92f2-b7647becb214 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:56.060662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b5de1-7908-43b2-92f2-b7647becb214 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:56.061156 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b5de1-7908-43b2-92f2-b7647becb214 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:56.062030 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b5de1-7908-43b2-92f2-b7647becb214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:56.063892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b5de1-7908-43b2-92f2-b7647becb214 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:56.078489 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1277/2526] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:56.083084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b5de1-7908-43b2-92f2-b7647becb214 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:56.088045 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac773c-c106-4689-acae-4be57d868a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=813843b6231c48139399993a7ebde7f2, user_id=5932656ef0ca4186a1a3498e8a1ad279, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:56.106581 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac773c-c106-4689-acae-4be57d868a95 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:56.119073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b5de1-7908-43b2-92f2-b7647becb214 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:56.125437 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dbc86-1090-4aea-a5b0-6fa13c7d3953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:56.126503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dbc86-1090-4aea-a5b0-6fa13c7d3953 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:56.126641 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dbc86-1090-4aea-a5b0-6fa13c7d3953 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:56.126862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dbc86-1090-4aea-a5b0-6fa13c7d3953 admin admin] PATH_INFO: `/v3/projects/35e9bb4745804a4296b1fbac91fe4c4e/users/c66b4413984048cdbdf2860cf2ec06c7/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:56.142107 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1250/2527] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:56 2022] PUT /identity/v3/projects/813843b6231c48139399993a7ebde7f2/users/5932656ef0ca4186a1a3498e8a1ad279/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:59:56.158953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665bc9e-e0ca-489a-8a7a-b27655b8cb66 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:56.161216 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665bc9e-e0ca-489a-8a7a-b27655b8cb66 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:56.161818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665bc9e-e0ca-489a-8a7a-b27655b8cb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:56.161944 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dbc86-1090-4aea-a5b0-6fa13c7d3953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e9bb4745804a4296b1fbac91fe4c4e, user_id=c66b4413984048cdbdf2860cf2ec06c7, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:56.165046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dbc86-1090-4aea-a5b0-6fa13c7d3953 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:56.201768 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1278/2528] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:56 2022] PUT /identity/v3/projects/35e9bb4745804a4296b1fbac91fe4c4e/users/c66b4413984048cdbdf2860cf2ec06c7/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:56.209129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55821bae-96de-4f0c-804f-df418b980d3f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:56.209534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55821bae-96de-4f0c-804f-df418b980d3f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:56.209721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55821bae-96de-4f0c-804f-df418b980d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:56.220086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-e665bc9e-e0ca-489a-8a7a-b27655b8cb66 None None] MFA Rules not processed for user `5932656ef0ca4186a1a3498e8a1ad279`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:56.222235 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e665bc9e-e0ca-489a-8a7a-b27655b8cb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:56.254753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:56.262431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-55821bae-96de-4f0c-804f-df418b980d3f None None] MFA Rules not processed for user `c66b4413984048cdbdf2860cf2ec06c7`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:56.268080 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-55821bae-96de-4f0c-804f-df418b980d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:56.332453 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1251/2529] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 12 23:59:56.340167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665bc9e-e0ca-489a-8a7a-b27655b8cb66 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:56.389437 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1279/2530] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:59:56.393447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55821bae-96de-4f0c-804f-df418b980d3f None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:56.441820 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:56.461188 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665bc9e-e0ca-489a-8a7a-b27655b8cb66 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:56.473258 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa66895-170b-4591-8823-7a445bacd105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:56.474079 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa66895-170b-4591-8823-7a445bacd105 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:56.474366 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa66895-170b-4591-8823-7a445bacd105 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:56.474689 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa66895-170b-4591-8823-7a445bacd105 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:56.475350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa66895-170b-4591-8823-7a445bacd105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:56.477302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa66895-170b-4591-8823-7a445bacd105 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:56.541830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55821bae-96de-4f0c-804f-df418b980d3f None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:56.554285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1794ae0-7520-494f-9718-2939c0879feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:56.555309 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1794ae0-7520-494f-9718-2939c0879feb admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:56.556101 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1794ae0-7520-494f-9718-2939c0879feb admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:56.556381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1794ae0-7520-494f-9718-2939c0879feb admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:56.557098 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1794ae0-7520-494f-9718-2939c0879feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:56.559526 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1794ae0-7520-494f-9718-2939c0879feb admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:56.561301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1252/2531] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:59:56 2022] POST /identity/v3/projects => generated 373 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:56.565797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa66895-170b-4591-8823-7a445bacd105 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:56.618854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1280/2532] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 12 23:59:56 2022] POST /identity/v3/projects => generated 391 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:59:56.627238 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1794ae0-7520-494f-9718-2939c0879feb admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:56.668457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa66895-170b-4591-8823-7a445bacd105 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:56.721775 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1794ae0-7520-494f-9718-2939c0879feb admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:56.729284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333b686-e86b-47a9-b80f-cf6ff3e91163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:56.732133 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333b686-e86b-47a9-b80f-cf6ff3e91163 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:56.732334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333b686-e86b-47a9-b80f-cf6ff3e91163 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:56.732762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333b686-e86b-47a9-b80f-cf6ff3e91163 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:56.733519 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333b686-e86b-47a9-b80f-cf6ff3e91163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:56.738532 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333b686-e86b-47a9-b80f-cf6ff3e91163 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:56.769150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1281/2533] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:59:56 2022] POST /identity/v3/users => generated 302 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 12 23:59:56.769853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:56.773136 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333b686-e86b-47a9-b80f-cf6ff3e91163 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:56.785006 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333b686-e86b-47a9-b80f-cf6ff3e91163 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:56.789749 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6296b5-dda3-4c90-89d7-706f4f77217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:56.790598 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fa176-e61c-48f0-ac96-a867fdb2cf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:56.791332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fa176-e61c-48f0-ac96-a867fdb2cf17 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:56.791521 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fa176-e61c-48f0-ac96-a867fdb2cf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:56.791769 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fa176-e61c-48f0-ac96-a867fdb2cf17 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:56.792182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6296b5-dda3-4c90-89d7-706f4f77217c admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:56.792719 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6296b5-dda3-4c90-89d7-706f4f77217c admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:56.792981 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fa176-e61c-48f0-ac96-a867fdb2cf17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:56.794128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6296b5-dda3-4c90-89d7-706f4f77217c admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:56.794642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fa176-e61c-48f0-ac96-a867fdb2cf17 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:56.795400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6296b5-dda3-4c90-89d7-706f4f77217c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:56.798941 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6296b5-dda3-4c90-89d7-706f4f77217c admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:56.807543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1282/2534] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:56.812413 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fa176-e61c-48f0-ac96-a867fdb2cf17 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:56.823888 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fa176-e61c-48f0-ac96-a867fdb2cf17 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:56.833449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1b66c-91af-4b8c-961d-17a5625770b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:56.834150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1b66c-91af-4b8c-961d-17a5625770b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:56.834437 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1b66c-91af-4b8c-961d-17a5625770b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:56.834740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1b66c-91af-4b8c-961d-17a5625770b3 admin admin] PATH_INFO: `/v3/projects/96a9f00a8625466eb12c6b446309a628/users/5a4fc9c81ab74b63bb86cb407ff7c410/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:56.835686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1253/2535] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 12 23:59:56 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 12 23:59:56.845717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6296b5-dda3-4c90-89d7-706f4f77217c admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:56.861701 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1b66c-91af-4b8c-961d-17a5625770b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a9f00a8625466eb12c6b446309a628, user_id=5a4fc9c81ab74b63bb86cb407ff7c410, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:56.864628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1b66c-91af-4b8c-961d-17a5625770b3 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:56.871127 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6296b5-dda3-4c90-89d7-706f4f77217c admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:56.879220 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89846e-2b3d-4bf2-a023-438a46a4133b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:56.880762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89846e-2b3d-4bf2-a023-438a46a4133b admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:56.881185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89846e-2b3d-4bf2-a023-438a46a4133b admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:56.881639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89846e-2b3d-4bf2-a023-438a46a4133b admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:56.882656 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89846e-2b3d-4bf2-a023-438a46a4133b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:56.885099 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1283/2536] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:56 2022] PUT /identity/v3/projects/96a9f00a8625466eb12c6b446309a628/users/5a4fc9c81ab74b63bb86cb407ff7c410/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:59:56.885250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89846e-2b3d-4bf2-a023-438a46a4133b admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:56.889232 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1b66c-91af-4b8c-961d-17a5625770b3 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:56.905919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1254/2537] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:56.909659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89846e-2b3d-4bf2-a023-438a46a4133b admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:56.923102 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89846e-2b3d-4bf2-a023-438a46a4133b admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:56.993547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1b66c-91af-4b8c-961d-17a5625770b3 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:56.996413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccfcb5-2037-4d5a-842c-3a464287e899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:56.997095 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccfcb5-2037-4d5a-842c-3a464287e899 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:56.997401 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccfcb5-2037-4d5a-842c-3a464287e899 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:56.997676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccfcb5-2037-4d5a-842c-3a464287e899 admin admin] PATH_INFO: `/v3/projects/fe57f9463b504760bef12742e6b538e9/users/3c3c7611cb514057ac2c61afa6c16784/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:57.003113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fadda4-ee8a-46e7-a34f-f332c03ee3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:57.003747 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fadda4-ee8a-46e7-a34f-f332c03ee3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:57.004030 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fadda4-ee8a-46e7-a34f-f332c03ee3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:57.004329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fadda4-ee8a-46e7-a34f-f332c03ee3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:57.005197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fadda4-ee8a-46e7-a34f-f332c03ee3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:57.006861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fadda4-ee8a-46e7-a34f-f332c03ee3a8 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:57.008383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:57.021703 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccfcb5-2037-4d5a-842c-3a464287e899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe57f9463b504760bef12742e6b538e9, user_id=3c3c7611cb514057ac2c61afa6c16784, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:57.021930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1284/2538] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 12 23:59:57.025368 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccfcb5-2037-4d5a-842c-3a464287e899 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:57.025958 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fadda4-ee8a-46e7-a34f-f332c03ee3a8 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:57.041114 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fadda4-ee8a-46e7-a34f-f332c03ee3a8 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:57.050474 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1255/2539] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:56 2022] PUT /identity/v3/projects/fe57f9463b504760bef12742e6b538e9/users/3c3c7611cb514057ac2c61afa6c16784/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:59:57.054547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccfcb5-2037-4d5a-842c-3a464287e899 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:57.114860 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ac4a3-97b8-4790-93f8-da326ba79d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:57.115642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac4a3-97b8-4790-93f8-da326ba79d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:57.115931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac4a3-97b8-4790-93f8-da326ba79d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:57.116207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac4a3-97b8-4790-93f8-da326ba79d84 admin admin] PATH_INFO: `/v3/projects/96a9f00a8625466eb12c6b446309a628/users/5a4fc9c81ab74b63bb86cb407ff7c410/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:57.118382 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ac4a3-97b8-4790-93f8-da326ba79d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a9f00a8625466eb12c6b446309a628, user_id=5a4fc9c81ab74b63bb86cb407ff7c410, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:57.121639 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ac4a3-97b8-4790-93f8-da326ba79d84 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:57.136304 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1285/2540] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:57 2022] PUT /identity/v3/projects/96a9f00a8625466eb12c6b446309a628/users/5a4fc9c81ab74b63bb86cb407ff7c410/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 12 23:59:57.143536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccfcb5-2037-4d5a-842c-3a464287e899 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:57.147455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a39a18-f914-47c9-8dac-6332ffa144f2 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:57.147945 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a39a18-f914-47c9-8dac-6332ffa144f2 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:57.148421 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a39a18-f914-47c9-8dac-6332ffa144f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:57.200997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-29a39a18-f914-47c9-8dac-6332ffa144f2 None None] MFA Rules not processed for user `5a4fc9c81ab74b63bb86cb407ff7c410`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:57.202481 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-29a39a18-f914-47c9-8dac-6332ffa144f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:57.218876 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268fe12-1c94-4fde-ad32-c5cf2719219c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:57.219528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268fe12-1c94-4fde-ad32-c5cf2719219c admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:57.219805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268fe12-1c94-4fde-ad32-c5cf2719219c admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:57.220065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268fe12-1c94-4fde-ad32-c5cf2719219c admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:57.220722 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268fe12-1c94-4fde-ad32-c5cf2719219c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:57.223031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268fe12-1c94-4fde-ad32-c5cf2719219c admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:57.230076 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:57.238826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1256/2541] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 12 23:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 12 23:59:57.241398 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268fe12-1c94-4fde-ad32-c5cf2719219c admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:57.254522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268fe12-1c94-4fde-ad32-c5cf2719219c admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:57.262120 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47f50e-0892-4660-8a8f-b21b7595a3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:57.262994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47f50e-0892-4660-8a8f-b21b7595a3c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:57.263337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47f50e-0892-4660-8a8f-b21b7595a3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:57.263671 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47f50e-0892-4660-8a8f-b21b7595a3c6 admin admin] PATH_INFO: `/v3/projects/fe57f9463b504760bef12742e6b538e9/users/3c3c7611cb514057ac2c61afa6c16784/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:57.266335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47f50e-0892-4660-8a8f-b21b7595a3c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe57f9463b504760bef12742e6b538e9, user_id=3c3c7611cb514057ac2c61afa6c16784, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:57.270023 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47f50e-0892-4660-8a8f-b21b7595a3c6 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:57.297672 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1257/2542] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 12 23:59:57 2022] PUT /identity/v3/projects/fe57f9463b504760bef12742e6b538e9/users/3c3c7611cb514057ac2c61afa6c16784/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 12 23:59:57.299717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5ade7-3297-4cd4-a54e-e0c1302d4102 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:57.300137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5ade7-3297-4cd4-a54e-e0c1302d4102 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:57.300420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5ade7-3297-4cd4-a54e-e0c1302d4102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:57.311187 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1286/2543] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:57 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:59:57.319678 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a39a18-f914-47c9-8dac-6332ffa144f2 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:57.321691 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-29a39a18-f914-47c9-8dac-6332ffa144f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:57.334470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-7ff5ade7-3297-4cd4-a54e-e0c1302d4102 None None] MFA Rules not processed for user `3c3c7611cb514057ac2c61afa6c16784`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:57.335804 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7ff5ade7-3297-4cd4-a54e-e0c1302d4102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:57.402984 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a39a18-f914-47c9-8dac-6332ffa144f2 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:57.429523 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1258/2544] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 12 23:59:57.443680 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5ade7-3297-4cd4-a54e-e0c1302d4102 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:57.445498 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7ff5ade7-3297-4cd4-a54e-e0c1302d4102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:57.451956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:57.480148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd826a0-3b2f-4fd2-9710-35325e4e40bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:57.480876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd826a0-3b2f-4fd2-9710-35325e4e40bf service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:57.481186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd826a0-3b2f-4fd2-9710-35325e4e40bf service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:57.481429 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd826a0-3b2f-4fd2-9710-35325e4e40bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:57.531797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5ade7-3297-4cd4-a54e-e0c1302d4102 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:57.537303 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe622fc-7dbf-43cf-a1c5-9e05dd876c49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:57.538477 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe622fc-7dbf-43cf-a1c5-9e05dd876c49 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:57.538985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe622fc-7dbf-43cf-a1c5-9e05dd876c49 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:57.539307 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe622fc-7dbf-43cf-a1c5-9e05dd876c49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:57.554412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe622fc-7dbf-43cf-a1c5-9e05dd876c49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:57.556126 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe622fc-7dbf-43cf-a1c5-9e05dd876c49 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:57.564070 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd826a0-3b2f-4fd2-9710-35325e4e40bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:57.565934 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd826a0-3b2f-4fd2-9710-35325e4e40bf service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:57.570257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1259/2545] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:59:57.578449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1287/2546] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:57 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 12 23:59:57.653864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe622fc-7dbf-43cf-a1c5-9e05dd876c49 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:57.655156 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd826a0-3b2f-4fd2-9710-35325e4e40bf service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 12 23:59:57.665310 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe622fc-7dbf-43cf-a1c5-9e05dd876c49 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:57.672194 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840afeb0-ee29-41b1-9a26-84c16a4153e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:57.672811 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840afeb0-ee29-41b1-9a26-84c16a4153e0 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:57.673085 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840afeb0-ee29-41b1-9a26-84c16a4153e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:57.673377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840afeb0-ee29-41b1-9a26-84c16a4153e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:57.673719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd826a0-3b2f-4fd2-9710-35325e4e40bf service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 12 23:59:57.678112 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aadc26-067e-4d73-bfa4-01ff1a62e3d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 12 23:59:57.678730 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aadc26-067e-4d73-bfa4-01ff1a62e3d5 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:57.679003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aadc26-067e-4d73-bfa4-01ff1a62e3d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:57.679278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aadc26-067e-4d73-bfa4-01ff1a62e3d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:57.760511 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840afeb0-ee29-41b1-9a26-84c16a4153e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:57.762835 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840afeb0-ee29-41b1-9a26-84c16a4153e0 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:57.767801 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aadc26-067e-4d73-bfa4-01ff1a62e3d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 12 23:59:57.771868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aadc26-067e-4d73-bfa4-01ff1a62e3d5 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 12 23:59:57.775666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1260/2547] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:59:57.818609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1288/2548] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 12 23:59:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 12 23:59:58.768006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d97c35-d36a-4666-9b19-425c6be8e457 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 12 23:59:58.768349 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d97c35-d36a-4666-9b19-425c6be8e457 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 12 23:59:58.768678 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d97c35-d36a-4666-9b19-425c6be8e457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 12 23:59:58.790648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-24d97c35-d36a-4666-9b19-425c6be8e457 None None] MFA Rules not processed for user `4020e53710354715b9c8a21d08618834`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 12 23:59:58.792070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-24d97c35-d36a-4666-9b19-425c6be8e457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 12 23:59:58.802286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:58.854294 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1261/2549] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 12 23:59:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:00.944493 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aadc26-067e-4d73-bfa4-01ff1a62e3d5 service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:00.946052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-54aadc26-067e-4d73-bfa4-01ff1a62e3d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:01.018457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aadc26-067e-4d73-bfa4-01ff1a62e3d5 service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:01.023423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae576a-8e26-4962-97cc-7f34e2de4cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:01.024830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae576a-8e26-4962-97cc-7f34e2de4cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:01.024830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae576a-8e26-4962-97cc-7f34e2de4cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:01.025036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae576a-8e26-4962-97cc-7f34e2de4cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:01.028332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-78ae576a-8e26-4962-97cc-7f34e2de4cf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:01.093685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c64f7e-3ee0-410b-92bb-9ba6bc961beb None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:01.093685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c64f7e-3ee0-410b-92bb-9ba6bc961beb None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:01.093685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c64f7e-3ee0-410b-92bb-9ba6bc961beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:01.113227 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:01.119520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-09c64f7e-3ee0-410b-92bb-9ba6bc961beb None None] MFA Rules not processed for user `e1f49820de264982aeec97fa0be3c290`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:01.122412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-09c64f7e-3ee0-410b-92bb-9ba6bc961beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:01.160269 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae576a-8e26-4962-97cc-7f34e2de4cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:01.161821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae576a-8e26-4962-97cc-7f34e2de4cf4 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:01.177746 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1289/2550] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 00:00:01.200142 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1262/2551] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Sep 13 00:00:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:01.216403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae576a-8e26-4962-97cc-7f34e2de4cf4 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:01.218415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-78ae576a-8e26-4962-97cc-7f34e2de4cf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:01.323639 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae576a-8e26-4962-97cc-7f34e2de4cf4 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:01.332551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f6a88-210d-4bd3-8626-15991b900049 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c45ae3144b4fe8ab4e921fda30164a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:01.333729 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f6a88-210d-4bd3-8626-15991b900049 service swift] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:01.334207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f6a88-210d-4bd3-8626-15991b900049 service swift] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:01.334638 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f6a88-210d-4bd3-8626-15991b900049 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:01.347120 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f6a88-210d-4bd3-8626-15991b900049 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:01.348674 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f6a88-210d-4bd3-8626-15991b900049 service swift] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:01.362451 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1290/2552] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Sep 13 00:00:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 00:00:01.857915 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c64f7e-3ee0-410b-92bb-9ba6bc961beb None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:01.886304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c64f7e-3ee0-410b-92bb-9ba6bc961beb None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:01.899362 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98f569-1788-4df5-8122-3e65ebe7f9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:01.900242 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98f569-1788-4df5-8122-3e65ebe7f9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:01.900766 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98f569-1788-4df5-8122-3e65ebe7f9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:01.901231 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98f569-1788-4df5-8122-3e65ebe7f9a1 admin admin] PATH_INFO: `/v3/users/c66b4413984048cdbdf2860cf2ec06c7` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:01.905582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98f569-1788-4df5-8122-3e65ebe7f9a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66b4413984048cdbdf2860cf2ec06c7)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:01.908665 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98f569-1788-4df5-8122-3e65ebe7f9a1 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:02.029283 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-7b98f569-1788-4df5-8122-3e65ebe7f9a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66b4413984048cdbdf2860cf2ec06c7'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:02.030897 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-7b98f569-1788-4df5-8122-3e65ebe7f9a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66b4413984048cdbdf2860cf2ec06c7'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:02.033172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-7b98f569-1788-4df5-8122-3e65ebe7f9a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66b4413984048cdbdf2860cf2ec06c7'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:02.071736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-7b98f569-1788-4df5-8122-3e65ebe7f9a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66b4413984048cdbdf2860cf2ec06c7'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:02.103791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-7b98f569-1788-4df5-8122-3e65ebe7f9a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66b4413984048cdbdf2860cf2ec06c7'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:02.146790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1263/2553] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:01 2022] DELETE /identity/v3/users/c66b4413984048cdbdf2860cf2ec06c7 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:02.152773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf88bad-9e7a-4026-b8ba-1e3c56311d65 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:02.154452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf88bad-9e7a-4026-b8ba-1e3c56311d65 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:02.155231 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf88bad-9e7a-4026-b8ba-1e3c56311d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:02.204017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-6bf88bad-9e7a-4026-b8ba-1e3c56311d65 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:02.205651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6bf88bad-9e7a-4026-b8ba-1e3c56311d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:02.328257 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1291/2554] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:02.351773 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98f569-1788-4df5-8122-3e65ebe7f9a1 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:02.353480 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7b98f569-1788-4df5-8122-3e65ebe7f9a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:02.442649 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:02.473738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98f569-1788-4df5-8122-3e65ebe7f9a1 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:02.481689 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56923c5-b40b-48c3-896e-53f7847da2d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:02.482421 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56923c5-b40b-48c3-896e-53f7847da2d9 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:02.482734 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56923c5-b40b-48c3-896e-53f7847da2d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:02.483035 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56923c5-b40b-48c3-896e-53f7847da2d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:02.503084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56923c5-b40b-48c3-896e-53f7847da2d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:02.504988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56923c5-b40b-48c3-896e-53f7847da2d9 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:02.528346 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1264/2555] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:04.285936 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf88bad-9e7a-4026-b8ba-1e3c56311d65 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:04.288385 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6bf88bad-9e7a-4026-b8ba-1e3c56311d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:04.330246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf88bad-9e7a-4026-b8ba-1e3c56311d65 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:04.355890 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:04.360349 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:04.362521 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:04.368067 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7 admin admin] PATH_INFO: `/v3/projects/35e9bb4745804a4296b1fbac91fe4c4e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:04.370185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e9bb4745804a4296b1fbac91fe4c4e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:04.380072 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:04.528404 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e9bb4745804a4296b1fbac91fe4c4e', 'request_id': 'req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:04.533555 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:04.543662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e9bb4745804a4296b1fbac91fe4c4e', 'request_id': 'req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:04.562712 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e9bb4745804a4296b1fbac91fe4c4e', 'request_id': 'req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:04.594717 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7 admin admin] The token cache is being invalidate because project 35e9bb4745804a4296b1fbac91fe4c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:04.597658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:04.600277 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:04.603566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1292/2556] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:04 2022] DELETE /identity/v3/projects/35e9bb4745804a4296b1fbac91fe4c4e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:04.608717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56923c5-b40b-48c3-896e-53f7847da2d9 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:04.626056 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56923c5-b40b-48c3-896e-53f7847da2d9 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:04.768748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1629b8-6f06-4e84-ac02-a98b34dd4ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:04.769779 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1629b8-6f06-4e84-ac02-a98b34dd4ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:04.770268 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1629b8-6f06-4e84-ac02-a98b34dd4ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:04.770742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1629b8-6f06-4e84-ac02-a98b34dd4ea3 admin admin] PATH_INFO: `/v3/users/5a4fc9c81ab74b63bb86cb407ff7c410` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:04.772223 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1629b8-6f06-4e84-ac02-a98b34dd4ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a4fc9c81ab74b63bb86cb407ff7c410)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:04.775057 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1629b8-6f06-4e84-ac02-a98b34dd4ea3 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:04.891310 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3b1629b8-6f06-4e84-ac02-a98b34dd4ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a4fc9c81ab74b63bb86cb407ff7c410'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:04.892374 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3b1629b8-6f06-4e84-ac02-a98b34dd4ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a4fc9c81ab74b63bb86cb407ff7c410'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:04.893107 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3b1629b8-6f06-4e84-ac02-a98b34dd4ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a4fc9c81ab74b63bb86cb407ff7c410'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:04.938470 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3b1629b8-6f06-4e84-ac02-a98b34dd4ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a4fc9c81ab74b63bb86cb407ff7c410'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:04.956250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-3b1629b8-6f06-4e84-ac02-a98b34dd4ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a4fc9c81ab74b63bb86cb407ff7c410'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:04.985644 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1265/2557] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:04 2022] DELETE /identity/v3/users/5a4fc9c81ab74b63bb86cb407ff7c410 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:05.819340 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:05.820692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:05.863912 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5bbe0-4e2c-4d1c-a7d7-a49b569211e7 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:06.000941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4573d29-85fd-4986-937d-a1ac221825db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:06.002318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4573d29-85fd-4986-937d-a1ac221825db admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:06.002817 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4573d29-85fd-4986-937d-a1ac221825db admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:06.003597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4573d29-85fd-4986-937d-a1ac221825db admin admin] PATH_INFO: `/v3/projects/96a9f00a8625466eb12c6b446309a628` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:06.006045 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4573d29-85fd-4986-937d-a1ac221825db admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a9f00a8625466eb12c6b446309a628)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:06.019861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4573d29-85fd-4986-937d-a1ac221825db admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:06.166440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b4573d29-85fd-4986-937d-a1ac221825db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a9f00a8625466eb12c6b446309a628', 'request_id': 'req-b4573d29-85fd-4986-937d-a1ac221825db'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:06.179688 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b4573d29-85fd-4986-937d-a1ac221825db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a9f00a8625466eb12c6b446309a628', 'request_id': 'req-b4573d29-85fd-4986-937d-a1ac221825db'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:06.190846 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b4573d29-85fd-4986-937d-a1ac221825db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a9f00a8625466eb12c6b446309a628', 'request_id': 'req-b4573d29-85fd-4986-937d-a1ac221825db'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:06.209866 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b4573d29-85fd-4986-937d-a1ac221825db admin admin] The token cache is being invalidate because project 96a9f00a8625466eb12c6b446309a628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:06.210601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b4573d29-85fd-4986-937d-a1ac221825db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:06.211472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b4573d29-85fd-4986-937d-a1ac221825db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:06.214073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1293/2558] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:05 2022] DELETE /identity/v3/projects/96a9f00a8625466eb12c6b446309a628 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:06.219032 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6f1f7-8499-4b8b-a2ad-ad78b8bab935 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:06.219552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6f1f7-8499-4b8b-a2ad-ad78b8bab935 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:06.219552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6f1f7-8499-4b8b-a2ad-ad78b8bab935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:06.257021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-47c6f1f7-8499-4b8b-a2ad-ad78b8bab935 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:06.259321 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-47c6f1f7-8499-4b8b-a2ad-ad78b8bab935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:06.409080 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:06.445112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1266/2559] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:06.447921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10b54b-c81d-4a28-b7ee-1da3cfdd32f4 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:06.448479 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10b54b-c81d-4a28-b7ee-1da3cfdd32f4 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:06.448969 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10b54b-c81d-4a28-b7ee-1da3cfdd32f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:06.493391 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-5d10b54b-c81d-4a28-b7ee-1da3cfdd32f4 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:06.498843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5d10b54b-c81d-4a28-b7ee-1da3cfdd32f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:06.523780 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1294/2560] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:06.529182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6f1f7-8499-4b8b-a2ad-ad78b8bab935 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:06.548339 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6f1f7-8499-4b8b-a2ad-ad78b8bab935 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:06.560971 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6ee06-977f-4700-b3a5-839690f60fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:06.563199 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6ee06-977f-4700-b3a5-839690f60fcf admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:06.563587 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6ee06-977f-4700-b3a5-839690f60fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:06.564644 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6ee06-977f-4700-b3a5-839690f60fcf admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:06.565579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6ee06-977f-4700-b3a5-839690f60fcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 00:00:06.567041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6ee06-977f-4700-b3a5-839690f60fcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:06.571251 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6ee06-977f-4700-b3a5-839690f60fcf admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:06.600881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1267/2561] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Sep 13 00:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 00:00:06.605658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10b54b-c81d-4a28-b7ee-1da3cfdd32f4 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:06.617902 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10b54b-c81d-4a28-b7ee-1da3cfdd32f4 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:06.624168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0fb06-1f46-4d7e-a316-9444049e1c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:06.625065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0fb06-1f46-4d7e-a316-9444049e1c88 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:06.625516 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0fb06-1f46-4d7e-a316-9444049e1c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:06.625896 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0fb06-1f46-4d7e-a316-9444049e1c88 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:06.626857 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0fb06-1f46-4d7e-a316-9444049e1c88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:06.639579 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0fb06-1f46-4d7e-a316-9444049e1c88 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:06.705202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1295/2562] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:06 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:00:06.709515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6ee06-977f-4700-b3a5-839690f60fcf admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:06.727109 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6ee06-977f-4700-b3a5-839690f60fcf admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:06.816906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf68f2-2912-4d5c-bcf1-85f4203c9069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:06.817913 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf68f2-2912-4d5c-bcf1-85f4203c9069 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:06.818210 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf68f2-2912-4d5c-bcf1-85f4203c9069 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:06.818491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf68f2-2912-4d5c-bcf1-85f4203c9069 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:06.822699 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf68f2-2912-4d5c-bcf1-85f4203c9069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:06.827438 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf68f2-2912-4d5c-bcf1-85f4203c9069 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:06.881399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1268/2563] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:06 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:06.883560 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0fb06-1f46-4d7e-a316-9444049e1c88 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:06.901673 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0fb06-1f46-4d7e-a316-9444049e1c88 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:06.918010 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40a978-a62d-489c-b6a2-f5a956f479d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:06.918823 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40a978-a62d-489c-b6a2-f5a956f479d8 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:06.919118 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40a978-a62d-489c-b6a2-f5a956f479d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:06.919393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40a978-a62d-489c-b6a2-f5a956f479d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:06.920168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40a978-a62d-489c-b6a2-f5a956f479d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:06.927291 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40a978-a62d-489c-b6a2-f5a956f479d8 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:06.964337 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1296/2564] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:06.969939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf68f2-2912-4d5c-bcf1-85f4203c9069 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:06.994713 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf68f2-2912-4d5c-bcf1-85f4203c9069 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:07.009937 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693205a-c822-4752-b833-75401f853ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:07.010801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693205a-c822-4752-b833-75401f853ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:07.011181 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693205a-c822-4752-b833-75401f853ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:07.011618 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693205a-c822-4752-b833-75401f853ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:07.012542 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693205a-c822-4752-b833-75401f853ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:07.014655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693205a-c822-4752-b833-75401f853ce9 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:07.043000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1269/2565] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:07.048578 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40a978-a62d-489c-b6a2-f5a956f479d8 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:07.077317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40a978-a62d-489c-b6a2-f5a956f479d8 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:07.094382 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d3194-8ace-49cd-8c5f-340267febf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:07.095501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d3194-8ace-49cd-8c5f-340267febf61 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:07.095917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d3194-8ace-49cd-8c5f-340267febf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:07.096069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d3194-8ace-49cd-8c5f-340267febf61 admin admin] PATH_INFO: `/v3/projects/891a33d0a7f64e6ba671d29f89e44238/users/a3cf03bc680640b0859023f1657b3642/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:07.131562 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d3194-8ace-49cd-8c5f-340267febf61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=891a33d0a7f64e6ba671d29f89e44238, user_id=a3cf03bc680640b0859023f1657b3642, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:07.134370 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d3194-8ace-49cd-8c5f-340267febf61 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:07.168847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1297/2566] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:07 2022] PUT /identity/v3/projects/891a33d0a7f64e6ba671d29f89e44238/users/a3cf03bc680640b0859023f1657b3642/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:07.184001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25889d-ad69-44d1-b6ea-5eafc8caeacf None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:07.184426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25889d-ad69-44d1-b6ea-5eafc8caeacf None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:07.185008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25889d-ad69-44d1-b6ea-5eafc8caeacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:07.267067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-2d25889d-ad69-44d1-b6ea-5eafc8caeacf None None] MFA Rules not processed for user `a3cf03bc680640b0859023f1657b3642`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:07.268247 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-2d25889d-ad69-44d1-b6ea-5eafc8caeacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:07.428974 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1270/2567] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:07.431079 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d3194-8ace-49cd-8c5f-340267febf61 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:07.452082 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:07.694196 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d3194-8ace-49cd-8c5f-340267febf61 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:07.701816 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f614d89-e9f4-4b27-981e-b13ade126e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:07.702666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f614d89-e9f4-4b27-981e-b13ade126e63 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:07.703123 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f614d89-e9f4-4b27-981e-b13ade126e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:07.703409 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f614d89-e9f4-4b27-981e-b13ade126e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:07.704278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f614d89-e9f4-4b27-981e-b13ade126e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:07.706894 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f614d89-e9f4-4b27-981e-b13ade126e63 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:07.774396 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1298/2568] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:07 2022] POST /identity/v3/projects => generated 377 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:07.778867 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25889d-ad69-44d1-b6ea-5eafc8caeacf None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:07.799068 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25889d-ad69-44d1-b6ea-5eafc8caeacf None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:07.938269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:07.987934 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394cecd-62f6-4b0f-aa5b-f87f1da20589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:07.992070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394cecd-62f6-4b0f-aa5b-f87f1da20589 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:07.993702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394cecd-62f6-4b0f-aa5b-f87f1da20589 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:07.993977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394cecd-62f6-4b0f-aa5b-f87f1da20589 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:07.995276 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394cecd-62f6-4b0f-aa5b-f87f1da20589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:08.004350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394cecd-62f6-4b0f-aa5b-f87f1da20589 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:08.045102 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1271/2569] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:07 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:00:08.050163 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f614d89-e9f4-4b27-981e-b13ade126e63 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:08.067264 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f614d89-e9f4-4b27-981e-b13ade126e63 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:08.094086 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336201a-0000-48c2-bb3b-a10b455bbb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:08.096037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336201a-0000-48c2-bb3b-a10b455bbb40 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:08.096402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336201a-0000-48c2-bb3b-a10b455bbb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:08.097097 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336201a-0000-48c2-bb3b-a10b455bbb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:08.097986 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336201a-0000-48c2-bb3b-a10b455bbb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:08.100558 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336201a-0000-48c2-bb3b-a10b455bbb40 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:08.115335 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1299/2570] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:08.119273 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394cecd-62f6-4b0f-aa5b-f87f1da20589 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:08.135296 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394cecd-62f6-4b0f-aa5b-f87f1da20589 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:08.140725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493a89d-ba3f-4f6f-a627-f3eb5523acca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:08.142314 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493a89d-ba3f-4f6f-a627-f3eb5523acca admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:08.142677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493a89d-ba3f-4f6f-a627-f3eb5523acca admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:08.144382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493a89d-ba3f-4f6f-a627-f3eb5523acca admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:08.144847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493a89d-ba3f-4f6f-a627-f3eb5523acca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:08.149864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493a89d-ba3f-4f6f-a627-f3eb5523acca admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:08.165274 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1272/2571] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:08.166400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336201a-0000-48c2-bb3b-a10b455bbb40 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:08.187803 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336201a-0000-48c2-bb3b-a10b455bbb40 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:08.201536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dd6bf-691a-4b3a-b9ea-f38306051dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:08.202259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dd6bf-691a-4b3a-b9ea-f38306051dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:08.202542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dd6bf-691a-4b3a-b9ea-f38306051dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:08.202821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dd6bf-691a-4b3a-b9ea-f38306051dbe admin admin] PATH_INFO: `/v3/projects/60366076112647259f7b93a91b856eea/users/22d7ba1eead94e249445e54be9d1ead7/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:08.242312 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05dd6bf-691a-4b3a-b9ea-f38306051dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=60366076112647259f7b93a91b856eea, user_id=22d7ba1eead94e249445e54be9d1ead7, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:08.252192 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05dd6bf-691a-4b3a-b9ea-f38306051dbe admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:08.284373 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1300/2572] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:08 2022] PUT /identity/v3/projects/60366076112647259f7b93a91b856eea/users/22d7ba1eead94e249445e54be9d1ead7/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:08.303453 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddf8af-cdb8-47a3-a93a-22f316ad9976 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:08.304054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddf8af-cdb8-47a3-a93a-22f316ad9976 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:08.304303 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddf8af-cdb8-47a3-a93a-22f316ad9976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:08.374387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-4cddf8af-cdb8-47a3-a93a-22f316ad9976 None None] MFA Rules not processed for user `22d7ba1eead94e249445e54be9d1ead7`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:08.375757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4cddf8af-cdb8-47a3-a93a-22f316ad9976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:08.514256 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dd6bf-691a-4b3a-b9ea-f38306051dbe admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:08.514902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1273/2573] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:08.657000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dd6bf-691a-4b3a-b9ea-f38306051dbe admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:08.669967 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafc8dd-d743-4a78-806c-5059cb95e214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:08.670625 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafc8dd-d743-4a78-806c-5059cb95e214 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:08.670908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafc8dd-d743-4a78-806c-5059cb95e214 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:08.686899 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafc8dd-d743-4a78-806c-5059cb95e214 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:08.687416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafc8dd-d743-4a78-806c-5059cb95e214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:08.695190 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafc8dd-d743-4a78-806c-5059cb95e214 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:08.770539 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1301/2574] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:08 2022] POST /identity/v3/projects => generated 377 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:00:08.777879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddf8af-cdb8-47a3-a93a-22f316ad9976 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:08.802415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddf8af-cdb8-47a3-a93a-22f316ad9976 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:08.866067 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafc8dd-d743-4a78-806c-5059cb95e214 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:08.869399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2fafc8dd-d743-4a78-806c-5059cb95e214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:08.928484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee4844-8975-47e2-93f1-78dbdc78241e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:08.929120 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee4844-8975-47e2-93f1-78dbdc78241e admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:08.929424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee4844-8975-47e2-93f1-78dbdc78241e admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:08.931618 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee4844-8975-47e2-93f1-78dbdc78241e admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:08.932344 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee4844-8975-47e2-93f1-78dbdc78241e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:08.935408 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee4844-8975-47e2-93f1-78dbdc78241e admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:09.017252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1274/2575] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:08 2022] POST /identity/v3/users => generated 295 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:09.025702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee4844-8975-47e2-93f1-78dbdc78241e admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:09.028920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9bee4844-8975-47e2-93f1-78dbdc78241e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:09.057395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:09.058833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee4844-8975-47e2-93f1-78dbdc78241e admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:09.067399 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf295f-9f85-40c0-a5e5-01a1de3cc64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:09.069061 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf295f-9f85-40c0-a5e5-01a1de3cc64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:09.070313 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf295f-9f85-40c0-a5e5-01a1de3cc64a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:09.070612 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf295f-9f85-40c0-a5e5-01a1de3cc64a admin admin] PATH_INFO: `/v3/users/938c34cda5234812894863921ad14d4e` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:09.073819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf295f-9f85-40c0-a5e5-01a1de3cc64a admin admin] RBAC: Authorizing `identity:delete_user(user_id=938c34cda5234812894863921ad14d4e)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:09.078650 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf295f-9f85-40c0-a5e5-01a1de3cc64a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:09.134651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafc8dd-d743-4a78-806c-5059cb95e214 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:09.150823 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93dc07-1a21-400e-835a-5871435340b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4395ee0a00df41adacb55b4a8684786b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:09.153637 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93dc07-1a21-400e-835a-5871435340b5 service placement] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:09.154849 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93dc07-1a21-400e-835a-5871435340b5 service placement] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:09.156055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93dc07-1a21-400e-835a-5871435340b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:09.161729 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-dc93dc07-1a21-400e-835a-5871435340b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:09.185435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93dc07-1a21-400e-835a-5871435340b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:09.187980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93dc07-1a21-400e-835a-5871435340b5 service placement] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:09.205552 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1302/2576] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:09.207472 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:09.207604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93dc07-1a21-400e-835a-5871435340b5 service placement] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:09.210690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-8ccf295f-9f85-40c0-a5e5-01a1de3cc64a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '938c34cda5234812894863921ad14d4e'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:09.213008 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-8ccf295f-9f85-40c0-a5e5-01a1de3cc64a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '938c34cda5234812894863921ad14d4e'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:09.213801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-8ccf295f-9f85-40c0-a5e5-01a1de3cc64a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '938c34cda5234812894863921ad14d4e'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:09.235062 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93dc07-1a21-400e-835a-5871435340b5 service placement] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:09.240225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87ff2d-83e2-4d2a-8563-1c73385fe6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:09.241054 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ff2d-83e2-4d2a-8563-1c73385fe6fd admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:09.241393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ff2d-83e2-4d2a-8563-1c73385fe6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:09.241642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ff2d-83e2-4d2a-8563-1c73385fe6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:09.242786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87ff2d-83e2-4d2a-8563-1c73385fe6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:09.244748 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87ff2d-83e2-4d2a-8563-1c73385fe6fd admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:09.249793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-8ccf295f-9f85-40c0-a5e5-01a1de3cc64a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '938c34cda5234812894863921ad14d4e'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:09.258423 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-8ccf295f-9f85-40c0-a5e5-01a1de3cc64a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '938c34cda5234812894863921ad14d4e'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:09.261821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1303/2577] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:09.265313 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87ff2d-83e2-4d2a-8563-1c73385fe6fd admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:09.267597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ee87ff2d-83e2-4d2a-8563-1c73385fe6fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:09.276609 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1275/2578] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:09 2022] DELETE /identity/v3/users/938c34cda5234812894863921ad14d4e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:09.293241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87ff2d-83e2-4d2a-8563-1c73385fe6fd admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:09.369143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82762924-5f9e-4afc-a56a-78590b66081d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:09.370304 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82762924-5f9e-4afc-a56a-78590b66081d admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:09.370908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82762924-5f9e-4afc-a56a-78590b66081d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:09.371360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82762924-5f9e-4afc-a56a-78590b66081d admin admin] PATH_INFO: `/v3/projects/faaf35162e64475ba921b0c391439aa9/users/ec814614788942df8876b5309d5df019/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:09.389524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82762924-5f9e-4afc-a56a-78590b66081d admin admin] RBAC: Authorizing `identity:create_grant(project_id=faaf35162e64475ba921b0c391439aa9, user_id=ec814614788942df8876b5309d5df019, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:09.392718 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82762924-5f9e-4afc-a56a-78590b66081d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:09.432055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1304/2579] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:09 2022] PUT /identity/v3/projects/faaf35162e64475ba921b0c391439aa9/users/ec814614788942df8876b5309d5df019/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:09.436487 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf295f-9f85-40c0-a5e5-01a1de3cc64a admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:09.448180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf295f-9f85-40c0-a5e5-01a1de3cc64a admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:09.542775 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82762924-5f9e-4afc-a56a-78590b66081d admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:09.545054 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-82762924-5f9e-4afc-a56a-78590b66081d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:09.550071 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46062bcd-1ab4-4c10-b709-d167db9c2ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:09.550876 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46062bcd-1ab4-4c10-b709-d167db9c2ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:09.551589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46062bcd-1ab4-4c10-b709-d167db9c2ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:09.551999 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46062bcd-1ab4-4c10-b709-d167db9c2ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:09.553028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46062bcd-1ab4-4c10-b709-d167db9c2ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:09.555173 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46062bcd-1ab4-4c10-b709-d167db9c2ef7 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:09.582138 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1276/2580] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:09.586360 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46062bcd-1ab4-4c10-b709-d167db9c2ef7 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:09.587141 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82762924-5f9e-4afc-a56a-78590b66081d admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:09.614461 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46062bcd-1ab4-4c10-b709-d167db9c2ef7 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:09.627855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ea0bb-df15-4c11-9b53-758e00f7dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:09.628762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ea0bb-df15-4c11-9b53-758e00f7dec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:09.629044 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ea0bb-df15-4c11-9b53-758e00f7dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:09.629316 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ea0bb-df15-4c11-9b53-758e00f7dec6 admin admin] PATH_INFO: `/v3/projects/faaf35162e64475ba921b0c391439aa9/users/ec814614788942df8876b5309d5df019/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:09.631382 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ea0bb-df15-4c11-9b53-758e00f7dec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faaf35162e64475ba921b0c391439aa9, user_id=ec814614788942df8876b5309d5df019, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:09.632905 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137f1ac-a9be-46cc-94f0-910847beb1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:09.633612 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137f1ac-a9be-46cc-94f0-910847beb1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:09.633892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137f1ac-a9be-46cc-94f0-910847beb1da admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:09.634133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ea0bb-df15-4c11-9b53-758e00f7dec6 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:09.634884 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137f1ac-a9be-46cc-94f0-910847beb1da admin admin] PATH_INFO: `/v3/projects/bc314ad5d96542b487703085b86f16da` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:09.639758 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137f1ac-a9be-46cc-94f0-910847beb1da admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc314ad5d96542b487703085b86f16da)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:09.643102 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137f1ac-a9be-46cc-94f0-910847beb1da admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:09.647302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1277/2581] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:09 2022] PUT /identity/v3/projects/faaf35162e64475ba921b0c391439aa9/users/ec814614788942df8876b5309d5df019/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:09.659103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dbea4-17a3-4144-a194-60ab3b987815 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:09.659428 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dbea4-17a3-4144-a194-60ab3b987815 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:09.659698 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dbea4-17a3-4144-a194-60ab3b987815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:09.698488 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-9a7dbea4-17a3-4144-a194-60ab3b987815 None None] MFA Rules not processed for user `ec814614788942df8876b5309d5df019`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:09.699789 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9a7dbea4-17a3-4144-a194-60ab3b987815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:09.765040 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e137f1ac-a9be-46cc-94f0-910847beb1da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc314ad5d96542b487703085b86f16da', 'request_id': 'req-e137f1ac-a9be-46cc-94f0-910847beb1da'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:09.781114 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e137f1ac-a9be-46cc-94f0-910847beb1da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc314ad5d96542b487703085b86f16da', 'request_id': 'req-e137f1ac-a9be-46cc-94f0-910847beb1da'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:09.799052 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1278/2582] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:09.799775 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e137f1ac-a9be-46cc-94f0-910847beb1da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc314ad5d96542b487703085b86f16da', 'request_id': 'req-e137f1ac-a9be-46cc-94f0-910847beb1da'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:09.814109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e137f1ac-a9be-46cc-94f0-910847beb1da admin admin] The token cache is being invalidate because project bc314ad5d96542b487703085b86f16da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:09.814425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e137f1ac-a9be-46cc-94f0-910847beb1da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:09.815199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e137f1ac-a9be-46cc-94f0-910847beb1da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:09.817147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dbea4-17a3-4144-a194-60ab3b987815 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:09.820417 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1305/2583] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:09 2022] DELETE /identity/v3/projects/bc314ad5d96542b487703085b86f16da => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:09.820921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9a7dbea4-17a3-4144-a194-60ab3b987815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:09.822179 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45b3e2-e1ff-4121-a14d-8395323df458 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:09.822523 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45b3e2-e1ff-4121-a14d-8395323df458 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:09.822861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45b3e2-e1ff-4121-a14d-8395323df458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:09.846551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-6f45b3e2-e1ff-4121-a14d-8395323df458 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:09.847893 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6f45b3e2-e1ff-4121-a14d-8395323df458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:09.870439 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:09.888460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:09.911925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dbea4-17a3-4144-a194-60ab3b987815 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:09.949962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1306/2584] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:09.958155 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c5cf0-46dc-4fa2-94a3-f53911acd8a1 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:09.958512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c5cf0-46dc-4fa2-94a3-f53911acd8a1 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:09.958708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c5cf0-46dc-4fa2-94a3-f53911acd8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:09.983600 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-520c5cf0-46dc-4fa2-94a3-f53911acd8a1 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:09.984851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-520c5cf0-46dc-4fa2-94a3-f53911acd8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:09.997520 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1307/2585] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:09.998886 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c5cf0-46dc-4fa2-94a3-f53911acd8a1 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:10.000618 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca51e27-93fe-4a38-9815-b007e5a8aa82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:10.001519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca51e27-93fe-4a38-9815-b007e5a8aa82 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:10.001801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca51e27-93fe-4a38-9815-b007e5a8aa82 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:10.002490 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca51e27-93fe-4a38-9815-b007e5a8aa82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:10.004972 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-cca51e27-93fe-4a38-9815-b007e5a8aa82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:10.011106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c5cf0-46dc-4fa2-94a3-f53911acd8a1 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:10.016759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f031a8b-a701-444f-8cb1-3b5d6a7081f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:10.017809 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f031a8b-a701-444f-8cb1-3b5d6a7081f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:10.018023 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f031a8b-a701-444f-8cb1-3b5d6a7081f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:10.018281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f031a8b-a701-444f-8cb1-3b5d6a7081f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:10.018955 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f031a8b-a701-444f-8cb1-3b5d6a7081f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 00:00:10.019321 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f031a8b-a701-444f-8cb1-3b5d6a7081f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:10.021173 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f031a8b-a701-444f-8cb1-3b5d6a7081f8 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:10.044282 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1308/2586] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Sep 13 00:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 00:00:10.047462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f031a8b-a701-444f-8cb1-3b5d6a7081f8 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:10.066163 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f031a8b-a701-444f-8cb1-3b5d6a7081f8 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:10.072982 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d54b0-b161-4a34-af38-0af9eede1683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:10.074267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d54b0-b161-4a34-af38-0af9eede1683 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:10.075877 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d54b0-b161-4a34-af38-0af9eede1683 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:10.076483 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d54b0-b161-4a34-af38-0af9eede1683 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:10.077360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d54b0-b161-4a34-af38-0af9eede1683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:10.079765 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d54b0-b161-4a34-af38-0af9eede1683 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:10.112720 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca51e27-93fe-4a38-9815-b007e5a8aa82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:10.114139 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca51e27-93fe-4a38-9815-b007e5a8aa82 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:10.126392 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1279/2587] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:10.130924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1309/2588] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:10 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:10.141838 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca51e27-93fe-4a38-9815-b007e5a8aa82 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:10.156348 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca51e27-93fe-4a38-9815-b007e5a8aa82 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:10.301029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaa23a-0b25-42b4-ac61-b19fdb5d9563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:10.302015 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaa23a-0b25-42b4-ac61-b19fdb5d9563 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:10.302303 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaa23a-0b25-42b4-ac61-b19fdb5d9563 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:10.302659 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaa23a-0b25-42b4-ac61-b19fdb5d9563 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:10.304128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afaa23a-0b25-42b4-ac61-b19fdb5d9563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:10.321441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afaa23a-0b25-42b4-ac61-b19fdb5d9563 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:10.388570 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1280/2589] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:10 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:10.404778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d54b0-b161-4a34-af38-0af9eede1683 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:10.434146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d54b0-b161-4a34-af38-0af9eede1683 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:10.472442 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c18df8-d6ff-4120-b4d0-239c3678954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:10.473110 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18df8-d6ff-4120-b4d0-239c3678954e admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:10.476674 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18df8-d6ff-4120-b4d0-239c3678954e admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:10.478970 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18df8-d6ff-4120-b4d0-239c3678954e admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:10.479741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c18df8-d6ff-4120-b4d0-239c3678954e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:10.498298 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c18df8-d6ff-4120-b4d0-239c3678954e admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:10.531648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1310/2590] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:10.533565 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaa23a-0b25-42b4-ac61-b19fdb5d9563 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:10.551471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaa23a-0b25-42b4-ac61-b19fdb5d9563 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:10.559763 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4204d9-b422-4980-93b6-76103d9760a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:10.560407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4204d9-b422-4980-93b6-76103d9760a3 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:10.560682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4204d9-b422-4980-93b6-76103d9760a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:10.560959 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4204d9-b422-4980-93b6-76103d9760a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:10.561732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4204d9-b422-4980-93b6-76103d9760a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:10.563430 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4204d9-b422-4980-93b6-76103d9760a3 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:10.586392 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1281/2591] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:10.590758 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c18df8-d6ff-4120-b4d0-239c3678954e admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:10.621194 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c18df8-d6ff-4120-b4d0-239c3678954e admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:10.634629 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c198eab-34f6-414b-b0bd-aa211b193ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:10.635703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c198eab-34f6-414b-b0bd-aa211b193ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:10.636061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c198eab-34f6-414b-b0bd-aa211b193ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:10.636412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c198eab-34f6-414b-b0bd-aa211b193ff1 admin admin] PATH_INFO: `/v3/projects/acaabbd3b0a04b63baa64b9e730a3492/users/333ea6d3eec6407388310b5a6b42c940/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:10.678105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c198eab-34f6-414b-b0bd-aa211b193ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acaabbd3b0a04b63baa64b9e730a3492, user_id=333ea6d3eec6407388310b5a6b42c940, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:10.682788 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c198eab-34f6-414b-b0bd-aa211b193ff1 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:10.720786 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1311/2592] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:10 2022] PUT /identity/v3/projects/acaabbd3b0a04b63baa64b9e730a3492/users/333ea6d3eec6407388310b5a6b42c940/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:10.742458 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a638d1-e407-4cdc-965b-70bc65b20718 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:10.743313 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a638d1-e407-4cdc-965b-70bc65b20718 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:10.743964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a638d1-e407-4cdc-965b-70bc65b20718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:10.838845 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-92a638d1-e407-4cdc-965b-70bc65b20718 None None] MFA Rules not processed for user `333ea6d3eec6407388310b5a6b42c940`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:10.840145 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-92a638d1-e407-4cdc-965b-70bc65b20718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:10.850492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:11.047667 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1282/2593] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:11.071703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c198eab-34f6-414b-b0bd-aa211b193ff1 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:11.074667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9c198eab-34f6-414b-b0bd-aa211b193ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:11.236083 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c198eab-34f6-414b-b0bd-aa211b193ff1 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:11.244172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117d2a7-01f0-4bf4-be34-60286dbd03ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:11.245281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117d2a7-01f0-4bf4-be34-60286dbd03ac service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:11.245850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117d2a7-01f0-4bf4-be34-60286dbd03ac service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:11.246219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117d2a7-01f0-4bf4-be34-60286dbd03ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:11.260096 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117d2a7-01f0-4bf4-be34-60286dbd03ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:11.261931 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117d2a7-01f0-4bf4-be34-60286dbd03ac service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:11.272703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1312/2594] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:12.140293 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a638d1-e407-4cdc-965b-70bc65b20718 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:12.141898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-92a638d1-e407-4cdc-965b-70bc65b20718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:12.203261 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a638d1-e407-4cdc-965b-70bc65b20718 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:12.206830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c507a3-875e-4d4f-b0ba-f5cf038e45eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:12.207431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c507a3-875e-4d4f-b0ba-f5cf038e45eb service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:12.207703 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c507a3-875e-4d4f-b0ba-f5cf038e45eb service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:12.207964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c507a3-875e-4d4f-b0ba-f5cf038e45eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:12.209682 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-69c507a3-875e-4d4f-b0ba-f5cf038e45eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:12.269610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c507a3-875e-4d4f-b0ba-f5cf038e45eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:12.271062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c507a3-875e-4d4f-b0ba-f5cf038e45eb service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:12.280420 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1283/2595] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:12.893073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117d2a7-01f0-4bf4-be34-60286dbd03ac service nova] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:12.909052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117d2a7-01f0-4bf4-be34-60286dbd03ac service nova] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:12.914105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945cf8c-8284-4218-861e-6d7eb253dbb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:12.914741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945cf8c-8284-4218-861e-6d7eb253dbb1 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:12.915024 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945cf8c-8284-4218-861e-6d7eb253dbb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:12.915324 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945cf8c-8284-4218-861e-6d7eb253dbb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:12.918805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-f945cf8c-8284-4218-861e-6d7eb253dbb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:12.961565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:13.008720 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945cf8c-8284-4218-861e-6d7eb253dbb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:13.010444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945cf8c-8284-4218-861e-6d7eb253dbb1 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:13.023329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1313/2596] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:16.659453 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c507a3-875e-4d4f-b0ba-f5cf038e45eb service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:16.742544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c507a3-875e-4d4f-b0ba-f5cf038e45eb service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:16.750598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb856fa6-d669-4331-a9b0-d1728ce77598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:16.751687 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb856fa6-d669-4331-a9b0-d1728ce77598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:16.752213 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb856fa6-d669-4331-a9b0-d1728ce77598 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:16.752676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb856fa6-d669-4331-a9b0-d1728ce77598 admin admin] PATH_INFO: `/v3/users/333ea6d3eec6407388310b5a6b42c940` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:16.755184 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb856fa6-d669-4331-a9b0-d1728ce77598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=333ea6d3eec6407388310b5a6b42c940)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:16.758540 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb856fa6-d669-4331-a9b0-d1728ce77598 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:16.767665 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:16.821502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-fb856fa6-d669-4331-a9b0-d1728ce77598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333ea6d3eec6407388310b5a6b42c940'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:16.822219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-fb856fa6-d669-4331-a9b0-d1728ce77598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333ea6d3eec6407388310b5a6b42c940'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:16.822846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-fb856fa6-d669-4331-a9b0-d1728ce77598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333ea6d3eec6407388310b5a6b42c940'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:16.836158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-fb856fa6-d669-4331-a9b0-d1728ce77598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333ea6d3eec6407388310b5a6b42c940'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:16.844566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-fb856fa6-d669-4331-a9b0-d1728ce77598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333ea6d3eec6407388310b5a6b42c940'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:16.862765 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1284/2597] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:16 2022] DELETE /identity/v3/users/333ea6d3eec6407388310b5a6b42c940 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:16.867731 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a3f2c-0bb3-4819-b2cf-78d9cc2d1bfc None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:16.868366 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a3f2c-0bb3-4819-b2cf-78d9cc2d1bfc None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:16.868366 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a3f2c-0bb3-4819-b2cf-78d9cc2d1bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:16.889930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-e89a3f2c-0bb3-4819-b2cf-78d9cc2d1bfc None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:16.891223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-e89a3f2c-0bb3-4819-b2cf-78d9cc2d1bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:16.922735 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb856fa6-d669-4331-a9b0-d1728ce77598 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:16.925109 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-fb856fa6-d669-4331-a9b0-d1728ce77598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:16.978412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1314/2598] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:16.989912 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a3f2c-0bb3-4819-b2cf-78d9cc2d1bfc None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:16.991566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-e89a3f2c-0bb3-4819-b2cf-78d9cc2d1bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:17.054596 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb856fa6-d669-4331-a9b0-d1728ce77598 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:17.060972 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d9db3-60f5-4292-bcc7-48cccdd7c2d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:17.061758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d9db3-60f5-4292-bcc7-48cccdd7c2d2 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:17.062038 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d9db3-60f5-4292-bcc7-48cccdd7c2d2 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:17.062326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d9db3-60f5-4292-bcc7-48cccdd7c2d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:17.064921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-650d9db3-60f5-4292-bcc7-48cccdd7c2d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:17.067650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a3f2c-0bb3-4819-b2cf-78d9cc2d1bfc None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:17.071577 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96ebf3-986b-46ff-8191-13a6f3c7638a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:17.072189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96ebf3-986b-46ff-8191-13a6f3c7638a service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:17.072558 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96ebf3-986b-46ff-8191-13a6f3c7638a service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:17.072731 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96ebf3-986b-46ff-8191-13a6f3c7638a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:17.078033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d9db3-60f5-4292-bcc7-48cccdd7c2d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:17.079663 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d9db3-60f5-4292-bcc7-48cccdd7c2d2 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:17.082395 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96ebf3-986b-46ff-8191-13a6f3c7638a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:17.083897 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96ebf3-986b-46ff-8191-13a6f3c7638a service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:17.093883 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1285/2599] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:17.094753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d9db3-60f5-4292-bcc7-48cccdd7c2d2 service nova] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:17.096184 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-650d9db3-60f5-4292-bcc7-48cccdd7c2d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:17.104915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1315/2600] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 00:00:17.114158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d9db3-60f5-4292-bcc7-48cccdd7c2d2 service nova] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:17.123179 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1889fb3-6c45-4aea-bba0-3c7ed82324b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:17.125398 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1889fb3-6c45-4aea-bba0-3c7ed82324b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:17.125763 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1889fb3-6c45-4aea-bba0-3c7ed82324b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:17.126405 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1889fb3-6c45-4aea-bba0-3c7ed82324b5 admin admin] PATH_INFO: `/v3/users/a3cf03bc680640b0859023f1657b3642` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:17.128179 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1889fb3-6c45-4aea-bba0-3c7ed82324b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3cf03bc680640b0859023f1657b3642)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:17.130231 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1889fb3-6c45-4aea-bba0-3c7ed82324b5 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:17.211882 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c1889fb3-6c45-4aea-bba0-3c7ed82324b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3cf03bc680640b0859023f1657b3642'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:17.212595 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c1889fb3-6c45-4aea-bba0-3c7ed82324b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3cf03bc680640b0859023f1657b3642'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:17.213306 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c1889fb3-6c45-4aea-bba0-3c7ed82324b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3cf03bc680640b0859023f1657b3642'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:17.235435 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:17.237515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c1889fb3-6c45-4aea-bba0-3c7ed82324b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3cf03bc680640b0859023f1657b3642'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:17.249787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c1889fb3-6c45-4aea-bba0-3c7ed82324b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3cf03bc680640b0859023f1657b3642'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:17.268990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1286/2601] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:17 2022] DELETE /identity/v3/users/a3cf03bc680640b0859023f1657b3642 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:17.275507 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6d249-5055-4ebb-8846-7add509f7c77 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:17.275918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6d249-5055-4ebb-8846-7add509f7c77 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:17.276204 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6d249-5055-4ebb-8846-7add509f7c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:17.300884 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-a7c6d249-5055-4ebb-8846-7add509f7c77 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:17.302326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a7c6d249-5055-4ebb-8846-7add509f7c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:17.367367 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1316/2602] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:17.377721 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1889fb3-6c45-4aea-bba0-3c7ed82324b5 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:17.379157 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c1889fb3-6c45-4aea-bba0-3c7ed82324b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:17.439071 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1889fb3-6c45-4aea-bba0-3c7ed82324b5 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:17.443054 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79268540-f7c3-4074-9714-12a9055f3333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:17.443675 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79268540-f7c3-4074-9714-12a9055f3333 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:17.443950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79268540-f7c3-4074-9714-12a9055f3333 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:17.444219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79268540-f7c3-4074-9714-12a9055f3333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:17.454140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79268540-f7c3-4074-9714-12a9055f3333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:17.455594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79268540-f7c3-4074-9714-12a9055f3333 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:17.466332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1287/2603] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:17.498696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6d249-5055-4ebb-8846-7add509f7c77 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:17.500426 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a7c6d249-5055-4ebb-8846-7add509f7c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:17.513393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6d249-5055-4ebb-8846-7add509f7c77 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:17.518440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd2544-8bc6-4766-8a77-38b97edf7aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:17.519172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd2544-8bc6-4766-8a77-38b97edf7aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:17.519528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd2544-8bc6-4766-8a77-38b97edf7aea admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:17.519805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd2544-8bc6-4766-8a77-38b97edf7aea admin admin] PATH_INFO: `/v3/projects/acaabbd3b0a04b63baa64b9e730a3492` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:17.521006 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd2544-8bc6-4766-8a77-38b97edf7aea admin admin] RBAC: Authorizing `identity:delete_project(project_id=acaabbd3b0a04b63baa64b9e730a3492)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:17.523025 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd2544-8bc6-4766-8a77-38b97edf7aea admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:17.536344 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:17.576220 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-cdbd2544-8bc6-4766-8a77-38b97edf7aea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acaabbd3b0a04b63baa64b9e730a3492', 'request_id': 'req-cdbd2544-8bc6-4766-8a77-38b97edf7aea'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:17.583879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-cdbd2544-8bc6-4766-8a77-38b97edf7aea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acaabbd3b0a04b63baa64b9e730a3492', 'request_id': 'req-cdbd2544-8bc6-4766-8a77-38b97edf7aea'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:17.590144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-cdbd2544-8bc6-4766-8a77-38b97edf7aea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acaabbd3b0a04b63baa64b9e730a3492', 'request_id': 'req-cdbd2544-8bc6-4766-8a77-38b97edf7aea'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:17.602691 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-cdbd2544-8bc6-4766-8a77-38b97edf7aea admin admin] The token cache is being invalidate because project acaabbd3b0a04b63baa64b9e730a3492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:17.602989 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-cdbd2544-8bc6-4766-8a77-38b97edf7aea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:17.603663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-cdbd2544-8bc6-4766-8a77-38b97edf7aea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:17.605197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1317/2604] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:17 2022] DELETE /identity/v3/projects/acaabbd3b0a04b63baa64b9e730a3492 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:17.610174 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f55cf-6046-4860-b490-2ee68130db9f None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:17.610457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f55cf-6046-4860-b490-2ee68130db9f None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:17.610728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f55cf-6046-4860-b490-2ee68130db9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:17.633475 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-4c6f55cf-6046-4860-b490-2ee68130db9f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:17.635389 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4c6f55cf-6046-4860-b490-2ee68130db9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:17.710681 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1288/2605] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:17.720150 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0932ab-8520-4f1a-b48f-556cb582597f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:17.720436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0932ab-8520-4f1a-b48f-556cb582597f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:17.720696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0932ab-8520-4f1a-b48f-556cb582597f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:17.744319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-ee0932ab-8520-4f1a-b48f-556cb582597f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:17.745607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ee0932ab-8520-4f1a-b48f-556cb582597f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:17.754569 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1318/2606] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:17.758937 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f55cf-6046-4860-b490-2ee68130db9f None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:17.770473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f55cf-6046-4860-b490-2ee68130db9f None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:17.779259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15ed42-1402-48e9-a5c6-536db10c4275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:17.780088 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15ed42-1402-48e9-a5c6-536db10c4275 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:17.780423 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15ed42-1402-48e9-a5c6-536db10c4275 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:17.780737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15ed42-1402-48e9-a5c6-536db10c4275 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:17.781511 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15ed42-1402-48e9-a5c6-536db10c4275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 00:00:17.781856 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15ed42-1402-48e9-a5c6-536db10c4275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:17.783573 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15ed42-1402-48e9-a5c6-536db10c4275 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:17.789612 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0932ab-8520-4f1a-b48f-556cb582597f None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:17.793035 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ee0932ab-8520-4f1a-b48f-556cb582597f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:17.821964 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0932ab-8520-4f1a-b48f-556cb582597f None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:17.821964 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d9746-5b6f-4f20-9d83-4b1140203d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:17.821964 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d9746-5b6f-4f20-9d83-4b1140203d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:17.821964 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d9746-5b6f-4f20-9d83-4b1140203d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:17.822428 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d9746-5b6f-4f20-9d83-4b1140203d61 admin admin] PATH_INFO: `/v3/projects/891a33d0a7f64e6ba671d29f89e44238` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:17.822519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1289/2607] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Sep 13 00:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 00:00:17.828268 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15ed42-1402-48e9-a5c6-536db10c4275 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:17.828441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d9746-5b6f-4f20-9d83-4b1140203d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=891a33d0a7f64e6ba671d29f89e44238)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:17.828441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d9746-5b6f-4f20-9d83-4b1140203d61 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:17.835105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15ed42-1402-48e9-a5c6-536db10c4275 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:17.839868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106b887-a133-4447-8b34-9b3bb7a795eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:17.840517 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b887-a133-4447-8b34-9b3bb7a795eb admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:17.840885 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b887-a133-4447-8b34-9b3bb7a795eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:17.841245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b887-a133-4447-8b34-9b3bb7a795eb admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:17.841993 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106b887-a133-4447-8b34-9b3bb7a795eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:17.844042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106b887-a133-4447-8b34-9b3bb7a795eb admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:17.873495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1290/2608] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:17 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:00:17.876692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4f5d9746-5b6f-4f20-9d83-4b1140203d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891a33d0a7f64e6ba671d29f89e44238', 'request_id': 'req-4f5d9746-5b6f-4f20-9d83-4b1140203d61'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:17.878532 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106b887-a133-4447-8b34-9b3bb7a795eb admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:17.885400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4f5d9746-5b6f-4f20-9d83-4b1140203d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891a33d0a7f64e6ba671d29f89e44238', 'request_id': 'req-4f5d9746-5b6f-4f20-9d83-4b1140203d61'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:17.891588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4f5d9746-5b6f-4f20-9d83-4b1140203d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891a33d0a7f64e6ba671d29f89e44238', 'request_id': 'req-4f5d9746-5b6f-4f20-9d83-4b1140203d61'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:17.903256 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4f5d9746-5b6f-4f20-9d83-4b1140203d61 admin admin] The token cache is being invalidate because project 891a33d0a7f64e6ba671d29f89e44238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:17.903545 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4f5d9746-5b6f-4f20-9d83-4b1140203d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:17.904229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4f5d9746-5b6f-4f20-9d83-4b1140203d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:17.905957 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1319/2609] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:17 2022] DELETE /identity/v3/projects/891a33d0a7f64e6ba671d29f89e44238 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:17.909906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d9746-5b6f-4f20-9d83-4b1140203d61 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:17.911241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4f5d9746-5b6f-4f20-9d83-4b1140203d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:17.929046 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:17.943718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106b887-a133-4447-8b34-9b3bb7a795eb admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:17.949286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a2404-c143-43e0-a41d-a0c5178b49cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:17.949951 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a2404-c143-43e0-a41d-a0c5178b49cc admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:17.950473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a2404-c143-43e0-a41d-a0c5178b49cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:17.950743 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a2404-c143-43e0-a41d-a0c5178b49cc admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:17.951364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a2404-c143-43e0-a41d-a0c5178b49cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:17.953564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a2404-c143-43e0-a41d-a0c5178b49cc admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:17.978695 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1291/2610] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:17 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:00:17.979798 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a2404-c143-43e0-a41d-a0c5178b49cc admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:17.980832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d9746-5b6f-4f20-9d83-4b1140203d61 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:17.981531 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-088a2404-c143-43e0-a41d-a0c5178b49cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:17.985867 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f7286-92c8-4812-a203-d30f64df8233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:17.986513 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f7286-92c8-4812-a203-d30f64df8233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:17.986793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f7286-92c8-4812-a203-d30f64df8233 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:17.987065 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f7286-92c8-4812-a203-d30f64df8233 admin admin] PATH_INFO: `/v3/users/22d7ba1eead94e249445e54be9d1ead7` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:17.988203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f7286-92c8-4812-a203-d30f64df8233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d7ba1eead94e249445e54be9d1ead7)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:17.990166 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f7286-92c8-4812-a203-d30f64df8233 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:17.993874 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a2404-c143-43e0-a41d-a0c5178b49cc admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:17.999523 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf84161-22cc-4b39-8962-08a024d72074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:18.000115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf84161-22cc-4b39-8962-08a024d72074 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:18.000393 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf84161-22cc-4b39-8962-08a024d72074 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:18.000668 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf84161-22cc-4b39-8962-08a024d72074 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:18.001313 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf84161-22cc-4b39-8962-08a024d72074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:18.002972 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf84161-22cc-4b39-8962-08a024d72074 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:18.007773 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:18.014958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1292/2611] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:18.019109 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf84161-22cc-4b39-8962-08a024d72074 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:18.030784 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf84161-22cc-4b39-8962-08a024d72074 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:18.035424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00effc6f-f30a-4618-8134-eaee94bdf123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:18.036018 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00effc6f-f30a-4618-8134-eaee94bdf123 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:18.036290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00effc6f-f30a-4618-8134-eaee94bdf123 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:18.036556 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00effc6f-f30a-4618-8134-eaee94bdf123 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:18.037191 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00effc6f-f30a-4618-8134-eaee94bdf123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:18.038819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00effc6f-f30a-4618-8134-eaee94bdf123 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:18.043367 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e32f7286-92c8-4812-a203-d30f64df8233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d7ba1eead94e249445e54be9d1ead7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:18.050063 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1293/2612] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:18.051250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e32f7286-92c8-4812-a203-d30f64df8233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d7ba1eead94e249445e54be9d1ead7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:18.054443 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00effc6f-f30a-4618-8134-eaee94bdf123 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:18.063983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00effc6f-f30a-4618-8134-eaee94bdf123 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:18.064653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e32f7286-92c8-4812-a203-d30f64df8233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d7ba1eead94e249445e54be9d1ead7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:18.068711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72b0dc-a3bd-4ff5-8583-107f8e63a7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:18.069380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72b0dc-a3bd-4ff5-8583-107f8e63a7f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:18.069715 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72b0dc-a3bd-4ff5-8583-107f8e63a7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:18.070030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72b0dc-a3bd-4ff5-8583-107f8e63a7f3 admin admin] PATH_INFO: `/v3/projects/c24b8584fe6242f5b28202e030618f3c/users/b780f2abcf96473c88d3d36f5a87544c/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:18.073233 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e32f7286-92c8-4812-a203-d30f64df8233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d7ba1eead94e249445e54be9d1ead7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:18.073979 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-e32f7286-92c8-4812-a203-d30f64df8233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d7ba1eead94e249445e54be9d1ead7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:18.080426 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1320/2613] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:17 2022] DELETE /identity/v3/users/22d7ba1eead94e249445e54be9d1ead7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:18.085706 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72b0dc-a3bd-4ff5-8583-107f8e63a7f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24b8584fe6242f5b28202e030618f3c, user_id=b780f2abcf96473c88d3d36f5a87544c, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:18.088524 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72b0dc-a3bd-4ff5-8583-107f8e63a7f3 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:18.105418 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1294/2614] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:18 2022] PUT /identity/v3/projects/c24b8584fe6242f5b28202e030618f3c/users/b780f2abcf96473c88d3d36f5a87544c/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:18.116598 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91904f45-9248-4a38-ad72-04c1eddbae18 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:18.116598 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91904f45-9248-4a38-ad72-04c1eddbae18 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:18.116598 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91904f45-9248-4a38-ad72-04c1eddbae18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:18.146136 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-91904f45-9248-4a38-ad72-04c1eddbae18 None None] MFA Rules not processed for user `b780f2abcf96473c88d3d36f5a87544c`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:18.147354 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-91904f45-9248-4a38-ad72-04c1eddbae18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:18.215155 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1321/2615] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:18 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:18.219861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72b0dc-a3bd-4ff5-8583-107f8e63a7f3 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:18.221803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0f72b0dc-a3bd-4ff5-8583-107f8e63a7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:18.301390 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72b0dc-a3bd-4ff5-8583-107f8e63a7f3 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:18.307381 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417299f2-f9ee-4a0d-94b3-0f4a204624e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:18.308004 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417299f2-f9ee-4a0d-94b3-0f4a204624e2 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:18.308282 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417299f2-f9ee-4a0d-94b3-0f4a204624e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:18.308550 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417299f2-f9ee-4a0d-94b3-0f4a204624e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:18.309184 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417299f2-f9ee-4a0d-94b3-0f4a204624e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:18.311576 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417299f2-f9ee-4a0d-94b3-0f4a204624e2 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:18.344208 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1295/2616] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:18 2022] POST /identity/v3/projects => generated 403 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:00:18.348524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91904f45-9248-4a38-ad72-04c1eddbae18 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:18.364667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91904f45-9248-4a38-ad72-04c1eddbae18 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:18.389956 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417299f2-f9ee-4a0d-94b3-0f4a204624e2 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:18.392447 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-417299f2-f9ee-4a0d-94b3-0f4a204624e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:18.483681 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417299f2-f9ee-4a0d-94b3-0f4a204624e2 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:18.488422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe13c4-c3aa-41d1-bca3-b91b30c59010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:18.489181 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe13c4-c3aa-41d1-bca3-b91b30c59010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:18.489504 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe13c4-c3aa-41d1-bca3-b91b30c59010 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:18.490386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe13c4-c3aa-41d1-bca3-b91b30c59010 admin admin] PATH_INFO: `/v3/projects/60366076112647259f7b93a91b856eea` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:18.490514 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19344a-3145-43a4-ac51-6632b35484f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:18.490826 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19344a-3145-43a4-ac51-6632b35484f4 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:18.491094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19344a-3145-43a4-ac51-6632b35484f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:18.491315 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe13c4-c3aa-41d1-bca3-b91b30c59010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60366076112647259f7b93a91b856eea)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:18.491441 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19344a-3145-43a4-ac51-6632b35484f4 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:18.491981 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19344a-3145-43a4-ac51-6632b35484f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:18.493678 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe13c4-c3aa-41d1-bca3-b91b30c59010 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:18.494010 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19344a-3145-43a4-ac51-6632b35484f4 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:18.519361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:18.519962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1322/2617] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:18 2022] POST /identity/v3/users => generated 308 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:18.524158 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19344a-3145-43a4-ac51-6632b35484f4 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:18.535304 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19344a-3145-43a4-ac51-6632b35484f4 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:18.540787 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d0345-5417-4bfe-a850-b6858a45ded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:18.541831 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d0345-5417-4bfe-a850-b6858a45ded6 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:18.542157 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d0345-5417-4bfe-a850-b6858a45ded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:18.542468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d0345-5417-4bfe-a850-b6858a45ded6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:18.543077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d0345-5417-4bfe-a850-b6858a45ded6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:18.545126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d0345-5417-4bfe-a850-b6858a45ded6 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:18.556728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-fafe13c4-c3aa-41d1-bca3-b91b30c59010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60366076112647259f7b93a91b856eea', 'request_id': 'req-fafe13c4-c3aa-41d1-bca3-b91b30c59010'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:18.557708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1323/2618] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:18.561538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d0345-5417-4bfe-a850-b6858a45ded6 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:18.564267 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-fafe13c4-c3aa-41d1-bca3-b91b30c59010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60366076112647259f7b93a91b856eea', 'request_id': 'req-fafe13c4-c3aa-41d1-bca3-b91b30c59010'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:18.567203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:18.572545 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d0345-5417-4bfe-a850-b6858a45ded6 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:18.573971 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-fafe13c4-c3aa-41d1-bca3-b91b30c59010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60366076112647259f7b93a91b856eea', 'request_id': 'req-fafe13c4-c3aa-41d1-bca3-b91b30c59010'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:18.586683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-fafe13c4-c3aa-41d1-bca3-b91b30c59010 admin admin] The token cache is being invalidate because project 60366076112647259f7b93a91b856eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:18.586979 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-fafe13c4-c3aa-41d1-bca3-b91b30c59010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:18.587649 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-fafe13c4-c3aa-41d1-bca3-b91b30c59010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:18.589479 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1296/2619] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:18 2022] DELETE /identity/v3/projects/60366076112647259f7b93a91b856eea => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:18.593309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe13c4-c3aa-41d1-bca3-b91b30c59010 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:18.594762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-fafe13c4-c3aa-41d1-bca3-b91b30c59010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:18.650949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0e83d-be8f-4879-8aa5-fce3cfb1c107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:18.651660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0e83d-be8f-4879-8aa5-fce3cfb1c107 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:18.651984 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0e83d-be8f-4879-8aa5-fce3cfb1c107 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:18.652265 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0e83d-be8f-4879-8aa5-fce3cfb1c107 admin admin] PATH_INFO: `/v3/projects/824d67426b104122be5d64402c5ca836/users/7ccc5dbef34e4c02bade73e96d6508c0/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:18.669140 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0e83d-be8f-4879-8aa5-fce3cfb1c107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=824d67426b104122be5d64402c5ca836, user_id=7ccc5dbef34e4c02bade73e96d6508c0, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:18.672242 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0e83d-be8f-4879-8aa5-fce3cfb1c107 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:18.682952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe13c4-c3aa-41d1-bca3-b91b30c59010 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:18.682952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93556fc8-3650-4b12-a510-d2e520473625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:18.683652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93556fc8-3650-4b12-a510-d2e520473625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:18.683911 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93556fc8-3650-4b12-a510-d2e520473625 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:18.684375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93556fc8-3650-4b12-a510-d2e520473625 admin admin] PATH_INFO: `/v3/users/ec814614788942df8876b5309d5df019` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:18.685643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93556fc8-3650-4b12-a510-d2e520473625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec814614788942df8876b5309d5df019)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:18.687645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93556fc8-3650-4b12-a510-d2e520473625 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:18.693505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1324/2620] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:18 2022] PUT /identity/v3/projects/824d67426b104122be5d64402c5ca836/users/7ccc5dbef34e4c02bade73e96d6508c0/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:18.697307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0e83d-be8f-4879-8aa5-fce3cfb1c107 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:18.699222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-42d0e83d-be8f-4879-8aa5-fce3cfb1c107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:18.749637 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-93556fc8-3650-4b12-a510-d2e520473625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec814614788942df8876b5309d5df019'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:18.750303 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-93556fc8-3650-4b12-a510-d2e520473625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec814614788942df8876b5309d5df019'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:18.750909 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-93556fc8-3650-4b12-a510-d2e520473625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec814614788942df8876b5309d5df019'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:18.763539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-93556fc8-3650-4b12-a510-d2e520473625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec814614788942df8876b5309d5df019'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:18.771412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-93556fc8-3650-4b12-a510-d2e520473625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec814614788942df8876b5309d5df019'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:18.773882 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0e83d-be8f-4879-8aa5-fce3cfb1c107 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:18.779416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adeb935-8232-457e-84b4-3a43524986f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:18.779696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeb935-8232-457e-84b4-3a43524986f2 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:18.779986 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeb935-8232-457e-84b4-3a43524986f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:18.780310 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeb935-8232-457e-84b4-3a43524986f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:18.781011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adeb935-8232-457e-84b4-3a43524986f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:18.782783 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adeb935-8232-457e-84b4-3a43524986f2 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:18.787042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1297/2621] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:18 2022] DELETE /identity/v3/users/ec814614788942df8876b5309d5df019 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:18.796572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1325/2622] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:18.801822 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93556fc8-3650-4b12-a510-d2e520473625 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:18.804730 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-93556fc8-3650-4b12-a510-d2e520473625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:18.845406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:18.892913 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93556fc8-3650-4b12-a510-d2e520473625 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:18.897677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156609b0-c8a0-46e1-b959-49bab8687d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:18.898351 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156609b0-c8a0-46e1-b959-49bab8687d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:18.898625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156609b0-c8a0-46e1-b959-49bab8687d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:18.898906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156609b0-c8a0-46e1-b959-49bab8687d9b admin admin] PATH_INFO: `/v3/projects/824d67426b104122be5d64402c5ca836/users/7ccc5dbef34e4c02bade73e96d6508c0/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:18.901070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156609b0-c8a0-46e1-b959-49bab8687d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=824d67426b104122be5d64402c5ca836, user_id=7ccc5dbef34e4c02bade73e96d6508c0, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:18.903864 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156609b0-c8a0-46e1-b959-49bab8687d9b admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:18.916550 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1298/2623] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:18 2022] PUT /identity/v3/projects/824d67426b104122be5d64402c5ca836/users/7ccc5dbef34e4c02bade73e96d6508c0/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:18.927568 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc51b5-423b-4f4c-83ed-98b9ce8dd477 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:18.928140 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc51b5-423b-4f4c-83ed-98b9ce8dd477 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:18.928140 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc51b5-423b-4f4c-83ed-98b9ce8dd477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:18.959762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-70cc51b5-423b-4f4c-83ed-98b9ce8dd477 None None] MFA Rules not processed for user `7ccc5dbef34e4c02bade73e96d6508c0`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:18.960935 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-70cc51b5-423b-4f4c-83ed-98b9ce8dd477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:19.038315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1326/2624] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:18 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:19.055130 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156609b0-c8a0-46e1-b959-49bab8687d9b admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:19.057447 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-156609b0-c8a0-46e1-b959-49bab8687d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:19.140472 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156609b0-c8a0-46e1-b959-49bab8687d9b admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:19.144746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77156f5-53cb-41ac-8bf8-84c271639d66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:19.146101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77156f5-53cb-41ac-8bf8-84c271639d66 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:19.146396 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77156f5-53cb-41ac-8bf8-84c271639d66 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:19.146671 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77156f5-53cb-41ac-8bf8-84c271639d66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:19.158998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77156f5-53cb-41ac-8bf8-84c271639d66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:19.160493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77156f5-53cb-41ac-8bf8-84c271639d66 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:19.173387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1299/2625] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:19 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:19.214151 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc51b5-423b-4f4c-83ed-98b9ce8dd477 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:19.215671 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-70cc51b5-423b-4f4c-83ed-98b9ce8dd477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:19.228660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:19.326801 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc51b5-423b-4f4c-83ed-98b9ce8dd477 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:19.332930 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c8d19-b570-4bad-853e-dec86fb333ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:19.333825 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c8d19-b570-4bad-853e-dec86fb333ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:19.334527 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c8d19-b570-4bad-853e-dec86fb333ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:19.334807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c8d19-b570-4bad-853e-dec86fb333ef admin admin] PATH_INFO: `/v3/projects/faaf35162e64475ba921b0c391439aa9` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:19.336172 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c8d19-b570-4bad-853e-dec86fb333ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=faaf35162e64475ba921b0c391439aa9)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:19.341980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c8d19-b570-4bad-853e-dec86fb333ef admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:19.347129 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77156f5-53cb-41ac-8bf8-84c271639d66 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:19.359480 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77156f5-53cb-41ac-8bf8-84c271639d66 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:19.364483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa4c97-f94e-4fe2-9adb-88848fdcce13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:19.365115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa4c97-f94e-4fe2-9adb-88848fdcce13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:19.365413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa4c97-f94e-4fe2-9adb-88848fdcce13 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:19.365977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa4c97-f94e-4fe2-9adb-88848fdcce13 admin admin] PATH_INFO: `/v3/users/b780f2abcf96473c88d3d36f5a87544c` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:19.366799 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa4c97-f94e-4fe2-9adb-88848fdcce13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b780f2abcf96473c88d3d36f5a87544c)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:19.368714 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa4c97-f94e-4fe2-9adb-88848fdcce13 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:19.395259 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d43c8d19-b570-4bad-853e-dec86fb333ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faaf35162e64475ba921b0c391439aa9', 'request_id': 'req-d43c8d19-b570-4bad-853e-dec86fb333ef'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:19.405879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d43c8d19-b570-4bad-853e-dec86fb333ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faaf35162e64475ba921b0c391439aa9', 'request_id': 'req-d43c8d19-b570-4bad-853e-dec86fb333ef'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:19.413559 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d43c8d19-b570-4bad-853e-dec86fb333ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faaf35162e64475ba921b0c391439aa9', 'request_id': 'req-d43c8d19-b570-4bad-853e-dec86fb333ef'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:19.427075 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d43c8d19-b570-4bad-853e-dec86fb333ef admin admin] The token cache is being invalidate because project faaf35162e64475ba921b0c391439aa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:19.427459 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d43c8d19-b570-4bad-853e-dec86fb333ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:19.428234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d43c8d19-b570-4bad-853e-dec86fb333ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:19.430044 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-13fa4c97-f94e-4fe2-9adb-88848fdcce13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b780f2abcf96473c88d3d36f5a87544c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:19.430685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-13fa4c97-f94e-4fe2-9adb-88848fdcce13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b780f2abcf96473c88d3d36f5a87544c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:19.431283 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-13fa4c97-f94e-4fe2-9adb-88848fdcce13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b780f2abcf96473c88d3d36f5a87544c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:19.438838 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1327/2626] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:19 2022] DELETE /identity/v3/projects/faaf35162e64475ba921b0c391439aa9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:19.440288 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4590865-06b0-49f9-ab69-cadecb722ba6 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:19.440581 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4590865-06b0-49f9-ab69-cadecb722ba6 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:19.440853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4590865-06b0-49f9-ab69-cadecb722ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:19.444679 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-13fa4c97-f94e-4fe2-9adb-88848fdcce13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b780f2abcf96473c88d3d36f5a87544c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:19.451812 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-13fa4c97-f94e-4fe2-9adb-88848fdcce13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b780f2abcf96473c88d3d36f5a87544c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:19.461934 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-a4590865-06b0-49f9-ab69-cadecb722ba6 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:19.463318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a4590865-06b0-49f9-ab69-cadecb722ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:19.470191 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1300/2627] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:19 2022] DELETE /identity/v3/users/b780f2abcf96473c88d3d36f5a87544c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:19.474431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9433d99-1ed1-4789-a571-407500ec5d43 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:19.474716 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9433d99-1ed1-4789-a571-407500ec5d43 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:19.474978 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9433d99-1ed1-4789-a571-407500ec5d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:19.496967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-c9433d99-1ed1-4789-a571-407500ec5d43 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:19.498106 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c9433d99-1ed1-4789-a571-407500ec5d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:19.536831 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:19.540818 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1328/2628] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:19.550551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ac7ad-030e-4eab-9f9a-637661f815b5 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:19.550911 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ac7ad-030e-4eab-9f9a-637661f815b5 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:19.551636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ac7ad-030e-4eab-9f9a-637661f815b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:19.575497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-9d3ac7ad-030e-4eab-9f9a-637661f815b5 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:19.576960 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9d3ac7ad-030e-4eab-9f9a-637661f815b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:19.585912 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1301/2629] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:19.594562 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1329/2630] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:19.595786 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9433d99-1ed1-4789-a571-407500ec5d43 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:19.602116 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ac7ad-030e-4eab-9f9a-637661f815b5 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:19.604350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9d3ac7ad-030e-4eab-9f9a-637661f815b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:19.606542 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9433d99-1ed1-4789-a571-407500ec5d43 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:19.614742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce10214-fdd5-4232-a79b-423b669eaf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:19.615369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce10214-fdd5-4232-a79b-423b669eaf78 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:19.615648 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce10214-fdd5-4232-a79b-423b669eaf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:19.615921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce10214-fdd5-4232-a79b-423b669eaf78 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:19.616584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce10214-fdd5-4232-a79b-423b669eaf78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 00:00:19.616888 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce10214-fdd5-4232-a79b-423b669eaf78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:19.618552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce10214-fdd5-4232-a79b-423b669eaf78 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:19.632553 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1302/2631] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Sep 13 00:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 00:00:19.637168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce10214-fdd5-4232-a79b-423b669eaf78 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:19.646813 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:19.651131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce10214-fdd5-4232-a79b-423b669eaf78 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:19.657673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f36ea9-4f7c-46ee-a385-b065840af705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:19.658366 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f36ea9-4f7c-46ee-a385-b065840af705 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:19.658677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f36ea9-4f7c-46ee-a385-b065840af705 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:19.659194 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f36ea9-4f7c-46ee-a385-b065840af705 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:19.659591 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f36ea9-4f7c-46ee-a385-b065840af705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:19.662278 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f36ea9-4f7c-46ee-a385-b065840af705 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:19.673972 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ac7ad-030e-4eab-9f9a-637661f815b5 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:19.678219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f203335-eea8-4356-8e8b-fb9c8619248c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:19.678842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f203335-eea8-4356-8e8b-fb9c8619248c service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:19.679124 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f203335-eea8-4356-8e8b-fb9c8619248c service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:19.679394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f203335-eea8-4356-8e8b-fb9c8619248c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:19.690009 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f203335-eea8-4356-8e8b-fb9c8619248c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:19.691473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f203335-eea8-4356-8e8b-fb9c8619248c service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:19.697976 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1303/2632] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:19 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:19.700053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f36ea9-4f7c-46ee-a385-b065840af705 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:19.703225 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1330/2633] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:19.774605 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f36ea9-4f7c-46ee-a385-b065840af705 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:19.782460 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbedd43-c0ca-420c-855d-acd80d32e5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:19.783198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbedd43-c0ca-420c-855d-acd80d32e5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:19.783484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbedd43-c0ca-420c-855d-acd80d32e5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:19.783773 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbedd43-c0ca-420c-855d-acd80d32e5c4 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:19.784484 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbedd43-c0ca-420c-855d-acd80d32e5c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:19.787377 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbedd43-c0ca-420c-855d-acd80d32e5c4 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:19.815478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1304/2634] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:19 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:00:19.819878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f203335-eea8-4356-8e8b-fb9c8619248c service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:19.836204 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f203335-eea8-4356-8e8b-fb9c8619248c service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:19.844033 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed0b93-1be5-4e6f-accd-06fa9a75ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:19.844849 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed0b93-1be5-4e6f-accd-06fa9a75ea84 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:19.845236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed0b93-1be5-4e6f-accd-06fa9a75ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:19.845792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed0b93-1be5-4e6f-accd-06fa9a75ea84 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:19.846978 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed0b93-1be5-4e6f-accd-06fa9a75ea84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:19.850834 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed0b93-1be5-4e6f-accd-06fa9a75ea84 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:19.874966 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1331/2635] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:19.878967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbedd43-c0ca-420c-855d-acd80d32e5c4 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:19.892453 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbedd43-c0ca-420c-855d-acd80d32e5c4 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:19.903654 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17108de3-2827-47e5-b12d-837db4851ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:19.904304 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17108de3-2827-47e5-b12d-837db4851ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:19.904584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17108de3-2827-47e5-b12d-837db4851ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:19.905175 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17108de3-2827-47e5-b12d-837db4851ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:19.905990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17108de3-2827-47e5-b12d-837db4851ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:19.907651 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17108de3-2827-47e5-b12d-837db4851ec3 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:19.922879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1305/2636] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:19.924562 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed0b93-1be5-4e6f-accd-06fa9a75ea84 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:19.938702 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed0b93-1be5-4e6f-accd-06fa9a75ea84 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:19.947288 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5d0ee-ad25-42b5-80ed-fe78e9535729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:19.948145 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5d0ee-ad25-42b5-80ed-fe78e9535729 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:19.948643 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5d0ee-ad25-42b5-80ed-fe78e9535729 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:19.948919 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5d0ee-ad25-42b5-80ed-fe78e9535729 admin admin] PATH_INFO: `/v3/projects/1448bddb4d6641738ea97127c9cc8927/users/92b7592905c347b59192f080bfde0243/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:19.978878 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5d0ee-ad25-42b5-80ed-fe78e9535729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1448bddb4d6641738ea97127c9cc8927, user_id=92b7592905c347b59192f080bfde0243, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:19.984980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5d0ee-ad25-42b5-80ed-fe78e9535729 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:20.006152 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1332/2637] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:19 2022] PUT /identity/v3/projects/1448bddb4d6641738ea97127c9cc8927/users/92b7592905c347b59192f080bfde0243/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:20.091723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17108de3-2827-47e5-b12d-837db4851ec3 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:20.094445 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-17108de3-2827-47e5-b12d-837db4851ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:20.099389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4a3c8-d797-4ad6-b528-341fe88c7f30 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:20.099696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4a3c8-d797-4ad6-b528-341fe88c7f30 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:20.100084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4a3c8-d797-4ad6-b528-341fe88c7f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:20.128173 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17108de3-2827-47e5-b12d-837db4851ec3 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:20.164662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-dbd4a3c8-d797-4ad6-b528-341fe88c7f30 None None] MFA Rules not processed for user `92b7592905c347b59192f080bfde0243`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:20.165953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-dbd4a3c8-d797-4ad6-b528-341fe88c7f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:20.258635 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3885d-d0f8-44ba-bb44-8df6333e19a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:20.258635 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3885d-d0f8-44ba-bb44-8df6333e19a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:20.258635 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3885d-d0f8-44ba-bb44-8df6333e19a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:20.258635 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3885d-d0f8-44ba-bb44-8df6333e19a7 admin admin] PATH_INFO: `/v3/projects/c24b8584fe6242f5b28202e030618f3c` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:20.259299 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3885d-d0f8-44ba-bb44-8df6333e19a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c24b8584fe6242f5b28202e030618f3c)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:20.260160 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3885d-d0f8-44ba-bb44-8df6333e19a7 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:20.271987 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1333/2638] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:20.286453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4a3c8-d797-4ad6-b528-341fe88c7f30 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:20.288311 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-dbd4a3c8-d797-4ad6-b528-341fe88c7f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:20.318792 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:20.352802 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-36e3885d-d0f8-44ba-bb44-8df6333e19a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24b8584fe6242f5b28202e030618f3c', 'request_id': 'req-36e3885d-d0f8-44ba-bb44-8df6333e19a7'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:20.358988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-36e3885d-d0f8-44ba-bb44-8df6333e19a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24b8584fe6242f5b28202e030618f3c', 'request_id': 'req-36e3885d-d0f8-44ba-bb44-8df6333e19a7'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:20.360954 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4a3c8-d797-4ad6-b528-341fe88c7f30 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:20.368617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-36e3885d-d0f8-44ba-bb44-8df6333e19a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24b8584fe6242f5b28202e030618f3c', 'request_id': 'req-36e3885d-d0f8-44ba-bb44-8df6333e19a7'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:20.381175 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-36e3885d-d0f8-44ba-bb44-8df6333e19a7 admin admin] The token cache is being invalidate because project c24b8584fe6242f5b28202e030618f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:20.381519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-36e3885d-d0f8-44ba-bb44-8df6333e19a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:20.382200 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-36e3885d-d0f8-44ba-bb44-8df6333e19a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:20.383715 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1306/2639] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:20 2022] DELETE /identity/v3/projects/c24b8584fe6242f5b28202e030618f3c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:20.387793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3885d-d0f8-44ba-bb44-8df6333e19a7 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:20.389949 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-36e3885d-d0f8-44ba-bb44-8df6333e19a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:20.424146 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:20.438649 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e648a2-1869-4626-bcb9-fe69072d2b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:20.439284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e648a2-1869-4626-bcb9-fe69072d2b2a service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:20.439556 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e648a2-1869-4626-bcb9-fe69072d2b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:20.439841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e648a2-1869-4626-bcb9-fe69072d2b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:20.441698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-10e648a2-1869-4626-bcb9-fe69072d2b2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:20.474716 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3885d-d0f8-44ba-bb44-8df6333e19a7 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:20.479771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b16e0c-700c-4496-aefe-32a2460d9572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:20.480411 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b16e0c-700c-4496-aefe-32a2460d9572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:20.480690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b16e0c-700c-4496-aefe-32a2460d9572 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:20.480964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b16e0c-700c-4496-aefe-32a2460d9572 admin admin] PATH_INFO: `/v3/users/7ccc5dbef34e4c02bade73e96d6508c0` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:20.482152 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b16e0c-700c-4496-aefe-32a2460d9572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ccc5dbef34e4c02bade73e96d6508c0)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:20.484223 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b16e0c-700c-4496-aefe-32a2460d9572 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:20.513135 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e648a2-1869-4626-bcb9-fe69072d2b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:20.514776 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e648a2-1869-4626-bcb9-fe69072d2b2a service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:20.524675 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1334/2640] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 00:00:20.536337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-49b16e0c-700c-4496-aefe-32a2460d9572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ccc5dbef34e4c02bade73e96d6508c0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:20.536957 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-49b16e0c-700c-4496-aefe-32a2460d9572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ccc5dbef34e4c02bade73e96d6508c0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:20.538005 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-49b16e0c-700c-4496-aefe-32a2460d9572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ccc5dbef34e4c02bade73e96d6508c0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:20.551987 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-49b16e0c-700c-4496-aefe-32a2460d9572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ccc5dbef34e4c02bade73e96d6508c0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:20.559072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-49b16e0c-700c-4496-aefe-32a2460d9572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ccc5dbef34e4c02bade73e96d6508c0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:20.576416 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1307/2641] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:20 2022] DELETE /identity/v3/users/7ccc5dbef34e4c02bade73e96d6508c0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:20.916289 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e648a2-1869-4626-bcb9-fe69072d2b2a service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:20.928468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e648a2-1869-4626-bcb9-fe69072d2b2a service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:20.999708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b0f7a-ca96-4708-9ce4-39f4554dde36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:21.000477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b0f7a-ca96-4708-9ce4-39f4554dde36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:21.000622 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b0f7a-ca96-4708-9ce4-39f4554dde36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:21.000872 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b0f7a-ca96-4708-9ce4-39f4554dde36 admin admin] PATH_INFO: `/v3/projects/824d67426b104122be5d64402c5ca836` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:21.002062 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b0f7a-ca96-4708-9ce4-39f4554dde36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=824d67426b104122be5d64402c5ca836)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:21.003963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b0f7a-ca96-4708-9ce4-39f4554dde36 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:21.055252 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f77b0f7a-ca96-4708-9ce4-39f4554dde36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824d67426b104122be5d64402c5ca836', 'request_id': 'req-f77b0f7a-ca96-4708-9ce4-39f4554dde36'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:21.065584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f77b0f7a-ca96-4708-9ce4-39f4554dde36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824d67426b104122be5d64402c5ca836', 'request_id': 'req-f77b0f7a-ca96-4708-9ce4-39f4554dde36'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:21.074847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f77b0f7a-ca96-4708-9ce4-39f4554dde36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824d67426b104122be5d64402c5ca836', 'request_id': 'req-f77b0f7a-ca96-4708-9ce4-39f4554dde36'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:21.089103 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f77b0f7a-ca96-4708-9ce4-39f4554dde36 admin admin] The token cache is being invalidate because project 824d67426b104122be5d64402c5ca836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:21.089562 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f77b0f7a-ca96-4708-9ce4-39f4554dde36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:21.090404 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f77b0f7a-ca96-4708-9ce4-39f4554dde36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:21.092071 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1335/2642] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:20 2022] DELETE /identity/v3/projects/824d67426b104122be5d64402c5ca836 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:21.098407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2145e1e-77c1-4cc1-b5f4-a84f4836d401 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:21.098962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2145e1e-77c1-4cc1-b5f4-a84f4836d401 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:21.099477 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2145e1e-77c1-4cc1-b5f4-a84f4836d401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:21.126803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-f2145e1e-77c1-4cc1-b5f4-a84f4836d401 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:21.128091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f2145e1e-77c1-4cc1-b5f4-a84f4836d401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:21.156972 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:21.203257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1308/2643] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:21.211531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8a5f0-b3b8-4c79-af0a-e4c1f1455e62 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:21.211814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8a5f0-b3b8-4c79-af0a-e4c1f1455e62 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:21.212085 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8a5f0-b3b8-4c79-af0a-e4c1f1455e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:21.234650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-9ca8a5f0-b3b8-4c79-af0a-e4c1f1455e62 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:21.235918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-9ca8a5f0-b3b8-4c79-af0a-e4c1f1455e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:21.245319 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1336/2644] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:21.256477 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2145e1e-77c1-4cc1-b5f4-a84f4836d401 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:21.269612 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2145e1e-77c1-4cc1-b5f4-a84f4836d401 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:21.274753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74738a-b582-41ee-aff5-5c58ebfd0381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:21.275442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74738a-b582-41ee-aff5-5c58ebfd0381 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:21.275782 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74738a-b582-41ee-aff5-5c58ebfd0381 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:21.276131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74738a-b582-41ee-aff5-5c58ebfd0381 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:21.276822 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74738a-b582-41ee-aff5-5c58ebfd0381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 00:00:21.277120 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74738a-b582-41ee-aff5-5c58ebfd0381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:21.281031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74738a-b582-41ee-aff5-5c58ebfd0381 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:21.295335 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1309/2645] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Sep 13 00:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 00:00:21.300329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8a5f0-b3b8-4c79-af0a-e4c1f1455e62 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:21.309876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8a5f0-b3b8-4c79-af0a-e4c1f1455e62 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:21.314710 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb3c73-9139-4214-bcd9-1ad4c41ead90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:21.315330 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb3c73-9139-4214-bcd9-1ad4c41ead90 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:21.315610 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb3c73-9139-4214-bcd9-1ad4c41ead90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:21.315947 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb3c73-9139-4214-bcd9-1ad4c41ead90 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:21.316618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb3c73-9139-4214-bcd9-1ad4c41ead90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:21.318812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb3c73-9139-4214-bcd9-1ad4c41ead90 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:21.354916 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:21.369154 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1337/2646] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:21 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:21.370112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74738a-b582-41ee-aff5-5c58ebfd0381 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:21.386905 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74738a-b582-41ee-aff5-5c58ebfd0381 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:21.477475 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278962f-e8c8-4b43-8154-7ca29f45cef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:21.478119 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278962f-e8c8-4b43-8154-7ca29f45cef7 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:21.478561 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278962f-e8c8-4b43-8154-7ca29f45cef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:21.478988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278962f-e8c8-4b43-8154-7ca29f45cef7 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:21.480126 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278962f-e8c8-4b43-8154-7ca29f45cef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:21.481878 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278962f-e8c8-4b43-8154-7ca29f45cef7 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:21.509905 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1310/2647] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:21 2022] POST /identity/v3/users => generated 285 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:21.511491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb3c73-9139-4214-bcd9-1ad4c41ead90 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:21.523073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb3c73-9139-4214-bcd9-1ad4c41ead90 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:21.533008 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d345637-4d8c-492b-b615-0536ef40f02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:21.533857 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d345637-4d8c-492b-b615-0536ef40f02d admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:21.534200 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d345637-4d8c-492b-b615-0536ef40f02d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:21.534543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d345637-4d8c-492b-b615-0536ef40f02d admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:21.535209 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d345637-4d8c-492b-b615-0536ef40f02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:21.536830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d345637-4d8c-492b-b615-0536ef40f02d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:21.556169 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1338/2648] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:21.556428 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278962f-e8c8-4b43-8154-7ca29f45cef7 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:21.563174 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278962f-e8c8-4b43-8154-7ca29f45cef7 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:21.569168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf04d9c-46ad-4ce6-953d-ef55b60ae5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:21.569943 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf04d9c-46ad-4ce6-953d-ef55b60ae5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:21.570221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf04d9c-46ad-4ce6-953d-ef55b60ae5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:21.570491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf04d9c-46ad-4ce6-953d-ef55b60ae5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:21.571483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf04d9c-46ad-4ce6-953d-ef55b60ae5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:21.572902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf04d9c-46ad-4ce6-953d-ef55b60ae5c8 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:21.586090 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1311/2649] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:21.590358 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d345637-4d8c-492b-b615-0536ef40f02d admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:21.601500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d345637-4d8c-492b-b615-0536ef40f02d admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:21.607191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fd34c-bde9-40aa-a697-765a82740aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:21.607887 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fd34c-bde9-40aa-a697-765a82740aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:21.608692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fd34c-bde9-40aa-a697-765a82740aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:21.608692 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fd34c-bde9-40aa-a697-765a82740aa5 admin admin] PATH_INFO: `/v3/projects/acf4f66c98b7416490e17535b4592d1a/users/47dd0adfa4d746ec9386274a28b70822/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:21.627871 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fd34c-bde9-40aa-a697-765a82740aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf4f66c98b7416490e17535b4592d1a, user_id=47dd0adfa4d746ec9386274a28b70822, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:21.631694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fd34c-bde9-40aa-a697-765a82740aa5 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:21.648250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1339/2650] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:21 2022] PUT /identity/v3/projects/acf4f66c98b7416490e17535b4592d1a/users/47dd0adfa4d746ec9386274a28b70822/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:21.659300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce8bb5-9524-4764-a7ee-984701869ea4 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:21.659711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce8bb5-9524-4764-a7ee-984701869ea4 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:21.660002 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce8bb5-9524-4764-a7ee-984701869ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:21.698267 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-efce8bb5-9524-4764-a7ee-984701869ea4 None None] MFA Rules not processed for user `47dd0adfa4d746ec9386274a28b70822`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:21.699529 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-efce8bb5-9524-4764-a7ee-984701869ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:21.787331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1312/2651] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:21.791921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fd34c-bde9-40aa-a697-765a82740aa5 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:21.880543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fd34c-bde9-40aa-a697-765a82740aa5 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:21.885577 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1392a-5670-443e-9492-8cd82473fa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:21.886197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1392a-5670-443e-9492-8cd82473fa66 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:21.886476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1392a-5670-443e-9492-8cd82473fa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:21.886793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1392a-5670-443e-9492-8cd82473fa66 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:21.887472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1392a-5670-443e-9492-8cd82473fa66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:21.889494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1392a-5670-443e-9492-8cd82473fa66 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:21.949550 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1340/2652] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:21 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:21.953848 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce8bb5-9524-4764-a7ee-984701869ea4 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:21.967141 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce8bb5-9524-4764-a7ee-984701869ea4 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:21.993319 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:22.037016 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e8945-6e96-4ec1-a0c5-0452019c8380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:22.037671 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e8945-6e96-4ec1-a0c5-0452019c8380 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:22.038000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e8945-6e96-4ec1-a0c5-0452019c8380 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:22.038278 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e8945-6e96-4ec1-a0c5-0452019c8380 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:22.038921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e8945-6e96-4ec1-a0c5-0452019c8380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:22.040874 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e8945-6e96-4ec1-a0c5-0452019c8380 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:22.068503 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1313/2653] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:21 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:22.068634 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1392a-5670-443e-9492-8cd82473fa66 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:22.078988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1392a-5670-443e-9492-8cd82473fa66 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:22.084084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9825825-f835-4306-af4b-c91baa661004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:22.084709 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9825825-f835-4306-af4b-c91baa661004 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:22.084989 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9825825-f835-4306-af4b-c91baa661004 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:22.085284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9825825-f835-4306-af4b-c91baa661004 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:22.086033 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9825825-f835-4306-af4b-c91baa661004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:22.087705 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9825825-f835-4306-af4b-c91baa661004 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:22.101374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1341/2654] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:22.106154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e8945-6e96-4ec1-a0c5-0452019c8380 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:22.118794 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e8945-6e96-4ec1-a0c5-0452019c8380 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:22.123923 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25f37b-6343-4ea9-bf25-42fce35066f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:22.124705 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25f37b-6343-4ea9-bf25-42fce35066f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:22.124982 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25f37b-6343-4ea9-bf25-42fce35066f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:22.125300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25f37b-6343-4ea9-bf25-42fce35066f8 admin admin] PATH_INFO: `/v3/projects/de1387fb5f5540c182aa95cb0f361c65/users/138149e1fe81477481dc9035d12e62c2/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:22.143061 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25f37b-6343-4ea9-bf25-42fce35066f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1387fb5f5540c182aa95cb0f361c65, user_id=138149e1fe81477481dc9035d12e62c2, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:22.145906 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25f37b-6343-4ea9-bf25-42fce35066f8 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:22.159746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1314/2655] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:22 2022] PUT /identity/v3/projects/de1387fb5f5540c182aa95cb0f361c65/users/138149e1fe81477481dc9035d12e62c2/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:22.164130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9825825-f835-4306-af4b-c91baa661004 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:22.176308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9825825-f835-4306-af4b-c91baa661004 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:22.248814 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f17dae-6b41-4f1d-ba95-78ce599b55c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:22.249480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f17dae-6b41-4f1d-ba95-78ce599b55c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:22.249811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f17dae-6b41-4f1d-ba95-78ce599b55c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:22.250075 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f17dae-6b41-4f1d-ba95-78ce599b55c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:22.250725 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f17dae-6b41-4f1d-ba95-78ce599b55c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:22.252329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f17dae-6b41-4f1d-ba95-78ce599b55c3 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:22.263246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1342/2656] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:22.268103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25f37b-6343-4ea9-bf25-42fce35066f8 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:22.280482 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25f37b-6343-4ea9-bf25-42fce35066f8 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:22.286108 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3090f9-5f04-4755-85a8-978476868993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:22.286783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3090f9-5f04-4755-85a8-978476868993 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:22.287062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3090f9-5f04-4755-85a8-978476868993 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:22.287332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3090f9-5f04-4755-85a8-978476868993 admin admin] PATH_INFO: `/v3/projects/de1387fb5f5540c182aa95cb0f361c65/users/138149e1fe81477481dc9035d12e62c2/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:22.289321 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3090f9-5f04-4755-85a8-978476868993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1387fb5f5540c182aa95cb0f361c65, user_id=138149e1fe81477481dc9035d12e62c2, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:22.292074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3090f9-5f04-4755-85a8-978476868993 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:22.304415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1315/2657] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:22 2022] PUT /identity/v3/projects/de1387fb5f5540c182aa95cb0f361c65/users/138149e1fe81477481dc9035d12e62c2/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:22.316310 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a55610-5e90-4689-92f9-23f81e34bfde None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:22.316650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a55610-5e90-4689-92f9-23f81e34bfde None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:22.316847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a55610-5e90-4689-92f9-23f81e34bfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:22.352858 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-99a55610-5e90-4689-92f9-23f81e34bfde None None] MFA Rules not processed for user `138149e1fe81477481dc9035d12e62c2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:22.354953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-99a55610-5e90-4689-92f9-23f81e34bfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:22.407722 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:22.471297 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1343/2658] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:22.480056 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3090f9-5f04-4755-85a8-978476868993 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:22.481801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ba3090f9-5f04-4755-85a8-978476868993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:22.561861 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3090f9-5f04-4755-85a8-978476868993 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:22.566067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa89c96-8b19-4770-9451-367d84d39cd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:22.566869 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa89c96-8b19-4770-9451-367d84d39cd9 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:22.567354 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa89c96-8b19-4770-9451-367d84d39cd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:22.567630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa89c96-8b19-4770-9451-367d84d39cd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:22.578149 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa89c96-8b19-4770-9451-367d84d39cd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:22.579680 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa89c96-8b19-4770-9451-367d84d39cd9 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:22.590686 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1316/2659] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:22.644946 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a55610-5e90-4689-92f9-23f81e34bfde None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:22.646482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-99a55610-5e90-4689-92f9-23f81e34bfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:22.659207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a55610-5e90-4689-92f9-23f81e34bfde None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:22.663042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7b3a7-1711-43a4-9dca-d8b685327f8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:22.663673 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7b3a7-1711-43a4-9dca-d8b685327f8d service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:22.663948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7b3a7-1711-43a4-9dca-d8b685327f8d service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:22.664226 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7b3a7-1711-43a4-9dca-d8b685327f8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:22.735130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7b3a7-1711-43a4-9dca-d8b685327f8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:22.736929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7b3a7-1711-43a4-9dca-d8b685327f8d service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:22.748454 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1344/2660] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:23.356295 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa89c96-8b19-4770-9451-367d84d39cd9 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:23.358964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-3aa89c96-8b19-4770-9451-367d84d39cd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:23.422187 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa89c96-8b19-4770-9451-367d84d39cd9 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:23.426387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba57d2-b1eb-40b8-abe6-e830452aebcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:23.427032 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba57d2-b1eb-40b8-abe6-e830452aebcd service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:23.427310 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba57d2-b1eb-40b8-abe6-e830452aebcd service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:23.427592 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba57d2-b1eb-40b8-abe6-e830452aebcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:23.429818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6aba57d2-b1eb-40b8-abe6-e830452aebcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:23.464860 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:23.497421 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba57d2-b1eb-40b8-abe6-e830452aebcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:23.498902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba57d2-b1eb-40b8-abe6-e830452aebcd service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:23.508738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1317/2661] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 00:00:26.873052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7b3a7-1711-43a4-9dca-d8b685327f8d service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:27.005967 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7b3a7-1711-43a4-9dca-d8b685327f8d service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:27.019402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2380f-6e8f-4b3b-b3ef-705e01f993be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:27.020416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2380f-6e8f-4b3b-b3ef-705e01f993be admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:27.021011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2380f-6e8f-4b3b-b3ef-705e01f993be admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:27.021791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2380f-6e8f-4b3b-b3ef-705e01f993be admin admin] PATH_INFO: `/v3/users/47dd0adfa4d746ec9386274a28b70822` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:27.026112 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2380f-6e8f-4b3b-b3ef-705e01f993be admin admin] RBAC: Authorizing `identity:delete_user(user_id=47dd0adfa4d746ec9386274a28b70822)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:27.030853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2380f-6e8f-4b3b-b3ef-705e01f993be admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:27.100021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-3bf2380f-6e8f-4b3b-b3ef-705e01f993be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47dd0adfa4d746ec9386274a28b70822'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:27.110149 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-3bf2380f-6e8f-4b3b-b3ef-705e01f993be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47dd0adfa4d746ec9386274a28b70822'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:27.116372 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:27.128647 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-3bf2380f-6e8f-4b3b-b3ef-705e01f993be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47dd0adfa4d746ec9386274a28b70822'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:27.138817 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-3bf2380f-6e8f-4b3b-b3ef-705e01f993be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47dd0adfa4d746ec9386274a28b70822'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:27.139981 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-3bf2380f-6e8f-4b3b-b3ef-705e01f993be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47dd0adfa4d746ec9386274a28b70822'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:27.148695 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1345/2662] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:26 2022] DELETE /identity/v3/users/47dd0adfa4d746ec9386274a28b70822 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:27.155832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa33a92-2b7f-48f5-8e83-a982da08c12c None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:27.156634 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa33a92-2b7f-48f5-8e83-a982da08c12c None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:27.156792 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa33a92-2b7f-48f5-8e83-a982da08c12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:27.188706 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-6aa33a92-2b7f-48f5-8e83-a982da08c12c None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:27.190289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6aa33a92-2b7f-48f5-8e83-a982da08c12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:27.316232 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1318/2663] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:27.332294 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2380f-6e8f-4b3b-b3ef-705e01f993be admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:27.334322 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3bf2380f-6e8f-4b3b-b3ef-705e01f993be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:27.434800 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2380f-6e8f-4b3b-b3ef-705e01f993be admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:27.442924 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73172f-89d0-4584-a865-1196651d5672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:27.444043 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73172f-89d0-4584-a865-1196651d5672 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:27.444650 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73172f-89d0-4584-a865-1196651d5672 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:27.445214 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73172f-89d0-4584-a865-1196651d5672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:27.465766 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73172f-89d0-4584-a865-1196651d5672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:27.469007 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73172f-89d0-4584-a865-1196651d5672 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:27.489643 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1346/2664] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:28.144649 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa33a92-2b7f-48f5-8e83-a982da08c12c None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:28.147058 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6aa33a92-2b7f-48f5-8e83-a982da08c12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:28.178954 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa33a92-2b7f-48f5-8e83-a982da08c12c None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:28.197102 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb605d-dde3-4e40-9a49-d56df501e4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:28.199099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb605d-dde3-4e40-9a49-d56df501e4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:28.199867 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb605d-dde3-4e40-9a49-d56df501e4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:28.200827 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb605d-dde3-4e40-9a49-d56df501e4cf admin admin] PATH_INFO: `/v3/projects/acf4f66c98b7416490e17535b4592d1a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:28.203368 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb605d-dde3-4e40-9a49-d56df501e4cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf4f66c98b7416490e17535b4592d1a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:28.225298 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb605d-dde3-4e40-9a49-d56df501e4cf admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:28.361796 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-99bb605d-dde3-4e40-9a49-d56df501e4cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf4f66c98b7416490e17535b4592d1a', 'request_id': 'req-99bb605d-dde3-4e40-9a49-d56df501e4cf'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:28.385456 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-99bb605d-dde3-4e40-9a49-d56df501e4cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf4f66c98b7416490e17535b4592d1a', 'request_id': 'req-99bb605d-dde3-4e40-9a49-d56df501e4cf'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:28.403618 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-99bb605d-dde3-4e40-9a49-d56df501e4cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf4f66c98b7416490e17535b4592d1a', 'request_id': 'req-99bb605d-dde3-4e40-9a49-d56df501e4cf'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:28.514956 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-99bb605d-dde3-4e40-9a49-d56df501e4cf admin admin] The token cache is being invalidate because project acf4f66c98b7416490e17535b4592d1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:28.516020 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-99bb605d-dde3-4e40-9a49-d56df501e4cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:28.534265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-99bb605d-dde3-4e40-9a49-d56df501e4cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:28.540144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1319/2665] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:28 2022] DELETE /identity/v3/projects/acf4f66c98b7416490e17535b4592d1a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:28.547025 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73172f-89d0-4584-a865-1196651d5672 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:28.562524 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73172f-89d0-4584-a865-1196651d5672 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:28.752568 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e161d0-8029-4a7c-b704-a16f5efe9507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:28.754262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e161d0-8029-4a7c-b704-a16f5efe9507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:28.754898 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e161d0-8029-4a7c-b704-a16f5efe9507 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:28.755453 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e161d0-8029-4a7c-b704-a16f5efe9507 admin admin] PATH_INFO: `/v3/users/138149e1fe81477481dc9035d12e62c2` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:28.758892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e161d0-8029-4a7c-b704-a16f5efe9507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=138149e1fe81477481dc9035d12e62c2)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:28.764059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e161d0-8029-4a7c-b704-a16f5efe9507 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:28.866430 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-65e161d0-8029-4a7c-b704-a16f5efe9507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '138149e1fe81477481dc9035d12e62c2'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:28.877120 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-65e161d0-8029-4a7c-b704-a16f5efe9507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '138149e1fe81477481dc9035d12e62c2'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:28.902771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-65e161d0-8029-4a7c-b704-a16f5efe9507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '138149e1fe81477481dc9035d12e62c2'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:28.917637 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-65e161d0-8029-4a7c-b704-a16f5efe9507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '138149e1fe81477481dc9035d12e62c2'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:28.919041 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-65e161d0-8029-4a7c-b704-a16f5efe9507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '138149e1fe81477481dc9035d12e62c2'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:28.926554 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:28.940653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1347/2666] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:28 2022] DELETE /identity/v3/users/138149e1fe81477481dc9035d12e62c2 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:29.381323 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb605d-dde3-4e40-9a49-d56df501e4cf admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:29.383088 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-99bb605d-dde3-4e40-9a49-d56df501e4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:29.418362 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb605d-dde3-4e40-9a49-d56df501e4cf admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:29.506612 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:29.520039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588c99e-8900-4133-a83e-a0c3e4f7f1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:29.520712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588c99e-8900-4133-a83e-a0c3e4f7f1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:29.520998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588c99e-8900-4133-a83e-a0c3e4f7f1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:29.521269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588c99e-8900-4133-a83e-a0c3e4f7f1b8 admin admin] PATH_INFO: `/v3/projects/de1387fb5f5540c182aa95cb0f361c65` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:29.522742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588c99e-8900-4133-a83e-a0c3e4f7f1b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de1387fb5f5540c182aa95cb0f361c65)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:29.524748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588c99e-8900-4133-a83e-a0c3e4f7f1b8 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:29.607398 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-8588c99e-8900-4133-a83e-a0c3e4f7f1b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de1387fb5f5540c182aa95cb0f361c65', 'request_id': 'req-8588c99e-8900-4133-a83e-a0c3e4f7f1b8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:29.620961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-8588c99e-8900-4133-a83e-a0c3e4f7f1b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de1387fb5f5540c182aa95cb0f361c65', 'request_id': 'req-8588c99e-8900-4133-a83e-a0c3e4f7f1b8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:29.634915 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-8588c99e-8900-4133-a83e-a0c3e4f7f1b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de1387fb5f5540c182aa95cb0f361c65', 'request_id': 'req-8588c99e-8900-4133-a83e-a0c3e4f7f1b8'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:29.650959 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-8588c99e-8900-4133-a83e-a0c3e4f7f1b8 admin admin] The token cache is being invalidate because project de1387fb5f5540c182aa95cb0f361c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:29.651355 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-8588c99e-8900-4133-a83e-a0c3e4f7f1b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:29.652133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-8588c99e-8900-4133-a83e-a0c3e4f7f1b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:29.657817 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1320/2667] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:29 2022] DELETE /identity/v3/projects/de1387fb5f5540c182aa95cb0f361c65 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:29.660698 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12802394-26d1-487c-8d66-7dc2f84ca119 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:29.661548 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12802394-26d1-487c-8d66-7dc2f84ca119 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:29.661548 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12802394-26d1-487c-8d66-7dc2f84ca119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:29.692007 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-12802394-26d1-487c-8d66-7dc2f84ca119 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:29.695003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-12802394-26d1-487c-8d66-7dc2f84ca119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:29.810248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1348/2668] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:29.822288 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9db6e7-94c4-4e54-989e-cbd5f661ebca None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:29.822580 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9db6e7-94c4-4e54-989e-cbd5f661ebca None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:29.822851 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9db6e7-94c4-4e54-989e-cbd5f661ebca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:29.855566 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-7e9db6e7-94c4-4e54-989e-cbd5f661ebca None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:29.856875 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7e9db6e7-94c4-4e54-989e-cbd5f661ebca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:29.869041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1321/2669] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:29.870295 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12802394-26d1-487c-8d66-7dc2f84ca119 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:29.881796 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12802394-26d1-487c-8d66-7dc2f84ca119 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:29.887234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb323006-e9ab-4638-a41d-efda259f9282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:29.887914 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323006-e9ab-4638-a41d-efda259f9282 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:29.888190 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323006-e9ab-4638-a41d-efda259f9282 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:29.888463 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323006-e9ab-4638-a41d-efda259f9282 admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:29.889206 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb323006-e9ab-4638-a41d-efda259f9282 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 00:00:29.889549 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb323006-e9ab-4638-a41d-efda259f9282 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:29.891179 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb323006-e9ab-4638-a41d-efda259f9282 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:29.905190 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1349/2670] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Sep 13 00:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 00:00:29.910472 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9db6e7-94c4-4e54-989e-cbd5f661ebca None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:29.927313 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9db6e7-94c4-4e54-989e-cbd5f661ebca None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:29.936250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65155f6-6883-43a4-a7de-1f1257e5ba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:29.937565 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65155f6-6883-43a4-a7de-1f1257e5ba8b admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:29.938234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65155f6-6883-43a4-a7de-1f1257e5ba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:29.938785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65155f6-6883-43a4-a7de-1f1257e5ba8b admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:29.939718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65155f6-6883-43a4-a7de-1f1257e5ba8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:29.943994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65155f6-6883-43a4-a7de-1f1257e5ba8b admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:30.003652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1322/2671] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:29 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:30.005080 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb323006-e9ab-4638-a41d-efda259f9282 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:30.020643 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb323006-e9ab-4638-a41d-efda259f9282 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:30.127828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945f089-9954-4c8c-b875-4c384a5ecca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:30.129013 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945f089-9954-4c8c-b875-4c384a5ecca9 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:30.129446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945f089-9954-4c8c-b875-4c384a5ecca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:30.129863 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945f089-9954-4c8c-b875-4c384a5ecca9 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:30.130806 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945f089-9954-4c8c-b875-4c384a5ecca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:30.134233 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945f089-9954-4c8c-b875-4c384a5ecca9 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:30.168798 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1350/2672] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:30 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:00:30.175539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65155f6-6883-43a4-a7de-1f1257e5ba8b admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:30.193185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65155f6-6883-43a4-a7de-1f1257e5ba8b admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:30.201600 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ae61f-a1eb-4ee8-9512-bf7264e18afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:30.202657 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ae61f-a1eb-4ee8-9512-bf7264e18afe admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:30.203087 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ae61f-a1eb-4ee8-9512-bf7264e18afe admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:30.203577 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ae61f-a1eb-4ee8-9512-bf7264e18afe admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:30.204722 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ae61f-a1eb-4ee8-9512-bf7264e18afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:30.207347 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ae61f-a1eb-4ee8-9512-bf7264e18afe admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:30.229030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1323/2673] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:30.231364 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945f089-9954-4c8c-b875-4c384a5ecca9 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:30.255667 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945f089-9954-4c8c-b875-4c384a5ecca9 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:30.258925 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01d0bf-7b53-4eeb-a51f-8fb29608b3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:30.259845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01d0bf-7b53-4eeb-a51f-8fb29608b3bd admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:30.260195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01d0bf-7b53-4eeb-a51f-8fb29608b3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:30.260618 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01d0bf-7b53-4eeb-a51f-8fb29608b3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:30.261730 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01d0bf-7b53-4eeb-a51f-8fb29608b3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:30.264670 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01d0bf-7b53-4eeb-a51f-8fb29608b3bd admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:30.289964 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1351/2674] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:30.292636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ae61f-a1eb-4ee8-9512-bf7264e18afe admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:30.324380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ae61f-a1eb-4ee8-9512-bf7264e18afe admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:30.343811 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2e8fb-4522-4ec6-baea-d77dcbe6c5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:30.344917 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2e8fb-4522-4ec6-baea-d77dcbe6c5d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:30.345387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2e8fb-4522-4ec6-baea-d77dcbe6c5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:30.346101 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2e8fb-4522-4ec6-baea-d77dcbe6c5d3 admin admin] PATH_INFO: `/v3/projects/c8fdc1bffab64fc19ae69d42d5ec740e/users/4cf5fb5e19074e86871f93ea3f382a29/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:30.382776 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2e8fb-4522-4ec6-baea-d77dcbe6c5d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fdc1bffab64fc19ae69d42d5ec740e, user_id=4cf5fb5e19074e86871f93ea3f382a29, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:30.387948 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2e8fb-4522-4ec6-baea-d77dcbe6c5d3 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:30.417444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1324/2675] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:30 2022] PUT /identity/v3/projects/c8fdc1bffab64fc19ae69d42d5ec740e/users/4cf5fb5e19074e86871f93ea3f382a29/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:30.439356 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2313508-2a53-4ff0-ace6-58634fdb1b16 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:30.439847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2313508-2a53-4ff0-ace6-58634fdb1b16 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:30.440368 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2313508-2a53-4ff0-ace6-58634fdb1b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:30.474645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2e8fb-4522-4ec6-baea-d77dcbe6c5d3 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:30.477436 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-b7a2e8fb-4522-4ec6-baea-d77dcbe6c5d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:30.498062 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-a2313508-2a53-4ff0-ace6-58634fdb1b16 None None] MFA Rules not processed for user `4cf5fb5e19074e86871f93ea3f382a29`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:30.501020 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-a2313508-2a53-4ff0-ace6-58634fdb1b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:30.574809 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2e8fb-4522-4ec6-baea-d77dcbe6c5d3 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:30.579937 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:30.581572 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97908368-f6ad-4b74-995d-aacbfb1437d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:30.582190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97908368-f6ad-4b74-995d-aacbfb1437d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:30.582417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97908368-f6ad-4b74-995d-aacbfb1437d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:30.582691 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97908368-f6ad-4b74-995d-aacbfb1437d3 admin admin] PATH_INFO: `/v3/users/5932656ef0ca4186a1a3498e8a1ad279` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:30.584071 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97908368-f6ad-4b74-995d-aacbfb1437d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5932656ef0ca4186a1a3498e8a1ad279)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:30.586127 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97908368-f6ad-4b74-995d-aacbfb1437d3 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:30.597543 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1352/2676] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:30.600761 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2313508-2a53-4ff0-ace6-58634fdb1b16 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:30.614149 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:30.618601 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2313508-2a53-4ff0-ace6-58634fdb1b16 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:30.627448 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20e509-934c-4029-b562-cde22b2cd850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:30.628594 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20e509-934c-4029-b562-cde22b2cd850 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:30.628990 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20e509-934c-4029-b562-cde22b2cd850 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:30.629595 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20e509-934c-4029-b562-cde22b2cd850 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:30.630750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20e509-934c-4029-b562-cde22b2cd850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:30.634531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20e509-934c-4029-b562-cde22b2cd850 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:30.649782 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-97908368-f6ad-4b74-995d-aacbfb1437d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5932656ef0ca4186a1a3498e8a1ad279'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:30.651228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-97908368-f6ad-4b74-995d-aacbfb1437d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5932656ef0ca4186a1a3498e8a1ad279'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:30.652150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-97908368-f6ad-4b74-995d-aacbfb1437d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5932656ef0ca4186a1a3498e8a1ad279'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:30.669305 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-97908368-f6ad-4b74-995d-aacbfb1437d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5932656ef0ca4186a1a3498e8a1ad279'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:30.680703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1353/2677] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:30 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:00:30.687281 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20e509-934c-4029-b562-cde22b2cd850 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:30.688598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-97908368-f6ad-4b74-995d-aacbfb1437d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5932656ef0ca4186a1a3498e8a1ad279'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:30.694653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2a20e509-934c-4029-b562-cde22b2cd850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:30.709866 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1325/2678] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:30 2022] DELETE /identity/v3/users/5932656ef0ca4186a1a3498e8a1ad279 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:30.714798 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d89193-1697-4b0e-b103-a157210e9c74 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:30.715270 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d89193-1697-4b0e-b103-a157210e9c74 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:30.715683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d89193-1697-4b0e-b103-a157210e9c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:30.739670 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-41d89193-1697-4b0e-b103-a157210e9c74 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:30.740952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-41d89193-1697-4b0e-b103-a157210e9c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:30.789952 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20e509-934c-4029-b562-cde22b2cd850 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:30.819028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1326/2679] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:30.829855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d89193-1697-4b0e-b103-a157210e9c74 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:30.831598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-41d89193-1697-4b0e-b103-a157210e9c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:30.888974 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a61fc0-4a10-4677-8e1a-81b80db01cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:30.889725 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a61fc0-4a10-4677-8e1a-81b80db01cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:30.890059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a61fc0-4a10-4677-8e1a-81b80db01cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:30.890479 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a61fc0-4a10-4677-8e1a-81b80db01cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:30.891233 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a61fc0-4a10-4677-8e1a-81b80db01cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:30.893850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a61fc0-4a10-4677-8e1a-81b80db01cb0 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:30.919099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d89193-1697-4b0e-b103-a157210e9c74 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:30.924449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1354/2680] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:30 2022] POST /identity/v3/users => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:30.925891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a61fc0-4a10-4677-8e1a-81b80db01cb0 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:30.928988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2c807-6bbb-4b90-beea-c4288b49ed9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:30.930168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2c807-6bbb-4b90-beea-c4288b49ed9e service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:30.930625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2c807-6bbb-4b90-beea-c4288b49ed9e service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:30.931077 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2c807-6bbb-4b90-beea-c4288b49ed9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:30.943311 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a61fc0-4a10-4677-8e1a-81b80db01cb0 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:30.946695 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2c807-6bbb-4b90-beea-c4288b49ed9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:30.949410 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2c807-6bbb-4b90-beea-c4288b49ed9e service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:30.951307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d81ade-eb9b-4ab5-afa3-1c592cfc5a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:30.952375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d81ade-eb9b-4ab5-afa3-1c592cfc5a11 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:30.952830 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d81ade-eb9b-4ab5-afa3-1c592cfc5a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:30.953297 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d81ade-eb9b-4ab5-afa3-1c592cfc5a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:30.954404 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d81ade-eb9b-4ab5-afa3-1c592cfc5a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:30.957144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d81ade-eb9b-4ab5-afa3-1c592cfc5a11 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:30.967247 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1327/2681] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 00:00:30.970630 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1355/2682] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:30.977690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2c807-6bbb-4b90-beea-c4288b49ed9e service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:30.995340 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2c807-6bbb-4b90-beea-c4288b49ed9e service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:31.002999 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20a322-33f3-475d-b842-1186c285c01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:31.004228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20a322-33f3-475d-b842-1186c285c01b admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:31.004792 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20a322-33f3-475d-b842-1186c285c01b admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:31.005143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20a322-33f3-475d-b842-1186c285c01b admin admin] PATH_INFO: `/v3/projects/b816a03f74bc46d4912ebdb1877a2eb8/users/ab43dc3f37624278a3ef73f920613fe7/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:31.031523 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20a322-33f3-475d-b842-1186c285c01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b816a03f74bc46d4912ebdb1877a2eb8, user_id=ab43dc3f37624278a3ef73f920613fe7, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:31.034545 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20a322-33f3-475d-b842-1186c285c01b admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:31.055710 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1328/2683] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:30 2022] PUT /identity/v3/projects/b816a03f74bc46d4912ebdb1877a2eb8/users/ab43dc3f37624278a3ef73f920613fe7/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:31.061793 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d81ade-eb9b-4ab5-afa3-1c592cfc5a11 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:31.073393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d81ade-eb9b-4ab5-afa3-1c592cfc5a11 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:31.157824 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae029a-ce11-492f-8cc0-5010d2a65c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:31.158507 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae029a-ce11-492f-8cc0-5010d2a65c1d admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:31.158780 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae029a-ce11-492f-8cc0-5010d2a65c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:31.159038 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae029a-ce11-492f-8cc0-5010d2a65c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:31.159711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae029a-ce11-492f-8cc0-5010d2a65c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:31.161452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae029a-ce11-492f-8cc0-5010d2a65c1d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:31.163325 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:31.176023 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1356/2684] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:31.180718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20a322-33f3-475d-b842-1186c285c01b admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:31.194448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20a322-33f3-475d-b842-1186c285c01b admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:31.200357 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92143400-d1aa-44a4-a62b-384f02a1c1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:31.201055 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92143400-d1aa-44a4-a62b-384f02a1c1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:31.201375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92143400-d1aa-44a4-a62b-384f02a1c1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:31.201669 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92143400-d1aa-44a4-a62b-384f02a1c1e4 admin admin] PATH_INFO: `/v3/projects/b816a03f74bc46d4912ebdb1877a2eb8/users/ab43dc3f37624278a3ef73f920613fe7/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:31.203746 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92143400-d1aa-44a4-a62b-384f02a1c1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b816a03f74bc46d4912ebdb1877a2eb8, user_id=ab43dc3f37624278a3ef73f920613fe7, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:31.206506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92143400-d1aa-44a4-a62b-384f02a1c1e4 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:31.223192 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1329/2685] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:31 2022] PUT /identity/v3/projects/b816a03f74bc46d4912ebdb1877a2eb8/users/ab43dc3f37624278a3ef73f920613fe7/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:31.238494 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce31c7-4706-4aa6-b2c8-0c6f57942bdb None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:31.239181 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce31c7-4706-4aa6-b2c8-0c6f57942bdb None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:31.239662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce31c7-4706-4aa6-b2c8-0c6f57942bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:31.273684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-41ce31c7-4706-4aa6-b2c8-0c6f57942bdb None None] MFA Rules not processed for user `ab43dc3f37624278a3ef73f920613fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:31.275024 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-41ce31c7-4706-4aa6-b2c8-0c6f57942bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:31.366178 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1357/2686] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:31.371654 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92143400-d1aa-44a4-a62b-384f02a1c1e4 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:31.377713 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-92143400-d1aa-44a4-a62b-384f02a1c1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:31.387042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce31c7-4706-4aa6-b2c8-0c6f57942bdb None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:31.390210 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-41ce31c7-4706-4aa6-b2c8-0c6f57942bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:31.414208 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:31.471104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce31c7-4706-4aa6-b2c8-0c6f57942bdb None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:31.476287 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0480c5-a80e-46f1-b28f-3f308d586692 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:31.477046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0480c5-a80e-46f1-b28f-3f308d586692 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:31.477241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0480c5-a80e-46f1-b28f-3f308d586692 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:31.477537 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0480c5-a80e-46f1-b28f-3f308d586692 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:31.488056 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0480c5-a80e-46f1-b28f-3f308d586692 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:31.489699 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0480c5-a80e-46f1-b28f-3f308d586692 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:31.501498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1358/2687] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:31.542190 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92143400-d1aa-44a4-a62b-384f02a1c1e4 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:31.548263 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e03268-34d6-462e-98d4-1e5a6448849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:31.548986 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e03268-34d6-462e-98d4-1e5a6448849e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:31.549452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e03268-34d6-462e-98d4-1e5a6448849e admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:31.549828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e03268-34d6-462e-98d4-1e5a6448849e admin admin] PATH_INFO: `/v3/projects/813843b6231c48139399993a7ebde7f2` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:31.551247 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e03268-34d6-462e-98d4-1e5a6448849e admin admin] RBAC: Authorizing `identity:delete_project(project_id=813843b6231c48139399993a7ebde7f2)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:31.553472 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e03268-34d6-462e-98d4-1e5a6448849e admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:31.640014 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a6e03268-34d6-462e-98d4-1e5a6448849e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813843b6231c48139399993a7ebde7f2', 'request_id': 'req-a6e03268-34d6-462e-98d4-1e5a6448849e'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:31.649107 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0480c5-a80e-46f1-b28f-3f308d586692 service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:31.649638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a6e03268-34d6-462e-98d4-1e5a6448849e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813843b6231c48139399993a7ebde7f2', 'request_id': 'req-a6e03268-34d6-462e-98d4-1e5a6448849e'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:31.660171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0480c5-a80e-46f1-b28f-3f308d586692 service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:31.664890 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a6e03268-34d6-462e-98d4-1e5a6448849e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813843b6231c48139399993a7ebde7f2', 'request_id': 'req-a6e03268-34d6-462e-98d4-1e5a6448849e'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:31.686112 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a6e03268-34d6-462e-98d4-1e5a6448849e admin admin] The token cache is being invalidate because project 813843b6231c48139399993a7ebde7f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:31.686856 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a6e03268-34d6-462e-98d4-1e5a6448849e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:31.687818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a6e03268-34d6-462e-98d4-1e5a6448849e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:31.691034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1330/2688] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:31 2022] DELETE /identity/v3/projects/813843b6231c48139399993a7ebde7f2 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:31.697734 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e03268-34d6-462e-98d4-1e5a6448849e admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:31.701995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a6e03268-34d6-462e-98d4-1e5a6448849e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:31.765271 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c369270-6df1-4db4-8351-3b4377107265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:31.766465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c369270-6df1-4db4-8351-3b4377107265 service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:31.766944 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c369270-6df1-4db4-8351-3b4377107265 service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:31.767413 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c369270-6df1-4db4-8351-3b4377107265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:31.770355 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-3c369270-6df1-4db4-8351-3b4377107265 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:31.801828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e03268-34d6-462e-98d4-1e5a6448849e admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:31.808717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd172b2f-5d86-4174-ac43-1f93ef6ea843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:31.809700 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd172b2f-5d86-4174-ac43-1f93ef6ea843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:31.810091 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd172b2f-5d86-4174-ac43-1f93ef6ea843 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:31.810425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd172b2f-5d86-4174-ac43-1f93ef6ea843 admin admin] PATH_INFO: `/v3/users/3c3c7611cb514057ac2c61afa6c16784` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:31.812011 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd172b2f-5d86-4174-ac43-1f93ef6ea843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c3c7611cb514057ac2c61afa6c16784)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:31.814081 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd172b2f-5d86-4174-ac43-1f93ef6ea843 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:31.839711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:31.867235 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c369270-6df1-4db4-8351-3b4377107265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:31.868769 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c369270-6df1-4db4-8351-3b4377107265 service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:31.878490 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:31.880684 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1359/2689] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 00:00:31.902870 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cd172b2f-5d86-4174-ac43-1f93ef6ea843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c3c7611cb514057ac2c61afa6c16784'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:31.904063 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cd172b2f-5d86-4174-ac43-1f93ef6ea843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c3c7611cb514057ac2c61afa6c16784'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:31.905122 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cd172b2f-5d86-4174-ac43-1f93ef6ea843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c3c7611cb514057ac2c61afa6c16784'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:31.925754 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cd172b2f-5d86-4174-ac43-1f93ef6ea843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c3c7611cb514057ac2c61afa6c16784'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:31.935032 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cd172b2f-5d86-4174-ac43-1f93ef6ea843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c3c7611cb514057ac2c61afa6c16784'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:31.955699 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1331/2690] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:31 2022] DELETE /identity/v3/users/3c3c7611cb514057ac2c61afa6c16784 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:32.323594 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c369270-6df1-4db4-8351-3b4377107265 service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:32.342764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c369270-6df1-4db4-8351-3b4377107265 service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:32.438529 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c2ff9-4575-4cc8-b468-af3331fb8850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:32.440686 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c2ff9-4575-4cc8-b468-af3331fb8850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:32.440686 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c2ff9-4575-4cc8-b468-af3331fb8850 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:32.440686 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c2ff9-4575-4cc8-b468-af3331fb8850 admin admin] PATH_INFO: `/v3/projects/fe57f9463b504760bef12742e6b538e9` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:32.442403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c2ff9-4575-4cc8-b468-af3331fb8850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe57f9463b504760bef12742e6b538e9)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:32.447642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c2ff9-4575-4cc8-b468-af3331fb8850 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:32.528027 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-779c2ff9-4575-4cc8-b468-af3331fb8850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe57f9463b504760bef12742e6b538e9', 'request_id': 'req-779c2ff9-4575-4cc8-b468-af3331fb8850'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:32.540049 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-779c2ff9-4575-4cc8-b468-af3331fb8850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe57f9463b504760bef12742e6b538e9', 'request_id': 'req-779c2ff9-4575-4cc8-b468-af3331fb8850'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:32.548553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-779c2ff9-4575-4cc8-b468-af3331fb8850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe57f9463b504760bef12742e6b538e9', 'request_id': 'req-779c2ff9-4575-4cc8-b468-af3331fb8850'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:32.562699 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-779c2ff9-4575-4cc8-b468-af3331fb8850 admin admin] The token cache is being invalidate because project fe57f9463b504760bef12742e6b538e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:32.562990 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-779c2ff9-4575-4cc8-b468-af3331fb8850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:32.563658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-779c2ff9-4575-4cc8-b468-af3331fb8850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:32.565193 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1360/2691] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:32 2022] DELETE /identity/v3/projects/fe57f9463b504760bef12742e6b538e9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:32.575062 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb43fc-a6c4-4cb9-8eb0-8a6df517b1ad None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:32.575663 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb43fc-a6c4-4cb9-8eb0-8a6df517b1ad None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:32.575834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb43fc-a6c4-4cb9-8eb0-8a6df517b1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:32.610239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-a9fb43fc-a6c4-4cb9-8eb0-8a6df517b1ad None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:32.611880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a9fb43fc-a6c4-4cb9-8eb0-8a6df517b1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:32.682641 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1332/2692] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:32.694758 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08f18e-f97c-4113-ae88-c5445d35710c None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:32.695053 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08f18e-f97c-4113-ae88-c5445d35710c None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:32.695218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08f18e-f97c-4113-ae88-c5445d35710c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:32.717943 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-7c08f18e-f97c-4113-ae88-c5445d35710c None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:32.719230 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-7c08f18e-f97c-4113-ae88-c5445d35710c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:32.728173 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1361/2693] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:32.735283 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb43fc-a6c4-4cb9-8eb0-8a6df517b1ad None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:32.752833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb43fc-a6c4-4cb9-8eb0-8a6df517b1ad None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:32.760942 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ceb05-b2a4-4c89-8fe3-36b5c964e2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:32.762012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ceb05-b2a4-4c89-8fe3-36b5c964e2cc admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:32.762485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ceb05-b2a4-4c89-8fe3-36b5c964e2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:32.762988 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ceb05-b2a4-4c89-8fe3-36b5c964e2cc admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:32.764211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ceb05-b2a4-4c89-8fe3-36b5c964e2cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 00:00:32.764753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ceb05-b2a4-4c89-8fe3-36b5c964e2cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:32.768149 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ceb05-b2a4-4c89-8fe3-36b5c964e2cc admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:32.791956 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1333/2694] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Sep 13 00:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 00:00:32.797798 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08f18e-f97c-4113-ae88-c5445d35710c None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:32.813649 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08f18e-f97c-4113-ae88-c5445d35710c None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:32.821821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16d37d-de9c-4fac-9431-9057ed761f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:32.822941 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16d37d-de9c-4fac-9431-9057ed761f19 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:32.823574 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16d37d-de9c-4fac-9431-9057ed761f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:32.824113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16d37d-de9c-4fac-9431-9057ed761f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:32.825642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16d37d-de9c-4fac-9431-9057ed761f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:32.831032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16d37d-de9c-4fac-9431-9057ed761f19 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:32.872648 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1362/2695] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:32 2022] POST /identity/v3/projects => generated 365 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:32.877326 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ceb05-b2a4-4c89-8fe3-36b5c964e2cc admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:32.890180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ceb05-b2a4-4c89-8fe3-36b5c964e2cc admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:32.969222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743f015-794f-4a38-8688-408bf414852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:32.970332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743f015-794f-4a38-8688-408bf414852f admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:32.970655 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743f015-794f-4a38-8688-408bf414852f admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:32.970959 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743f015-794f-4a38-8688-408bf414852f admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:32.971981 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743f015-794f-4a38-8688-408bf414852f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:32.974169 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743f015-794f-4a38-8688-408bf414852f admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:32.999924 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1334/2696] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:32 2022] POST /identity/v3/users => generated 283 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:33.004712 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16d37d-de9c-4fac-9431-9057ed761f19 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:33.016280 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16d37d-de9c-4fac-9431-9057ed761f19 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:33.022058 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef66bc-5ee2-4937-87d5-c7deab2b75b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:33.022760 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef66bc-5ee2-4937-87d5-c7deab2b75b8 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:33.023086 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef66bc-5ee2-4937-87d5-c7deab2b75b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:33.023431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef66bc-5ee2-4937-87d5-c7deab2b75b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:33.024127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef66bc-5ee2-4937-87d5-c7deab2b75b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:33.026078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef66bc-5ee2-4937-87d5-c7deab2b75b8 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:33.038396 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1363/2697] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:33.043725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743f015-794f-4a38-8688-408bf414852f admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:33.062490 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743f015-794f-4a38-8688-408bf414852f admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:33.069834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988b68c-bc99-4c61-9441-311260897109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:33.070909 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988b68c-bc99-4c61-9441-311260897109 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:33.071418 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988b68c-bc99-4c61-9441-311260897109 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:33.071889 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988b68c-bc99-4c61-9441-311260897109 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:33.073201 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988b68c-bc99-4c61-9441-311260897109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:33.076414 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988b68c-bc99-4c61-9441-311260897109 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:33.093239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1335/2698] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:33.099583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef66bc-5ee2-4937-87d5-c7deab2b75b8 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:33.111512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef66bc-5ee2-4937-87d5-c7deab2b75b8 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:33.118073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8eb88d-bac4-4fc5-8c3d-a799e53f187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:33.119100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eb88d-bac4-4fc5-8c3d-a799e53f187d admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:33.119631 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eb88d-bac4-4fc5-8c3d-a799e53f187d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:33.120006 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8eb88d-bac4-4fc5-8c3d-a799e53f187d admin admin] PATH_INFO: `/v3/projects/b3758fbbe9cb4f2e8cc2e566cbdfc1d5/users/ad2aa8364ee641debfcf8a8a9a5a3209/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:33.140902 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8eb88d-bac4-4fc5-8c3d-a799e53f187d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3758fbbe9cb4f2e8cc2e566cbdfc1d5, user_id=ad2aa8364ee641debfcf8a8a9a5a3209, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:33.143784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8eb88d-bac4-4fc5-8c3d-a799e53f187d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:33.160957 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1364/2699] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:33 2022] PUT /identity/v3/projects/b3758fbbe9cb4f2e8cc2e566cbdfc1d5/users/ad2aa8364ee641debfcf8a8a9a5a3209/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:33.182623 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c082e6-cb87-401d-b9f7-de449ce29ed1 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:33.182950 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c082e6-cb87-401d-b9f7-de449ce29ed1 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:33.183147 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c082e6-cb87-401d-b9f7-de449ce29ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:33.218971 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-42c082e6-cb87-401d-b9f7-de449ce29ed1 None None] MFA Rules not processed for user `ad2aa8364ee641debfcf8a8a9a5a3209`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:33.220337 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-42c082e6-cb87-401d-b9f7-de449ce29ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:33.230786 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:33.294389 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1336/2700] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:33.299953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8eb88d-bac4-4fc5-8c3d-a799e53f187d admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:33.308674 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:33.396082 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8eb88d-bac4-4fc5-8c3d-a799e53f187d admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:33.401053 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed74882-220f-464f-a3e4-7220ead51c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:33.401712 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed74882-220f-464f-a3e4-7220ead51c2c admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:33.402002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed74882-220f-464f-a3e4-7220ead51c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:33.402278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed74882-220f-464f-a3e4-7220ead51c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:33.404415 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed74882-220f-464f-a3e4-7220ead51c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:33.406484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed74882-220f-464f-a3e4-7220ead51c2c admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:33.442370 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1365/2701] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:33 2022] POST /identity/v3/projects => generated 363 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:33.447212 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c082e6-cb87-401d-b9f7-de449ce29ed1 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:33.464535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c082e6-cb87-401d-b9f7-de449ce29ed1 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:33.540039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c7f34-65f3-406a-b5b0-5587a3123830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:33.540738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c7f34-65f3-406a-b5b0-5587a3123830 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:33.540933 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c7f34-65f3-406a-b5b0-5587a3123830 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:33.541200 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c7f34-65f3-406a-b5b0-5587a3123830 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:33.541882 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c7f34-65f3-406a-b5b0-5587a3123830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:33.544005 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c7f34-65f3-406a-b5b0-5587a3123830 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:33.573330 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1337/2702] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:33 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:33.574662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed74882-220f-464f-a3e4-7220ead51c2c admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:33.590303 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed74882-220f-464f-a3e4-7220ead51c2c admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:33.597223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6e6e2-08bf-40f8-8111-0451ee84ce97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:33.598262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6e6e2-08bf-40f8-8111-0451ee84ce97 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:33.598751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6e6e2-08bf-40f8-8111-0451ee84ce97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:33.599381 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6e6e2-08bf-40f8-8111-0451ee84ce97 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:33.600500 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6e6e2-08bf-40f8-8111-0451ee84ce97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:33.603126 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6e6e2-08bf-40f8-8111-0451ee84ce97 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:33.624271 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1366/2703] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:33.627722 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c7f34-65f3-406a-b5b0-5587a3123830 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:33.639049 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c7f34-65f3-406a-b5b0-5587a3123830 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:33.646274 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537c7a5-4e52-4bc8-94d6-c44239ed078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:33.647323 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537c7a5-4e52-4bc8-94d6-c44239ed078c admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:33.647734 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537c7a5-4e52-4bc8-94d6-c44239ed078c admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:33.648052 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537c7a5-4e52-4bc8-94d6-c44239ed078c admin admin] PATH_INFO: `/v3/projects/7110fad8033349b9843c518010d6f2f7/users/ef78a31107374ae99f7885f0e62ad82f/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:33.669638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537c7a5-4e52-4bc8-94d6-c44239ed078c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7110fad8033349b9843c518010d6f2f7, user_id=ef78a31107374ae99f7885f0e62ad82f, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:33.674375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537c7a5-4e52-4bc8-94d6-c44239ed078c admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:33.691359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1338/2704] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:33 2022] PUT /identity/v3/projects/7110fad8033349b9843c518010d6f2f7/users/ef78a31107374ae99f7885f0e62ad82f/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:33.695461 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6e6e2-08bf-40f8-8111-0451ee84ce97 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:33.708933 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6e6e2-08bf-40f8-8111-0451ee84ce97 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:33.778078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad87ae-c539-4bd1-9892-bf80036f708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:33.778730 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad87ae-c539-4bd1-9892-bf80036f708e admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:33.779008 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad87ae-c539-4bd1-9892-bf80036f708e admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:33.779278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad87ae-c539-4bd1-9892-bf80036f708e admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:33.780017 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad87ae-c539-4bd1-9892-bf80036f708e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:33.781676 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad87ae-c539-4bd1-9892-bf80036f708e admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:33.793445 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1367/2705] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:33.798881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537c7a5-4e52-4bc8-94d6-c44239ed078c admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:33.811391 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537c7a5-4e52-4bc8-94d6-c44239ed078c admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:33.817166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1406a-3aad-47c5-ad06-667589eb19ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:33.817879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1406a-3aad-47c5-ad06-667589eb19ab admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:33.818155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1406a-3aad-47c5-ad06-667589eb19ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:33.818422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1406a-3aad-47c5-ad06-667589eb19ab admin admin] PATH_INFO: `/v3/projects/7110fad8033349b9843c518010d6f2f7/users/ef78a31107374ae99f7885f0e62ad82f/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:33.820711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1406a-3aad-47c5-ad06-667589eb19ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7110fad8033349b9843c518010d6f2f7, user_id=ef78a31107374ae99f7885f0e62ad82f, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:33.823523 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1406a-3aad-47c5-ad06-667589eb19ab admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:33.836070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1339/2706] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:33 2022] PUT /identity/v3/projects/7110fad8033349b9843c518010d6f2f7/users/ef78a31107374ae99f7885f0e62ad82f/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:33.846961 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7df5-4590-420a-9961-559b3bd4961e None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:33.847628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7df5-4590-420a-9961-559b3bd4961e None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:33.847628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7df5-4590-420a-9961-559b3bd4961e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:33.879621 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-368f7df5-4590-420a-9961-559b3bd4961e None None] MFA Rules not processed for user `ef78a31107374ae99f7885f0e62ad82f`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:33.880866 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-368f7df5-4590-420a-9961-559b3bd4961e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:33.960437 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:33.970929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1368/2707] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:33.979286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1406a-3aad-47c5-ad06-667589eb19ab admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:33.981122 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a6c1406a-3aad-47c5-ad06-667589eb19ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:34.094473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1406a-3aad-47c5-ad06-667589eb19ab admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:34.100958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972f1d8-1991-485a-aeb7-1eda126d01a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:34.101858 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972f1d8-1991-485a-aeb7-1eda126d01a8 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:34.102144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972f1d8-1991-485a-aeb7-1eda126d01a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:34.102413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972f1d8-1991-485a-aeb7-1eda126d01a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:34.116874 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972f1d8-1991-485a-aeb7-1eda126d01a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:34.118636 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972f1d8-1991-485a-aeb7-1eda126d01a8 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:34.131756 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1340/2708] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:34.673834 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f7df5-4590-420a-9961-559b3bd4961e None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:34.675899 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-368f7df5-4590-420a-9961-559b3bd4961e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:34.739624 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972f1d8-1991-485a-aeb7-1eda126d01a8 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:34.749154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:34.777672 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f7df5-4590-420a-9961-559b3bd4961e None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:34.782803 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d02b41-2988-4564-9782-3d0c76a02a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:34.783492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d02b41-2988-4564-9782-3d0c76a02a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:34.783888 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d02b41-2988-4564-9782-3d0c76a02a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:34.784179 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d02b41-2988-4564-9782-3d0c76a02a4d admin admin] PATH_INFO: `/v3/users/4cf5fb5e19074e86871f93ea3f382a29` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:34.785565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d02b41-2988-4564-9782-3d0c76a02a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cf5fb5e19074e86871f93ea3f382a29)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:34.788106 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d02b41-2988-4564-9782-3d0c76a02a4d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:34.854702 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d1d02b41-2988-4564-9782-3d0c76a02a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cf5fb5e19074e86871f93ea3f382a29'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:34.864325 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d1d02b41-2988-4564-9782-3d0c76a02a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cf5fb5e19074e86871f93ea3f382a29'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:34.867478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972f1d8-1991-485a-aeb7-1eda126d01a8 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:34.873264 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35949170-63e1-4dba-afea-e80ec5f5394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:34.874307 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35949170-63e1-4dba-afea-e80ec5f5394a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:34.874705 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35949170-63e1-4dba-afea-e80ec5f5394a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:34.875085 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35949170-63e1-4dba-afea-e80ec5f5394a admin admin] PATH_INFO: `/v3/users/ad2aa8364ee641debfcf8a8a9a5a3209` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:34.876552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35949170-63e1-4dba-afea-e80ec5f5394a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2aa8364ee641debfcf8a8a9a5a3209)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:34.879481 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d1d02b41-2988-4564-9782-3d0c76a02a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cf5fb5e19074e86871f93ea3f382a29'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:34.879750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35949170-63e1-4dba-afea-e80ec5f5394a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:34.890775 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d1d02b41-2988-4564-9782-3d0c76a02a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cf5fb5e19074e86871f93ea3f382a29'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:34.892031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d1d02b41-2988-4564-9782-3d0c76a02a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cf5fb5e19074e86871f93ea3f382a29'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:34.903359 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1369/2709] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:34 2022] DELETE /identity/v3/users/4cf5fb5e19074e86871f93ea3f382a29 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:34.910457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa83f8-79c1-451a-a161-533b9f9fb4a1 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:34.911567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa83f8-79c1-451a-a161-533b9f9fb4a1 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:34.911567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa83f8-79c1-451a-a161-533b9f9fb4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:34.941423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-6caa83f8-79c1-451a-a161-533b9f9fb4a1 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:34.943516 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6caa83f8-79c1-451a-a161-533b9f9fb4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:34.965502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-35949170-63e1-4dba-afea-e80ec5f5394a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2aa8364ee641debfcf8a8a9a5a3209'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:34.966776 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-35949170-63e1-4dba-afea-e80ec5f5394a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2aa8364ee641debfcf8a8a9a5a3209'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:34.968153 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-35949170-63e1-4dba-afea-e80ec5f5394a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2aa8364ee641debfcf8a8a9a5a3209'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:34.996913 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-35949170-63e1-4dba-afea-e80ec5f5394a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2aa8364ee641debfcf8a8a9a5a3209'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:35.012990 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-35949170-63e1-4dba-afea-e80ec5f5394a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2aa8364ee641debfcf8a8a9a5a3209'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:35.039640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1341/2710] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:34 2022] DELETE /identity/v3/users/ad2aa8364ee641debfcf8a8a9a5a3209 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:35.047209 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd48c17-6014-4563-bcad-8e2fdf8d8e58 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:35.047814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd48c17-6014-4563-bcad-8e2fdf8d8e58 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:35.048169 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd48c17-6014-4563-bcad-8e2fdf8d8e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:35.059949 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1370/2711] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:35.078700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa83f8-79c1-451a-a161-533b9f9fb4a1 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:35.079497 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-7cd48c17-6014-4563-bcad-8e2fdf8d8e58 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:35.080790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7cd48c17-6014-4563-bcad-8e2fdf8d8e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:35.081274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6caa83f8-79c1-451a-a161-533b9f9fb4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:35.120181 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:35.174776 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa83f8-79c1-451a-a161-533b9f9fb4a1 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:35.184919 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1342/2712] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:35.197558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd48c17-6014-4563-bcad-8e2fdf8d8e58 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:35.201706 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7cd48c17-6014-4563-bcad-8e2fdf8d8e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:35.251734 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:35.259307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502874fb-5ba8-4df0-8948-e08b25bd6b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:35.260290 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502874fb-5ba8-4df0-8948-e08b25bd6b15 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:35.260742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502874fb-5ba8-4df0-8948-e08b25bd6b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:35.261182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502874fb-5ba8-4df0-8948-e08b25bd6b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:35.276742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502874fb-5ba8-4df0-8948-e08b25bd6b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:35.279124 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502874fb-5ba8-4df0-8948-e08b25bd6b15 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:35.292411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1371/2713] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:35.307114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd48c17-6014-4563-bcad-8e2fdf8d8e58 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:35.313375 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2c03a-d6b3-4650-b9ec-58bd5c8efc43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:35.314105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2c03a-d6b3-4650-b9ec-58bd5c8efc43 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:35.314386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2c03a-d6b3-4650-b9ec-58bd5c8efc43 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:35.314688 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2c03a-d6b3-4650-b9ec-58bd5c8efc43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:35.325586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2c03a-d6b3-4650-b9ec-58bd5c8efc43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:35.327207 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2c03a-d6b3-4650-b9ec-58bd5c8efc43 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:35.338497 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1343/2714] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 00:00:35.711348 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502874fb-5ba8-4df0-8948-e08b25bd6b15 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:35.713003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-502874fb-5ba8-4df0-8948-e08b25bd6b15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:35.729222 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2c03a-d6b3-4650-b9ec-58bd5c8efc43 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:35.730880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6aa2c03a-d6b3-4650-b9ec-58bd5c8efc43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:35.751041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2c03a-d6b3-4650-b9ec-58bd5c8efc43 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:35.753119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502874fb-5ba8-4df0-8948-e08b25bd6b15 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:35.759826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:35.760406 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87551cda-1357-4c5c-8203-b4ff74d9a2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:35.760596 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:35.760884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:35.761223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87551cda-1357-4c5c-8203-b4ff74d9a2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:35.761444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c admin admin] PATH_INFO: `/v3/projects/b3758fbbe9cb4f2e8cc2e566cbdfc1d5` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:35.761657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87551cda-1357-4c5c-8203-b4ff74d9a2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:35.761916 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87551cda-1357-4c5c-8203-b4ff74d9a2a0 admin admin] PATH_INFO: `/v3/projects/c8fdc1bffab64fc19ae69d42d5ec740e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:35.762644 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3758fbbe9cb4f2e8cc2e566cbdfc1d5)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:35.763094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87551cda-1357-4c5c-8203-b4ff74d9a2a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8fdc1bffab64fc19ae69d42d5ec740e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:35.764964 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:35.765178 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87551cda-1357-4c5c-8203-b4ff74d9a2a0 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:35.840447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-87551cda-1357-4c5c-8203-b4ff74d9a2a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8fdc1bffab64fc19ae69d42d5ec740e', 'request_id': 'req-87551cda-1357-4c5c-8203-b4ff74d9a2a0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:35.855228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-87551cda-1357-4c5c-8203-b4ff74d9a2a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8fdc1bffab64fc19ae69d42d5ec740e', 'request_id': 'req-87551cda-1357-4c5c-8203-b4ff74d9a2a0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:35.861313 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3758fbbe9cb4f2e8cc2e566cbdfc1d5', 'request_id': 'req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:35.862771 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-87551cda-1357-4c5c-8203-b4ff74d9a2a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8fdc1bffab64fc19ae69d42d5ec740e', 'request_id': 'req-87551cda-1357-4c5c-8203-b4ff74d9a2a0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:35.872202 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3758fbbe9cb4f2e8cc2e566cbdfc1d5', 'request_id': 'req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:35.884176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3758fbbe9cb4f2e8cc2e566cbdfc1d5', 'request_id': 'req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:35.884458 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-87551cda-1357-4c5c-8203-b4ff74d9a2a0 admin admin] The token cache is being invalidate because project c8fdc1bffab64fc19ae69d42d5ec740e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:35.885072 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-87551cda-1357-4c5c-8203-b4ff74d9a2a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:35.886345 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-87551cda-1357-4c5c-8203-b4ff74d9a2a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:35.889374 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1372/2715] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:35 2022] DELETE /identity/v3/projects/c8fdc1bffab64fc19ae69d42d5ec740e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:35.895562 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87551cda-1357-4c5c-8203-b4ff74d9a2a0 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:35.897792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-87551cda-1357-4c5c-8203-b4ff74d9a2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:35.907515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c admin admin] The token cache is being invalidate because project b3758fbbe9cb4f2e8cc2e566cbdfc1d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:35.907955 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:35.909053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:35.919638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1344/2716] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:35 2022] DELETE /identity/v3/projects/b3758fbbe9cb4f2e8cc2e566cbdfc1d5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:35.924803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:35.927683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:36.020972 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87551cda-1357-4c5c-8203-b4ff74d9a2a0 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:36.026816 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:36.044469 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ceebf6-8ab9-4a17-aaae-1fb55c17a31c admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:36.053023 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dce4b3-72e1-4d48-b0f6-59ab4c78aee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:36.054169 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dce4b3-72e1-4d48-b0f6-59ab4c78aee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:36.054839 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dce4b3-72e1-4d48-b0f6-59ab4c78aee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:36.055316 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dce4b3-72e1-4d48-b0f6-59ab4c78aee7 admin admin] PATH_INFO: `/v3/users/ef78a31107374ae99f7885f0e62ad82f` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:36.057146 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dce4b3-72e1-4d48-b0f6-59ab4c78aee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef78a31107374ae99f7885f0e62ad82f)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:36.061047 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dce4b3-72e1-4d48-b0f6-59ab4c78aee7 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:36.109402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470281eb-c829-4b8c-bab0-5ac773fb35a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:36.109402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470281eb-c829-4b8c-bab0-5ac773fb35a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:36.109402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470281eb-c829-4b8c-bab0-5ac773fb35a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:36.109402 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470281eb-c829-4b8c-bab0-5ac773fb35a3 admin admin] PATH_INFO: `/v3/users/ab43dc3f37624278a3ef73f920613fe7` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:36.111476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470281eb-c829-4b8c-bab0-5ac773fb35a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab43dc3f37624278a3ef73f920613fe7)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:36.113801 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470281eb-c829-4b8c-bab0-5ac773fb35a3 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:36.167453 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e3dce4b3-72e1-4d48-b0f6-59ab4c78aee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef78a31107374ae99f7885f0e62ad82f'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:36.168364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e3dce4b3-72e1-4d48-b0f6-59ab4c78aee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef78a31107374ae99f7885f0e62ad82f'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:36.169439 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e3dce4b3-72e1-4d48-b0f6-59ab4c78aee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef78a31107374ae99f7885f0e62ad82f'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:36.179276 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:36.186321 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-470281eb-c829-4b8c-bab0-5ac773fb35a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab43dc3f37624278a3ef73f920613fe7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:36.196400 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-470281eb-c829-4b8c-bab0-5ac773fb35a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab43dc3f37624278a3ef73f920613fe7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:36.197042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e3dce4b3-72e1-4d48-b0f6-59ab4c78aee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef78a31107374ae99f7885f0e62ad82f'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:36.212307 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-e3dce4b3-72e1-4d48-b0f6-59ab4c78aee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef78a31107374ae99f7885f0e62ad82f'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:36.221789 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-470281eb-c829-4b8c-bab0-5ac773fb35a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab43dc3f37624278a3ef73f920613fe7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:36.234361 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1345/2717] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:35 2022] DELETE /identity/v3/users/ef78a31107374ae99f7885f0e62ad82f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:36.234690 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-470281eb-c829-4b8c-bab0-5ac773fb35a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab43dc3f37624278a3ef73f920613fe7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:36.234690 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-470281eb-c829-4b8c-bab0-5ac773fb35a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab43dc3f37624278a3ef73f920613fe7'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:36.240671 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1373/2718] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:35 2022] DELETE /identity/v3/users/ab43dc3f37624278a3ef73f920613fe7 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:36.626765 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dce4b3-72e1-4d48-b0f6-59ab4c78aee7 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:36.631122 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e3dce4b3-72e1-4d48-b0f6-59ab4c78aee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:36.707493 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470281eb-c829-4b8c-bab0-5ac773fb35a3 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:36.710425 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-470281eb-c829-4b8c-bab0-5ac773fb35a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:36.803291 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dce4b3-72e1-4d48-b0f6-59ab4c78aee7 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:36.824564 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470281eb-c829-4b8c-bab0-5ac773fb35a3 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:36.830123 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d431a-b71a-4e43-abf8-a824904c0447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:36.830792 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d431a-b71a-4e43-abf8-a824904c0447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:36.831070 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d431a-b71a-4e43-abf8-a824904c0447 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:36.831344 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d431a-b71a-4e43-abf8-a824904c0447 admin admin] PATH_INFO: `/v3/projects/b816a03f74bc46d4912ebdb1877a2eb8` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:36.832642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d431a-b71a-4e43-abf8-a824904c0447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b816a03f74bc46d4912ebdb1877a2eb8)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:36.834668 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d431a-b71a-4e43-abf8-a824904c0447 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:36.888713 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:36.894486 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f5eb7-34ae-48c2-ba5d-5f3cd8d15da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:36.895594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f5eb7-34ae-48c2-ba5d-5f3cd8d15da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:36.896074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f5eb7-34ae-48c2-ba5d-5f3cd8d15da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:36.896444 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f5eb7-34ae-48c2-ba5d-5f3cd8d15da2 admin admin] PATH_INFO: `/v3/projects/7110fad8033349b9843c518010d6f2f7` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:36.898735 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f5eb7-34ae-48c2-ba5d-5f3cd8d15da2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7110fad8033349b9843c518010d6f2f7)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:36.902905 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f5eb7-34ae-48c2-ba5d-5f3cd8d15da2 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:36.917189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-426d431a-b71a-4e43-abf8-a824904c0447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b816a03f74bc46d4912ebdb1877a2eb8', 'request_id': 'req-426d431a-b71a-4e43-abf8-a824904c0447'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:36.930299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-426d431a-b71a-4e43-abf8-a824904c0447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b816a03f74bc46d4912ebdb1877a2eb8', 'request_id': 'req-426d431a-b71a-4e43-abf8-a824904c0447'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:36.941498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-426d431a-b71a-4e43-abf8-a824904c0447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b816a03f74bc46d4912ebdb1877a2eb8', 'request_id': 'req-426d431a-b71a-4e43-abf8-a824904c0447'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:36.960270 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-426d431a-b71a-4e43-abf8-a824904c0447 admin admin] The token cache is being invalidate because project b816a03f74bc46d4912ebdb1877a2eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:36.960855 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-426d431a-b71a-4e43-abf8-a824904c0447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:36.962274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-426d431a-b71a-4e43-abf8-a824904c0447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:36.966636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1374/2719] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:36 2022] DELETE /identity/v3/projects/b816a03f74bc46d4912ebdb1877a2eb8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:36.974914 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aaba38-2eae-4b7a-ad8c-d5ce70443a9d None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:36.975320 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aaba38-2eae-4b7a-ad8c-d5ce70443a9d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:36.975723 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aaba38-2eae-4b7a-ad8c-d5ce70443a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:36.990662 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-956f5eb7-34ae-48c2-ba5d-5f3cd8d15da2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7110fad8033349b9843c518010d6f2f7', 'request_id': 'req-956f5eb7-34ae-48c2-ba5d-5f3cd8d15da2'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:36.999242 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-956f5eb7-34ae-48c2-ba5d-5f3cd8d15da2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7110fad8033349b9843c518010d6f2f7', 'request_id': 'req-956f5eb7-34ae-48c2-ba5d-5f3cd8d15da2'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:37.000822 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-62aaba38-2eae-4b7a-ad8c-d5ce70443a9d None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:37.002447 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-62aaba38-2eae-4b7a-ad8c-d5ce70443a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:37.009620 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-956f5eb7-34ae-48c2-ba5d-5f3cd8d15da2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7110fad8033349b9843c518010d6f2f7', 'request_id': 'req-956f5eb7-34ae-48c2-ba5d-5f3cd8d15da2'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:37.031255 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-956f5eb7-34ae-48c2-ba5d-5f3cd8d15da2 admin admin] The token cache is being invalidate because project 7110fad8033349b9843c518010d6f2f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:37.031743 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-956f5eb7-34ae-48c2-ba5d-5f3cd8d15da2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:37.032761 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-956f5eb7-34ae-48c2-ba5d-5f3cd8d15da2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:37.034890 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1346/2720] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:36 2022] DELETE /identity/v3/projects/7110fad8033349b9843c518010d6f2f7 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:37.040689 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97bdea-c541-431a-9d03-89e4a3b62658 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:37.040975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97bdea-c541-431a-9d03-89e4a3b62658 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:37.041256 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97bdea-c541-431a-9d03-89e4a3b62658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:37.059709 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:37.066915 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-7b97bdea-c541-431a-9d03-89e4a3b62658 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:37.070505 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-7b97bdea-c541-431a-9d03-89e4a3b62658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:37.105284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1375/2721] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:37.113603 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810de89-ccc6-4ed8-a20c-3cc015fdb143 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:37.113899 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810de89-ccc6-4ed8-a20c-3cc015fdb143 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:37.114188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810de89-ccc6-4ed8-a20c-3cc015fdb143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:37.136032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-1810de89-ccc6-4ed8-a20c-3cc015fdb143 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:37.137893 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1810de89-ccc6-4ed8-a20c-3cc015fdb143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:37.152306 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1376/2722] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:37.154170 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810de89-ccc6-4ed8-a20c-3cc015fdb143 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:37.164653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810de89-ccc6-4ed8-a20c-3cc015fdb143 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:37.169497 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1347/2723] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:37.176553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca52bc7-3f10-47f8-8c43-6d58c1f41683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:37.176553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca52bc7-3f10-47f8-8c43-6d58c1f41683 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:37.176553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca52bc7-3f10-47f8-8c43-6d58c1f41683 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:37.176553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca52bc7-3f10-47f8-8c43-6d58c1f41683 admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:37.177055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca52bc7-3f10-47f8-8c43-6d58c1f41683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 00:00:37.177055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca52bc7-3f10-47f8-8c43-6d58c1f41683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:37.177055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca52bc7-3f10-47f8-8c43-6d58c1f41683 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:37.178736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf166df-b71b-414e-8e6c-37f92d9ade3e None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:37.179215 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf166df-b71b-414e-8e6c-37f92d9ade3e None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:37.179697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf166df-b71b-414e-8e6c-37f92d9ade3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:37.188571 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1377/2724] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Sep 13 00:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 00:00:37.193066 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca52bc7-3f10-47f8-8c43-6d58c1f41683 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:37.207785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca52bc7-3f10-47f8-8c43-6d58c1f41683 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:37.213859 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb3267-28de-473c-89ba-348665e37b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:37.214666 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb3267-28de-473c-89ba-348665e37b9a admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:37.215026 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb3267-28de-473c-89ba-348665e37b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:37.215360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb3267-28de-473c-89ba-348665e37b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:37.215630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-0bf166df-b71b-414e-8e6c-37f92d9ade3e None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:37.216493 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb3267-28de-473c-89ba-348665e37b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:37.217898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0bf166df-b71b-414e-8e6c-37f92d9ade3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:37.218837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb3267-28de-473c-89ba-348665e37b9a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:37.235417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1348/2725] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:37.237201 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf166df-b71b-414e-8e6c-37f92d9ade3e None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:37.255046 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf166df-b71b-414e-8e6c-37f92d9ade3e None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:37.261252 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1378/2726] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:37 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:00:37.262662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb3267-28de-473c-89ba-348665e37b9a admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:37.266625 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e7024-301e-4d4f-b386-768df0491c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:37.267616 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7024-301e-4d4f-b386-768df0491c45 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:37.268088 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7024-301e-4d4f-b386-768df0491c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:37.268519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e7024-301e-4d4f-b386-768df0491c45 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:37.269679 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e7024-301e-4d4f-b386-768df0491c45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 00:00:37.270189 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e7024-301e-4d4f-b386-768df0491c45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:37.273286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e7024-301e-4d4f-b386-768df0491c45 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:37.296406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1349/2727] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Sep 13 00:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 00:00:37.302645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e7024-301e-4d4f-b386-768df0491c45 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:37.322745 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e7024-301e-4d4f-b386-768df0491c45 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:37.362507 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb3267-28de-473c-89ba-348665e37b9a admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:37.369866 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77945467-d9d6-49dd-8648-a402404f5923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:37.370673 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77945467-d9d6-49dd-8648-a402404f5923 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:37.371073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77945467-d9d6-49dd-8648-a402404f5923 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:37.371548 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77945467-d9d6-49dd-8648-a402404f5923 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:37.372819 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77945467-d9d6-49dd-8648-a402404f5923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:37.376719 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77945467-d9d6-49dd-8648-a402404f5923 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:37.414616 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1379/2728] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:37 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:37.420361 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77945467-d9d6-49dd-8648-a402404f5923 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:37.434825 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d9f34-006f-4e37-8c6f-0f249e41e93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:37.435584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d9f34-006f-4e37-8c6f-0f249e41e93d admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:37.436004 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d9f34-006f-4e37-8c6f-0f249e41e93d admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:37.436483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d9f34-006f-4e37-8c6f-0f249e41e93d admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:37.437151 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d9f34-006f-4e37-8c6f-0f249e41e93d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:37.439274 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d9f34-006f-4e37-8c6f-0f249e41e93d admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:37.447293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77945467-d9d6-49dd-8648-a402404f5923 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:37.453052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66b040-fe86-4a3d-b392-add78ce0be26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:37.453947 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66b040-fe86-4a3d-b392-add78ce0be26 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:37.454379 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66b040-fe86-4a3d-b392-add78ce0be26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:37.455032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66b040-fe86-4a3d-b392-add78ce0be26 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:37.455877 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66b040-fe86-4a3d-b392-add78ce0be26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:37.457911 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66b040-fe86-4a3d-b392-add78ce0be26 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:37.459748 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:37.480088 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1380/2729] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:37.484240 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66b040-fe86-4a3d-b392-add78ce0be26 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:37.491405 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1350/2730] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:37 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:37.494051 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d9f34-006f-4e37-8c6f-0f249e41e93d admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:37.498945 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66b040-fe86-4a3d-b392-add78ce0be26 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:37.601099 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d2d52-5f9b-4611-8b0c-3f782d5ff614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:37.602219 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d2d52-5f9b-4611-8b0c-3f782d5ff614 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:37.602864 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d2d52-5f9b-4611-8b0c-3f782d5ff614 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:37.603236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d2d52-5f9b-4611-8b0c-3f782d5ff614 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:37.604083 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d2d52-5f9b-4611-8b0c-3f782d5ff614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:37.606909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d2d52-5f9b-4611-8b0c-3f782d5ff614 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:37.610823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d9f34-006f-4e37-8c6f-0f249e41e93d admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:37.617422 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749d140-7c28-45dd-a879-9f9d6bc15de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:37.618084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749d140-7c28-45dd-a879-9f9d6bc15de5 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:37.618506 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749d140-7c28-45dd-a879-9f9d6bc15de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:37.618698 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749d140-7c28-45dd-a879-9f9d6bc15de5 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:37.619338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749d140-7c28-45dd-a879-9f9d6bc15de5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:37.621629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749d140-7c28-45dd-a879-9f9d6bc15de5 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:37.625404 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1381/2731] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:37.634694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d2d52-5f9b-4611-8b0c-3f782d5ff614 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:37.650393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d2d52-5f9b-4611-8b0c-3f782d5ff614 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:37.651068 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1351/2732] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:37 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:37.656514 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65d928-a300-4fba-8722-4b762dcd57c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:37.657227 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65d928-a300-4fba-8722-4b762dcd57c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:37.657459 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749d140-7c28-45dd-a879-9f9d6bc15de5 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:37.658249 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65d928-a300-4fba-8722-4b762dcd57c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:37.658551 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65d928-a300-4fba-8722-4b762dcd57c8 admin admin] PATH_INFO: `/v3/projects/c2d6689373f941859a5230f0db22a8c9/users/742cd32bc6cc4ca78b599b294426b014/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:37.663359 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:37.673791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749d140-7c28-45dd-a879-9f9d6bc15de5 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:37.682914 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7760d-3d9e-4771-bc40-aba4ed25356e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:37.683995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7760d-3d9e-4771-bc40-aba4ed25356e admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:37.684479 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7760d-3d9e-4771-bc40-aba4ed25356e admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:37.684908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7760d-3d9e-4771-bc40-aba4ed25356e admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:37.686249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7760d-3d9e-4771-bc40-aba4ed25356e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:37.688504 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65d928-a300-4fba-8722-4b762dcd57c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d6689373f941859a5230f0db22a8c9, user_id=742cd32bc6cc4ca78b599b294426b014, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:37.689530 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7760d-3d9e-4771-bc40-aba4ed25356e admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:37.691768 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65d928-a300-4fba-8722-4b762dcd57c8 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:37.708425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1352/2733] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:37.712855 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7760d-3d9e-4771-bc40-aba4ed25356e admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:37.713605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1382/2734] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:37 2022] PUT /identity/v3/projects/c2d6689373f941859a5230f0db22a8c9/users/742cd32bc6cc4ca78b599b294426b014/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:37.724081 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7760d-3d9e-4771-bc40-aba4ed25356e admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:37.729451 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dab18-24af-42ef-9dc8-2c23ca03ec7f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:37.729868 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dab18-24af-42ef-9dc8-2c23ca03ec7f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:37.730820 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dab18-24af-42ef-9dc8-2c23ca03ec7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:37.794662 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-1a0dab18-24af-42ef-9dc8-2c23ca03ec7f None None] MFA Rules not processed for user `742cd32bc6cc4ca78b599b294426b014`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:37.797493 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-1a0dab18-24af-42ef-9dc8-2c23ca03ec7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:37.811805 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78893c64-c3c6-4521-912d-e7fa638285a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:37.812551 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78893c64-c3c6-4521-912d-e7fa638285a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:37.813089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78893c64-c3c6-4521-912d-e7fa638285a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:37.813236 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78893c64-c3c6-4521-912d-e7fa638285a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:37.813891 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78893c64-c3c6-4521-912d-e7fa638285a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:37.817679 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78893c64-c3c6-4521-912d-e7fa638285a9 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:37.844349 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1353/2735] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:37.845323 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78893c64-c3c6-4521-912d-e7fa638285a9 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:37.860673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78893c64-c3c6-4521-912d-e7fa638285a9 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:37.865758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939723dd-354c-4f97-ad5b-a6da28c41ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:37.866532 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939723dd-354c-4f97-ad5b-a6da28c41ece admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:37.867260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939723dd-354c-4f97-ad5b-a6da28c41ece admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:37.867260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939723dd-354c-4f97-ad5b-a6da28c41ece admin admin] PATH_INFO: `/v3/projects/54c5c6b60fd34cff924585858786f131/users/8e6fd67aab354bfb8ae086f3df859ce6/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:37.884195 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939723dd-354c-4f97-ad5b-a6da28c41ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c5c6b60fd34cff924585858786f131, user_id=8e6fd67aab354bfb8ae086f3df859ce6, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:37.886978 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939723dd-354c-4f97-ad5b-a6da28c41ece admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:37.905578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1354/2736] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:37 2022] PUT /identity/v3/projects/54c5c6b60fd34cff924585858786f131/users/8e6fd67aab354bfb8ae086f3df859ce6/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:37.917887 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5937a1d-e31f-434a-9ea3-35c4b46bf356 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:37.918920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5937a1d-e31f-434a-9ea3-35c4b46bf356 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:37.919314 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5937a1d-e31f-434a-9ea3-35c4b46bf356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:37.924504 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1383/2737] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:37.929645 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dab18-24af-42ef-9dc8-2c23ca03ec7f None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:37.947908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dab18-24af-42ef-9dc8-2c23ca03ec7f None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:37.953693 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-b5937a1d-e31f-434a-9ea3-35c4b46bf356 None None] MFA Rules not processed for user `8e6fd67aab354bfb8ae086f3df859ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:37.955227 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-b5937a1d-e31f-434a-9ea3-35c4b46bf356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:38.011565 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:38.024380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ba1b8-2d98-4aef-ba01-9aea1bba6b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:38.025509 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ba1b8-2d98-4aef-ba01-9aea1bba6b55 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:38.025997 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ba1b8-2d98-4aef-ba01-9aea1bba6b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:38.026457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ba1b8-2d98-4aef-ba01-9aea1bba6b55 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:38.027624 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ba1b8-2d98-4aef-ba01-9aea1bba6b55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:38.031557 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ba1b8-2d98-4aef-ba01-9aea1bba6b55 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:38.039133 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1355/2738] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:38.043837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5937a1d-e31f-434a-9ea3-35c4b46bf356 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:38.059598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5937a1d-e31f-434a-9ea3-35c4b46bf356 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:38.067556 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e2672-2679-4501-a5ea-a0b073072266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:38.068758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e2672-2679-4501-a5ea-a0b073072266 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:38.069279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e2672-2679-4501-a5ea-a0b073072266 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:38.069759 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e2672-2679-4501-a5ea-a0b073072266 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:38.070926 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e2672-2679-4501-a5ea-a0b073072266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:38.075032 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e2672-2679-4501-a5ea-a0b073072266 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:38.082403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1384/2739] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:37 2022] POST /identity/v3/projects => generated 389 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:00:38.083583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ba1b8-2d98-4aef-ba01-9aea1bba6b55 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:38.134525 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1356/2740] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:38 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:00:38.136246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e2672-2679-4501-a5ea-a0b073072266 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:38.188112 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ba1b8-2d98-4aef-ba01-9aea1bba6b55 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:38.196425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:38.267212 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e2672-2679-4501-a5ea-a0b073072266 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:38.273516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b13342-cb22-4bbb-9958-57189677fe47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:38.274458 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b13342-cb22-4bbb-9958-57189677fe47 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:38.275123 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b13342-cb22-4bbb-9958-57189677fe47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:38.275398 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b13342-cb22-4bbb-9958-57189677fe47 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:38.276571 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b13342-cb22-4bbb-9958-57189677fe47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:38.280074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b13342-cb22-4bbb-9958-57189677fe47 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:38.292024 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b362de-3ca2-4b42-9b6b-0eca45f3b558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:38.293023 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b362de-3ca2-4b42-9b6b-0eca45f3b558 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:38.293569 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b362de-3ca2-4b42-9b6b-0eca45f3b558 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:38.293977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b362de-3ca2-4b42-9b6b-0eca45f3b558 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:38.295048 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b362de-3ca2-4b42-9b6b-0eca45f3b558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:38.298959 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b362de-3ca2-4b42-9b6b-0eca45f3b558 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:38.313815 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1357/2741] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:38 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:38.320440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b13342-cb22-4bbb-9958-57189677fe47 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:38.337493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b13342-cb22-4bbb-9958-57189677fe47 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:38.342985 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1385/2742] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:38 2022] POST /identity/v3/users => generated 301 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:00:38.343230 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1db56c-524f-4ae8-9dc6-374de72e32cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:38.343540 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1db56c-524f-4ae8-9dc6-374de72e32cc admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:38.343827 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1db56c-524f-4ae8-9dc6-374de72e32cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:38.344098 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1db56c-524f-4ae8-9dc6-374de72e32cc admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:38.344796 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1db56c-524f-4ae8-9dc6-374de72e32cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:38.345119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b362de-3ca2-4b42-9b6b-0eca45f3b558 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:38.346685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1db56c-524f-4ae8-9dc6-374de72e32cc admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:38.358641 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1358/2743] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:38.359141 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b362de-3ca2-4b42-9b6b-0eca45f3b558 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:38.370254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1db56c-524f-4ae8-9dc6-374de72e32cc admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:38.370487 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2bddc-2b64-47c7-9e68-f1340e1369db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:38.371287 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2bddc-2b64-47c7-9e68-f1340e1369db admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:38.371749 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2bddc-2b64-47c7-9e68-f1340e1369db admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:38.372171 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2bddc-2b64-47c7-9e68-f1340e1369db admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:38.373153 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2bddc-2b64-47c7-9e68-f1340e1369db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:38.374923 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2bddc-2b64-47c7-9e68-f1340e1369db admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:38.381645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1db56c-524f-4ae8-9dc6-374de72e32cc admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:38.386814 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618791b5-3991-400c-ae94-f684e6eacb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:38.387438 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618791b5-3991-400c-ae94-f684e6eacb63 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:38.387717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618791b5-3991-400c-ae94-f684e6eacb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:38.387991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1386/2744] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:38.388129 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618791b5-3991-400c-ae94-f684e6eacb63 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:38.388647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618791b5-3991-400c-ae94-f684e6eacb63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:38.390440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618791b5-3991-400c-ae94-f684e6eacb63 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:38.394203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2bddc-2b64-47c7-9e68-f1340e1369db admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:38.402937 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1359/2745] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:38.408706 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2bddc-2b64-47c7-9e68-f1340e1369db admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:38.410427 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618791b5-3991-400c-ae94-f684e6eacb63 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:38.414717 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b476b-cd13-4964-a7df-b30898c4b0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:38.415067 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b476b-cd13-4964-a7df-b30898c4b0d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:38.415206 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b476b-cd13-4964-a7df-b30898c4b0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:38.415484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b476b-cd13-4964-a7df-b30898c4b0d7 admin admin] PATH_INFO: `/v3/projects/9cd64c5fb9c44c1e9cc29bc563ac6096/users/a73534562f384e4da726708f050378d0/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:38.426491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618791b5-3991-400c-ae94-f684e6eacb63 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:38.441124 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ec70b-e95a-4290-8600-56cec57c5a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:38.441442 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b476b-cd13-4964-a7df-b30898c4b0d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd64c5fb9c44c1e9cc29bc563ac6096, user_id=a73534562f384e4da726708f050378d0, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:38.442224 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ec70b-e95a-4290-8600-56cec57c5a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:38.442883 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ec70b-e95a-4290-8600-56cec57c5a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:38.443338 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ec70b-e95a-4290-8600-56cec57c5a9a admin admin] PATH_INFO: `/v3/projects/dc6e9b140c0047b685d112499e5eb178/users/fec475248fde41a6bee3c10e2d1dbdc6/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:38.445068 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b476b-cd13-4964-a7df-b30898c4b0d7 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:38.463927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1387/2746] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:38 2022] PUT /identity/v3/projects/9cd64c5fb9c44c1e9cc29bc563ac6096/users/a73534562f384e4da726708f050378d0/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:38.468329 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ec70b-e95a-4290-8600-56cec57c5a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6e9b140c0047b685d112499e5eb178, user_id=fec475248fde41a6bee3c10e2d1dbdc6, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:38.468927 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b476b-cd13-4964-a7df-b30898c4b0d7 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:38.471738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ec70b-e95a-4290-8600-56cec57c5a9a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:38.496152 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1360/2747] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:38 2022] PUT /identity/v3/projects/dc6e9b140c0047b685d112499e5eb178/users/fec475248fde41a6bee3c10e2d1dbdc6/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:38.514473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40fe94-17c5-4327-a69c-87ec714d8f76 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:38.514922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40fe94-17c5-4327-a69c-87ec714d8f76 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:38.515353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40fe94-17c5-4327-a69c-87ec714d8f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:38.555879 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:38.562056 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-db40fe94-17c5-4327-a69c-87ec714d8f76 None None] MFA Rules not processed for user `fec475248fde41a6bee3c10e2d1dbdc6`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:38.563811 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-db40fe94-17c5-4327-a69c-87ec714d8f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:38.580488 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b476b-cd13-4964-a7df-b30898c4b0d7 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:38.669129 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1361/2748] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:38.672939 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b83cf-2c75-4f87-ab97-22cf0654ceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:38.673634 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b83cf-2c75-4f87-ab97-22cf0654ceae admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:38.673915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b83cf-2c75-4f87-ab97-22cf0654ceae admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:38.674189 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b83cf-2c75-4f87-ab97-22cf0654ceae admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:38.674928 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b83cf-2c75-4f87-ab97-22cf0654ceae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:38.675048 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40fe94-17c5-4327-a69c-87ec714d8f76 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:38.676695 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b83cf-2c75-4f87-ab97-22cf0654ceae admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:38.687558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40fe94-17c5-4327-a69c-87ec714d8f76 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:38.689064 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1388/2749] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:38.692873 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384f295-63e9-4aaa-8a69-e1fd9fb951e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:38.693521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384f295-63e9-4aaa-8a69-e1fd9fb951e9 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:38.693801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384f295-63e9-4aaa-8a69-e1fd9fb951e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:38.694082 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384f295-63e9-4aaa-8a69-e1fd9fb951e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:38.694792 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384f295-63e9-4aaa-8a69-e1fd9fb951e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:38.695516 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b83cf-2c75-4f87-ab97-22cf0654ceae admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:38.696791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384f295-63e9-4aaa-8a69-e1fd9fb951e9 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:38.710649 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b83cf-2c75-4f87-ab97-22cf0654ceae admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:38.719202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6c9f0-52aa-4c5d-a87b-8bf0616795e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:38.719889 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6c9f0-52aa-4c5d-a87b-8bf0616795e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:38.720742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6c9f0-52aa-4c5d-a87b-8bf0616795e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:38.721022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6c9f0-52aa-4c5d-a87b-8bf0616795e1 admin admin] PATH_INFO: `/v3/projects/9cd64c5fb9c44c1e9cc29bc563ac6096/users/a73534562f384e4da726708f050378d0/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:38.723163 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6c9f0-52aa-4c5d-a87b-8bf0616795e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd64c5fb9c44c1e9cc29bc563ac6096, user_id=a73534562f384e4da726708f050378d0, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:38.725948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6c9f0-52aa-4c5d-a87b-8bf0616795e1 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:38.739042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1389/2750] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:38 2022] PUT /identity/v3/projects/9cd64c5fb9c44c1e9cc29bc563ac6096/users/a73534562f384e4da726708f050378d0/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:38.743596 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1362/2751] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:38 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:38.748820 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6c9f0-52aa-4c5d-a87b-8bf0616795e1 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:38.815784 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddabade-a924-4185-b11e-382ab9768ab2 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:38.816630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddabade-a924-4185-b11e-382ab9768ab2 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:38.816630 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddabade-a924-4185-b11e-382ab9768ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:38.857364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-dddabade-a924-4185-b11e-382ab9768ab2 None None] MFA Rules not processed for user `a73534562f384e4da726708f050378d0`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:38.859140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-dddabade-a924-4185-b11e-382ab9768ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:38.879947 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6c9f0-52aa-4c5d-a87b-8bf0616795e1 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:38.910138 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:38.981515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1363/2752] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:38 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:38.991261 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d209f-ede5-466e-80fd-afaad147b474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:38.992334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d209f-ede5-466e-80fd-afaad147b474 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:38.992811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d209f-ede5-466e-80fd-afaad147b474 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:38.993293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d209f-ede5-466e-80fd-afaad147b474 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:38.993433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddabade-a924-4185-b11e-382ab9768ab2 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:38.994570 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d209f-ede5-466e-80fd-afaad147b474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:38.995790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-dddabade-a924-4185-b11e-382ab9768ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:38.999499 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d209f-ede5-466e-80fd-afaad147b474 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:39.033097 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1390/2753] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:38 2022] POST /identity/v3/users => generated 296 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:00:39.038674 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d209f-ede5-466e-80fd-afaad147b474 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:39.060181 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d209f-ede5-466e-80fd-afaad147b474 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:39.068655 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eeb828-5d00-444c-b4cd-0fbf678e3ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:39.069875 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eeb828-5d00-444c-b4cd-0fbf678e3ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:39.070354 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eeb828-5d00-444c-b4cd-0fbf678e3ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:39.070845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eeb828-5d00-444c-b4cd-0fbf678e3ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:39.072091 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eeb828-5d00-444c-b4cd-0fbf678e3ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:39.075343 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eeb828-5d00-444c-b4cd-0fbf678e3ab0 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:39.086479 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:39.088419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddabade-a924-4185-b11e-382ab9768ab2 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:39.093619 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a6f14-2fdd-4600-a20a-8f0269689827 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:39.094427 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6f14-2fdd-4600-a20a-8f0269689827 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:39.094780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6f14-2fdd-4600-a20a-8f0269689827 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:39.095085 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6f14-2fdd-4600-a20a-8f0269689827 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:39.100872 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1391/2754] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:39.102055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eeb828-5d00-444c-b4cd-0fbf678e3ab0 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:39.108776 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a6f14-2fdd-4600-a20a-8f0269689827 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:39.111602 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a6f14-2fdd-4600-a20a-8f0269689827 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:39.122107 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eeb828-5d00-444c-b4cd-0fbf678e3ab0 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:39.129865 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e0eda-5b10-4463-9f3e-e52958824e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:39.130640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1364/2755] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:38 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:39.131060 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e0eda-5b10-4463-9f3e-e52958824e0c admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:39.131392 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e0eda-5b10-4463-9f3e-e52958824e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:39.131937 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e0eda-5b10-4463-9f3e-e52958824e0c admin admin] PATH_INFO: `/v3/projects/3ee1c50ec8704323b3867894c50692e1/users/086c7a256dca42779812847d46f52d29/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:39.157599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e0eda-5b10-4463-9f3e-e52958824e0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee1c50ec8704323b3867894c50692e1, user_id=086c7a256dca42779812847d46f52d29, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:39.160838 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e0eda-5b10-4463-9f3e-e52958824e0c admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:39.195021 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1392/2756] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:39 2022] PUT /identity/v3/projects/3ee1c50ec8704323b3867894c50692e1/users/086c7a256dca42779812847d46f52d29/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:39.195574 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a6f14-2fdd-4600-a20a-8f0269689827 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:39.218228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a6f14-2fdd-4600-a20a-8f0269689827 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:39.336966 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f747f-0377-42c7-b8ae-dd8d6c01bc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:39.337765 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f747f-0377-42c7-b8ae-dd8d6c01bc7f admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:39.338067 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f747f-0377-42c7-b8ae-dd8d6c01bc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:39.338392 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f747f-0377-42c7-b8ae-dd8d6c01bc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:39.339143 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f747f-0377-42c7-b8ae-dd8d6c01bc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:39.341072 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f747f-0377-42c7-b8ae-dd8d6c01bc7f admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:39.348474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e0eda-5b10-4463-9f3e-e52958824e0c admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:39.358033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1365/2757] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:39.359865 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e0eda-5b10-4463-9f3e-e52958824e0c admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:39.364713 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7856283-c273-4d68-b08c-859e23512070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:39.365403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7856283-c273-4d68-b08c-859e23512070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:39.365558 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f747f-0377-42c7-b8ae-dd8d6c01bc7f admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:39.365737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7856283-c273-4d68-b08c-859e23512070 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:39.365944 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7856283-c273-4d68-b08c-859e23512070 admin admin] PATH_INFO: `/v3/users/742cd32bc6cc4ca78b599b294426b014` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:39.367123 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7856283-c273-4d68-b08c-859e23512070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=742cd32bc6cc4ca78b599b294426b014)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:39.369108 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7856283-c273-4d68-b08c-859e23512070 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:39.381702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f747f-0377-42c7-b8ae-dd8d6c01bc7f admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:39.389914 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b0f7f-95e5-4ff3-85eb-882989fb64c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:39.390633 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0f7f-95e5-4ff3-85eb-882989fb64c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:39.390908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0f7f-95e5-4ff3-85eb-882989fb64c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:39.391907 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0f7f-95e5-4ff3-85eb-882989fb64c1 admin admin] PATH_INFO: `/v3/projects/3ee1c50ec8704323b3867894c50692e1/users/086c7a256dca42779812847d46f52d29/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:39.394186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b0f7f-95e5-4ff3-85eb-882989fb64c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee1c50ec8704323b3867894c50692e1, user_id=086c7a256dca42779812847d46f52d29, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:39.396993 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b0f7f-95e5-4ff3-85eb-882989fb64c1 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:39.410116 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1366/2758] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:39 2022] PUT /identity/v3/projects/3ee1c50ec8704323b3867894c50692e1/users/086c7a256dca42779812847d46f52d29/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:39.428431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8182e1-4071-47cc-a6d1-cca7e98e61e4 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:39.428711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8182e1-4071-47cc-a6d1-cca7e98e61e4 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:39.428948 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8182e1-4071-47cc-a6d1-cca7e98e61e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:39.461554 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f7856283-c273-4d68-b08c-859e23512070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742cd32bc6cc4ca78b599b294426b014'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:39.463515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-ff8182e1-4071-47cc-a6d1-cca7e98e61e4 None None] MFA Rules not processed for user `086c7a256dca42779812847d46f52d29`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:39.466093 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ff8182e1-4071-47cc-a6d1-cca7e98e61e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:39.470996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f7856283-c273-4d68-b08c-859e23512070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742cd32bc6cc4ca78b599b294426b014'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:39.491213 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f7856283-c273-4d68-b08c-859e23512070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742cd32bc6cc4ca78b599b294426b014'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:39.504356 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f7856283-c273-4d68-b08c-859e23512070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742cd32bc6cc4ca78b599b294426b014'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:39.505053 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-f7856283-c273-4d68-b08c-859e23512070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742cd32bc6cc4ca78b599b294426b014'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:39.513208 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1393/2759] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:39 2022] DELETE /identity/v3/users/742cd32bc6cc4ca78b599b294426b014 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:39.519988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11228a-1dfb-4c22-a1c5-f5bbb59b907d None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:39.520430 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11228a-1dfb-4c22-a1c5-f5bbb59b907d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:39.521003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11228a-1dfb-4c22-a1c5-f5bbb59b907d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:39.541434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:39.545228 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-be11228a-1dfb-4c22-a1c5-f5bbb59b907d None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:39.547512 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-be11228a-1dfb-4c22-a1c5-f5bbb59b907d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:39.595415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1367/2760] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:39.618228 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8182e1-4071-47cc-a6d1-cca7e98e61e4 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:39.620637 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ff8182e1-4071-47cc-a6d1-cca7e98e61e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:39.647482 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1394/2761] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:39.659412 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11228a-1dfb-4c22-a1c5-f5bbb59b907d None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:39.661926 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-be11228a-1dfb-4c22-a1c5-f5bbb59b907d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:39.716615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8182e1-4071-47cc-a6d1-cca7e98e61e4 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:39.740502 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:39.748977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11228a-1dfb-4c22-a1c5-f5bbb59b907d None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:39.755078 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2282cd-eb73-4aca-b7a7-6795bcc28fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:39.755988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2282cd-eb73-4aca-b7a7-6795bcc28fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:39.756897 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2282cd-eb73-4aca-b7a7-6795bcc28fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:39.757184 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2282cd-eb73-4aca-b7a7-6795bcc28fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:39.772185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2282cd-eb73-4aca-b7a7-6795bcc28fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:39.775121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2282cd-eb73-4aca-b7a7-6795bcc28fc6 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:39.792008 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1395/2762] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 00:00:39.809093 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62c81f-61ba-466c-8767-3b94142677e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:39.810098 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c81f-61ba-466c-8767-3b94142677e5 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:39.810492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c81f-61ba-466c-8767-3b94142677e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:39.810898 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c81f-61ba-466c-8767-3b94142677e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:39.926177 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62c81f-61ba-466c-8767-3b94142677e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:39.927666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62c81f-61ba-466c-8767-3b94142677e5 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:39.943052 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1368/2763] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 00:00:40.006296 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2282cd-eb73-4aca-b7a7-6795bcc28fc6 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:40.032960 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2282cd-eb73-4aca-b7a7-6795bcc28fc6 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:40.039713 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5a17d-d896-4e16-8a4b-4bb84257e29a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:40.041812 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5a17d-d896-4e16-8a4b-4bb84257e29a service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:40.042505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5a17d-d896-4e16-8a4b-4bb84257e29a service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:40.042974 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5a17d-d896-4e16-8a4b-4bb84257e29a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:40.048460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-bfa5a17d-d896-4e16-8a4b-4bb84257e29a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:40.151597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5a17d-d896-4e16-8a4b-4bb84257e29a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:40.153218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5a17d-d896-4e16-8a4b-4bb84257e29a service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:40.164271 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1396/2764] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 00:00:40.265065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62c81f-61ba-466c-8767-3b94142677e5 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:40.267673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-5e62c81f-61ba-466c-8767-3b94142677e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:40.301303 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62c81f-61ba-466c-8767-3b94142677e5 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:40.311094 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fac344-5878-45ab-8889-17ef89d0a735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:40.312276 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fac344-5878-45ab-8889-17ef89d0a735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:40.312736 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fac344-5878-45ab-8889-17ef89d0a735 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:40.313085 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fac344-5878-45ab-8889-17ef89d0a735 admin admin] PATH_INFO: `/v3/projects/c2d6689373f941859a5230f0db22a8c9` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:40.316020 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fac344-5878-45ab-8889-17ef89d0a735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d6689373f941859a5230f0db22a8c9)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:40.320096 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fac344-5878-45ab-8889-17ef89d0a735 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:40.402370 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:40.416102 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-01fac344-5878-45ab-8889-17ef89d0a735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d6689373f941859a5230f0db22a8c9', 'request_id': 'req-01fac344-5878-45ab-8889-17ef89d0a735'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:40.426798 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-01fac344-5878-45ab-8889-17ef89d0a735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d6689373f941859a5230f0db22a8c9', 'request_id': 'req-01fac344-5878-45ab-8889-17ef89d0a735'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:40.444515 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-01fac344-5878-45ab-8889-17ef89d0a735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d6689373f941859a5230f0db22a8c9', 'request_id': 'req-01fac344-5878-45ab-8889-17ef89d0a735'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:40.461850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-01fac344-5878-45ab-8889-17ef89d0a735 admin admin] The token cache is being invalidate because project c2d6689373f941859a5230f0db22a8c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:40.462380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-01fac344-5878-45ab-8889-17ef89d0a735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:40.463465 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-01fac344-5878-45ab-8889-17ef89d0a735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:40.466149 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1369/2765] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:40 2022] DELETE /identity/v3/projects/c2d6689373f941859a5230f0db22a8c9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:40.471129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5a17d-d896-4e16-8a4b-4bb84257e29a service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:40.486173 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5a17d-d896-4e16-8a4b-4bb84257e29a service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:40.568646 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee0617-7a08-4c2b-8b48-7304b33b48b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:40.569632 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee0617-7a08-4c2b-8b48-7304b33b48b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:40.570041 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee0617-7a08-4c2b-8b48-7304b33b48b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:40.570567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee0617-7a08-4c2b-8b48-7304b33b48b5 admin admin] PATH_INFO: `/v3/users/a73534562f384e4da726708f050378d0` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:40.572540 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee0617-7a08-4c2b-8b48-7304b33b48b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73534562f384e4da726708f050378d0)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:40.576326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee0617-7a08-4c2b-8b48-7304b33b48b5 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:40.674140 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-67ee0617-7a08-4c2b-8b48-7304b33b48b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73534562f384e4da726708f050378d0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:40.683521 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-67ee0617-7a08-4c2b-8b48-7304b33b48b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73534562f384e4da726708f050378d0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:40.699205 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-67ee0617-7a08-4c2b-8b48-7304b33b48b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73534562f384e4da726708f050378d0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:40.719121 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-67ee0617-7a08-4c2b-8b48-7304b33b48b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73534562f384e4da726708f050378d0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:40.719926 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-67ee0617-7a08-4c2b-8b48-7304b33b48b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73534562f384e4da726708f050378d0'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:40.731431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1397/2766] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:40 2022] DELETE /identity/v3/users/a73534562f384e4da726708f050378d0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:41.171167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fac344-5878-45ab-8889-17ef89d0a735 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:41.176380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-01fac344-5878-45ab-8889-17ef89d0a735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:41.203191 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fac344-5878-45ab-8889-17ef89d0a735 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:41.285213 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609687b-ec88-4f28-8c09-970642840ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:41.286276 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609687b-ec88-4f28-8c09-970642840ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:41.286639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609687b-ec88-4f28-8c09-970642840ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:41.286952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609687b-ec88-4f28-8c09-970642840ef4 admin admin] PATH_INFO: `/v3/projects/9cd64c5fb9c44c1e9cc29bc563ac6096` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:41.288351 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609687b-ec88-4f28-8c09-970642840ef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd64c5fb9c44c1e9cc29bc563ac6096)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:41.290836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609687b-ec88-4f28-8c09-970642840ef4 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:41.348435 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-4609687b-ec88-4f28-8c09-970642840ef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd64c5fb9c44c1e9cc29bc563ac6096', 'request_id': 'req-4609687b-ec88-4f28-8c09-970642840ef4'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:41.355386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-4609687b-ec88-4f28-8c09-970642840ef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd64c5fb9c44c1e9cc29bc563ac6096', 'request_id': 'req-4609687b-ec88-4f28-8c09-970642840ef4'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:41.366158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-4609687b-ec88-4f28-8c09-970642840ef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd64c5fb9c44c1e9cc29bc563ac6096', 'request_id': 'req-4609687b-ec88-4f28-8c09-970642840ef4'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:41.380440 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-4609687b-ec88-4f28-8c09-970642840ef4 admin admin] The token cache is being invalidate because project 9cd64c5fb9c44c1e9cc29bc563ac6096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:41.380737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-4609687b-ec88-4f28-8c09-970642840ef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:41.381471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-4609687b-ec88-4f28-8c09-970642840ef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:41.383022 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1370/2767] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:41 2022] DELETE /identity/v3/projects/9cd64c5fb9c44c1e9cc29bc563ac6096 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:41.388180 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d917ac-2340-443f-8508-e8721dc74dcc None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:41.388738 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d917ac-2340-443f-8508-e8721dc74dcc None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:41.388738 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d917ac-2340-443f-8508-e8721dc74dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:41.415722 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-58d917ac-2340-443f-8508-e8721dc74dcc None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:41.417745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-58d917ac-2340-443f-8508-e8721dc74dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:41.423780 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:41.519886 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1398/2768] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:41.532423 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28067dbe-55f4-4c1f-a79f-b227e0be1847 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:41.532713 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28067dbe-55f4-4c1f-a79f-b227e0be1847 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:41.532971 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28067dbe-55f4-4c1f-a79f-b227e0be1847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:41.556141 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-28067dbe-55f4-4c1f-a79f-b227e0be1847 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:41.557297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-28067dbe-55f4-4c1f-a79f-b227e0be1847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:41.566767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1371/2769] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:41.571985 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d917ac-2340-443f-8508-e8721dc74dcc None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:41.583103 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d917ac-2340-443f-8508-e8721dc74dcc None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:41.590059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73407f9f-7b79-4078-a04f-a49707e41a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:41.590718 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73407f9f-7b79-4078-a04f-a49707e41a2f admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:41.590999 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73407f9f-7b79-4078-a04f-a49707e41a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:41.591269 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73407f9f-7b79-4078-a04f-a49707e41a2f admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:41.591996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73407f9f-7b79-4078-a04f-a49707e41a2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 00:00:41.592306 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73407f9f-7b79-4078-a04f-a49707e41a2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:41.594006 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73407f9f-7b79-4078-a04f-a49707e41a2f admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:41.607410 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1399/2770] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Sep 13 00:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 00:00:41.612250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28067dbe-55f4-4c1f-a79f-b227e0be1847 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:41.622931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28067dbe-55f4-4c1f-a79f-b227e0be1847 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:41.628448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00750b71-4cd8-442a-a5e0-9958b7bdce88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:41.629291 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00750b71-4cd8-442a-a5e0-9958b7bdce88 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:41.629744 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00750b71-4cd8-442a-a5e0-9958b7bdce88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:41.630051 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00750b71-4cd8-442a-a5e0-9958b7bdce88 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:41.630733 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00750b71-4cd8-442a-a5e0-9958b7bdce88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:41.633666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00750b71-4cd8-442a-a5e0-9958b7bdce88 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:41.669897 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1372/2771] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:41 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:00:41.675461 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73407f9f-7b79-4078-a04f-a49707e41a2f admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:41.698155 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73407f9f-7b79-4078-a04f-a49707e41a2f admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:41.802081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648fc82-9ad2-4b99-9deb-97c791cdfe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:41.803345 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648fc82-9ad2-4b99-9deb-97c791cdfe23 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:41.803872 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648fc82-9ad2-4b99-9deb-97c791cdfe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:41.804339 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648fc82-9ad2-4b99-9deb-97c791cdfe23 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:41.805582 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648fc82-9ad2-4b99-9deb-97c791cdfe23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:41.808760 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648fc82-9ad2-4b99-9deb-97c791cdfe23 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:41.843934 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1400/2772] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:41 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:41.847048 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00750b71-4cd8-442a-a5e0-9958b7bdce88 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:41.859753 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00750b71-4cd8-442a-a5e0-9958b7bdce88 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:41.872505 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b1f81-f0fb-4b57-a85a-2c59ef9bb4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:41.874323 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b1f81-f0fb-4b57-a85a-2c59ef9bb4ba admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:41.875082 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b1f81-f0fb-4b57-a85a-2c59ef9bb4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:41.875419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b1f81-f0fb-4b57-a85a-2c59ef9bb4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:41.876640 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b1f81-f0fb-4b57-a85a-2c59ef9bb4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:41.878737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b1f81-f0fb-4b57-a85a-2c59ef9bb4ba admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:41.892695 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1373/2773] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:41.898055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648fc82-9ad2-4b99-9deb-97c791cdfe23 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:41.909965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648fc82-9ad2-4b99-9deb-97c791cdfe23 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:41.921375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a3a4e-3672-42f5-90b0-4f16b283ff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:41.921375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a3a4e-3672-42f5-90b0-4f16b283ff77 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:41.921375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a3a4e-3672-42f5-90b0-4f16b283ff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:41.921375 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a3a4e-3672-42f5-90b0-4f16b283ff77 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:41.922642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a3a4e-3672-42f5-90b0-4f16b283ff77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:41.922642 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a3a4e-3672-42f5-90b0-4f16b283ff77 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:41.932124 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1401/2774] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:41.937056 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b1f81-f0fb-4b57-a85a-2c59ef9bb4ba admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:41.950265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b1f81-f0fb-4b57-a85a-2c59ef9bb4ba admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:41.957564 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968a8d5-7da2-4d23-ae1d-bb9f311b4471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:41.958758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968a8d5-7da2-4d23-ae1d-bb9f311b4471 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:41.959276 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968a8d5-7da2-4d23-ae1d-bb9f311b4471 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:41.959778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968a8d5-7da2-4d23-ae1d-bb9f311b4471 admin admin] PATH_INFO: `/v3/projects/aa3c9f3c1e084f06b48e05cedecc7d97/users/fa06eb3edf86410da127b2626da5ec1d/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:41.991457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968a8d5-7da2-4d23-ae1d-bb9f311b4471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3c9f3c1e084f06b48e05cedecc7d97, user_id=fa06eb3edf86410da127b2626da5ec1d, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:41.995732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968a8d5-7da2-4d23-ae1d-bb9f311b4471 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:42.000157 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:42.021425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1374/2775] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:41 2022] PUT /identity/v3/projects/aa3c9f3c1e084f06b48e05cedecc7d97/users/fa06eb3edf86410da127b2626da5ec1d/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:42.035357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d39e9-7cb3-4929-beeb-b5ee2069168d None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:42.035785 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d39e9-7cb3-4929-beeb-b5ee2069168d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:42.036223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d39e9-7cb3-4929-beeb-b5ee2069168d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:42.080036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-7a0d39e9-7cb3-4929-beeb-b5ee2069168d None None] MFA Rules not processed for user `fa06eb3edf86410da127b2626da5ec1d`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:42.081700 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-7a0d39e9-7cb3-4929-beeb-b5ee2069168d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:42.188907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1402/2776] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:42.194751 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968a8d5-7da2-4d23-ae1d-bb9f311b4471 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:42.313785 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968a8d5-7da2-4d23-ae1d-bb9f311b4471 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:42.320351 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0de09c-0f7c-4149-ae20-a430ada1d461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:42.320995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0de09c-0f7c-4149-ae20-a430ada1d461 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:42.321307 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0de09c-0f7c-4149-ae20-a430ada1d461 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:42.321611 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0de09c-0f7c-4149-ae20-a430ada1d461 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:42.322267 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0de09c-0f7c-4149-ae20-a430ada1d461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:42.324232 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0de09c-0f7c-4149-ae20-a430ada1d461 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:42.355544 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1375/2777] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:42 2022] POST /identity/v3/projects => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:42.361278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d39e9-7cb3-4929-beeb-b5ee2069168d None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:42.372097 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:42.378212 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d39e9-7cb3-4929-beeb-b5ee2069168d None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:42.459544 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a806b-746e-479b-a635-8c8f553b7bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:42.460325 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a806b-746e-479b-a635-8c8f553b7bdb admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:42.460466 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a806b-746e-479b-a635-8c8f553b7bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:42.460731 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a806b-746e-479b-a635-8c8f553b7bdb admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:42.461423 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a806b-746e-479b-a635-8c8f553b7bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:42.463399 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a806b-746e-479b-a635-8c8f553b7bdb admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:42.488345 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1403/2778] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:42 2022] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:42.492832 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0de09c-0f7c-4149-ae20-a430ada1d461 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:42.504738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0de09c-0f7c-4149-ae20-a430ada1d461 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:42.512711 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c01dae-ecd5-4de0-82ae-4b7331e146d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:42.514434 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c01dae-ecd5-4de0-82ae-4b7331e146d9 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:42.515231 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c01dae-ecd5-4de0-82ae-4b7331e146d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:42.515958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c01dae-ecd5-4de0-82ae-4b7331e146d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:42.517277 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c01dae-ecd5-4de0-82ae-4b7331e146d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:42.520433 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c01dae-ecd5-4de0-82ae-4b7331e146d9 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:42.536442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1376/2779] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:42.541450 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a806b-746e-479b-a635-8c8f553b7bdb admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:42.553318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a806b-746e-479b-a635-8c8f553b7bdb admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:42.559649 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6226ad-16ee-4bd8-b96f-5b1c56c16825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:42.560768 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6226ad-16ee-4bd8-b96f-5b1c56c16825 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:42.561253 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6226ad-16ee-4bd8-b96f-5b1c56c16825 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:42.561729 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6226ad-16ee-4bd8-b96f-5b1c56c16825 admin admin] PATH_INFO: `/v3/projects/3a504e73a9aa44a798d3648854214c21/users/71fd76a651a04f1793cc787cad7b5b34/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:42.580514 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6226ad-16ee-4bd8-b96f-5b1c56c16825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a504e73a9aa44a798d3648854214c21, user_id=71fd76a651a04f1793cc787cad7b5b34, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:42.583270 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6226ad-16ee-4bd8-b96f-5b1c56c16825 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:42.599896 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1404/2780] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:42 2022] PUT /identity/v3/projects/3a504e73a9aa44a798d3648854214c21/users/71fd76a651a04f1793cc787cad7b5b34/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:42.604593 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c01dae-ecd5-4de0-82ae-4b7331e146d9 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:42.618245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c01dae-ecd5-4de0-82ae-4b7331e146d9 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:42.721017 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f7972-c481-43f6-9c3e-a029c1223581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:42.722104 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f7972-c481-43f6-9c3e-a029c1223581 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:42.722512 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f7972-c481-43f6-9c3e-a029c1223581 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:42.723000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f7972-c481-43f6-9c3e-a029c1223581 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:42.724291 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f7972-c481-43f6-9c3e-a029c1223581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:42.727275 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f7972-c481-43f6-9c3e-a029c1223581 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:42.745787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1377/2781] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:42.751117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6226ad-16ee-4bd8-b96f-5b1c56c16825 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:42.764360 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6226ad-16ee-4bd8-b96f-5b1c56c16825 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:42.771555 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a811bd-2fcb-4374-9517-ea5680a4fe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:42.772789 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a811bd-2fcb-4374-9517-ea5680a4fe2a admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:42.773131 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a811bd-2fcb-4374-9517-ea5680a4fe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:42.773592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a811bd-2fcb-4374-9517-ea5680a4fe2a admin admin] PATH_INFO: `/v3/projects/3a504e73a9aa44a798d3648854214c21/users/71fd76a651a04f1793cc787cad7b5b34/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:42.776094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a811bd-2fcb-4374-9517-ea5680a4fe2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a504e73a9aa44a798d3648854214c21, user_id=71fd76a651a04f1793cc787cad7b5b34, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:42.779002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a811bd-2fcb-4374-9517-ea5680a4fe2a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:42.791932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1405/2782] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:42 2022] PUT /identity/v3/projects/3a504e73a9aa44a798d3648854214c21/users/71fd76a651a04f1793cc787cad7b5b34/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:42.803733 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebef9c-d513-453f-b44f-5c20bc4d4ff3 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:42.803981 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebef9c-d513-453f-b44f-5c20bc4d4ff3 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:42.804273 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebef9c-d513-453f-b44f-5c20bc4d4ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:42.849161 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-00ebef9c-d513-453f-b44f-5c20bc4d4ff3 None None] MFA Rules not processed for user `71fd76a651a04f1793cc787cad7b5b34`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:42.851239 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-00ebef9c-d513-453f-b44f-5c20bc4d4ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:42.934692 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:42.957581 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1378/2783] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:42.970795 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a811bd-2fcb-4374-9517-ea5680a4fe2a admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:42.973333 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c8a811bd-2fcb-4374-9517-ea5680a4fe2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:43.049455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a811bd-2fcb-4374-9517-ea5680a4fe2a admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:43.053581 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d0591-853c-4f29-92ec-dbf22575f75d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:43.054251 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d0591-853c-4f29-92ec-dbf22575f75d service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:43.054547 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d0591-853c-4f29-92ec-dbf22575f75d service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:43.054818 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d0591-853c-4f29-92ec-dbf22575f75d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:43.065380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d0591-853c-4f29-92ec-dbf22575f75d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:43.066861 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d0591-853c-4f29-92ec-dbf22575f75d service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:43.078330 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1406/2784] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:43.182246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebef9c-d513-453f-b44f-5c20bc4d4ff3 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:43.197584 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebef9c-d513-453f-b44f-5c20bc4d4ff3 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:43.201589 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bba0e-359b-4faa-b8d7-e69d0ff43da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:43.202221 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bba0e-359b-4faa-b8d7-e69d0ff43da2 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:43.202501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bba0e-359b-4faa-b8d7-e69d0ff43da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:43.202790 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bba0e-359b-4faa-b8d7-e69d0ff43da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:43.288519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bba0e-359b-4faa-b8d7-e69d0ff43da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:43.290104 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bba0e-359b-4faa-b8d7-e69d0ff43da2 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:43.301045 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1379/2785] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:43.459737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d0591-853c-4f29-92ec-dbf22575f75d service cinder] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:43.461197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-006d0591-853c-4f29-92ec-dbf22575f75d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:43.562032 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d0591-853c-4f29-92ec-dbf22575f75d service cinder] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:43.567501 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93331a10-7a47-4452-98a3-4c644c84111b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:43.568213 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93331a10-7a47-4452-98a3-4c644c84111b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:43.568467 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93331a10-7a47-4452-98a3-4c644c84111b admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:43.568737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93331a10-7a47-4452-98a3-4c644c84111b admin admin] PATH_INFO: `/v3/users/8e6fd67aab354bfb8ae086f3df859ce6` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:43.570267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93331a10-7a47-4452-98a3-4c644c84111b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6fd67aab354bfb8ae086f3df859ce6)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:43.572256 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93331a10-7a47-4452-98a3-4c644c84111b admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:43.574207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:43.640627 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-93331a10-7a47-4452-98a3-4c644c84111b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6fd67aab354bfb8ae086f3df859ce6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:43.651503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-93331a10-7a47-4452-98a3-4c644c84111b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6fd67aab354bfb8ae086f3df859ce6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:43.695132 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-93331a10-7a47-4452-98a3-4c644c84111b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6fd67aab354bfb8ae086f3df859ce6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:43.710962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-93331a10-7a47-4452-98a3-4c644c84111b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6fd67aab354bfb8ae086f3df859ce6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:43.710962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-93331a10-7a47-4452-98a3-4c644c84111b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6fd67aab354bfb8ae086f3df859ce6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:43.725293 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1407/2786] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:43 2022] DELETE /identity/v3/users/8e6fd67aab354bfb8ae086f3df859ce6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:43.731706 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649d247-d64d-456b-9bd8-0c99b599f068 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:43.732466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649d247-d64d-456b-9bd8-0c99b599f068 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:43.732777 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649d247-d64d-456b-9bd8-0c99b599f068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:43.759703 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-a649d247-d64d-456b-9bd8-0c99b599f068 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:43.760495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a649d247-d64d-456b-9bd8-0c99b599f068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:43.844307 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1380/2787] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:43.856182 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93331a10-7a47-4452-98a3-4c644c84111b admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:43.858688 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-93331a10-7a47-4452-98a3-4c644c84111b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:43.942995 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93331a10-7a47-4452-98a3-4c644c84111b admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:43.947087 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e76cc-9bc4-4b14-ac44-7f6017ecf940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:43.947725 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e76cc-9bc4-4b14-ac44-7f6017ecf940 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:43.947998 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e76cc-9bc4-4b14-ac44-7f6017ecf940 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:43.948267 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e76cc-9bc4-4b14-ac44-7f6017ecf940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:43.960020 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e76cc-9bc4-4b14-ac44-7f6017ecf940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:43.961621 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e76cc-9bc4-4b14-ac44-7f6017ecf940 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:43.974082 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1408/2788] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:44.315010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649d247-d64d-456b-9bd8-0c99b599f068 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:44.316754 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a649d247-d64d-456b-9bd8-0c99b599f068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:44.331115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649d247-d64d-456b-9bd8-0c99b599f068 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:44.336587 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:44.337455 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:44.337868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:44.338259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94 admin admin] PATH_INFO: `/v3/projects/54c5c6b60fd34cff924585858786f131` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:44.339757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c5c6b60fd34cff924585858786f131)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:44.342660 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:44.412728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c5c6b60fd34cff924585858786f131', 'request_id': 'req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:44.419937 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c5c6b60fd34cff924585858786f131', 'request_id': 'req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:44.430144 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c5c6b60fd34cff924585858786f131', 'request_id': 'req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:44.445307 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94 admin admin] The token cache is being invalidate because project 54c5c6b60fd34cff924585858786f131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:44.445638 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:44.446332 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:44.448028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1381/2789] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:44 2022] DELETE /identity/v3/projects/54c5c6b60fd34cff924585858786f131 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:44.452094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e76cc-9bc4-4b14-ac44-7f6017ecf940 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:44.463022 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e76cc-9bc4-4b14-ac44-7f6017ecf940 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:44.537357 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96ed16-f5d9-4438-bf5c-c68d875c5d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:44.538069 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96ed16-f5d9-4438-bf5c-c68d875c5d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:44.538386 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96ed16-f5d9-4438-bf5c-c68d875c5d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:44.538711 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96ed16-f5d9-4438-bf5c-c68d875c5d4a admin admin] PATH_INFO: `/v3/users/fec475248fde41a6bee3c10e2d1dbdc6` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:44.540108 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96ed16-f5d9-4438-bf5c-c68d875c5d4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fec475248fde41a6bee3c10e2d1dbdc6)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:44.542309 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96ed16-f5d9-4438-bf5c-c68d875c5d4a admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:44.569241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:44.601173 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2c96ed16-f5d9-4438-bf5c-c68d875c5d4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fec475248fde41a6bee3c10e2d1dbdc6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:44.610836 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2c96ed16-f5d9-4438-bf5c-c68d875c5d4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fec475248fde41a6bee3c10e2d1dbdc6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:44.625958 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2c96ed16-f5d9-4438-bf5c-c68d875c5d4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fec475248fde41a6bee3c10e2d1dbdc6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:44.635037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2c96ed16-f5d9-4438-bf5c-c68d875c5d4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fec475248fde41a6bee3c10e2d1dbdc6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:44.635841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-2c96ed16-f5d9-4438-bf5c-c68d875c5d4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fec475248fde41a6bee3c10e2d1dbdc6'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:44.642703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1409/2790] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:44 2022] DELETE /identity/v3/users/fec475248fde41a6bee3c10e2d1dbdc6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:45.071212 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:45.074019 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:45.092417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf9106-ee3f-4671-abaf-82b1ccbcaf94 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:45.104188 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:45.172394 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed166ab-1cca-4071-98ab-04e84364ea1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:45.173048 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed166ab-1cca-4071-98ab-04e84364ea1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:45.173328 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed166ab-1cca-4071-98ab-04e84364ea1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:45.173627 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed166ab-1cca-4071-98ab-04e84364ea1d admin admin] PATH_INFO: `/v3/projects/dc6e9b140c0047b685d112499e5eb178` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:45.174865 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed166ab-1cca-4071-98ab-04e84364ea1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc6e9b140c0047b685d112499e5eb178)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:45.176838 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed166ab-1cca-4071-98ab-04e84364ea1d admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:45.239424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0ed166ab-1cca-4071-98ab-04e84364ea1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc6e9b140c0047b685d112499e5eb178', 'request_id': 'req-0ed166ab-1cca-4071-98ab-04e84364ea1d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:45.246935 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0ed166ab-1cca-4071-98ab-04e84364ea1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc6e9b140c0047b685d112499e5eb178', 'request_id': 'req-0ed166ab-1cca-4071-98ab-04e84364ea1d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:45.259535 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0ed166ab-1cca-4071-98ab-04e84364ea1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc6e9b140c0047b685d112499e5eb178', 'request_id': 'req-0ed166ab-1cca-4071-98ab-04e84364ea1d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:45.276830 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0ed166ab-1cca-4071-98ab-04e84364ea1d admin admin] The token cache is being invalidate because project dc6e9b140c0047b685d112499e5eb178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:45.277073 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0ed166ab-1cca-4071-98ab-04e84364ea1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:45.277872 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0ed166ab-1cca-4071-98ab-04e84364ea1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:45.279549 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1382/2791] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:45 2022] DELETE /identity/v3/projects/dc6e9b140c0047b685d112499e5eb178 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:45.284536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96ed16-f5d9-4438-bf5c-c68d875c5d4a admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:45.286160 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-2c96ed16-f5d9-4438-bf5c-c68d875c5d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:45.300971 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96ed16-f5d9-4438-bf5c-c68d875c5d4a admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:45.367133 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18818f2a-5e40-4422-82f7-7ee2d19cdcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:45.368056 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18818f2a-5e40-4422-82f7-7ee2d19cdcf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:45.368537 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18818f2a-5e40-4422-82f7-7ee2d19cdcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:45.368928 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18818f2a-5e40-4422-82f7-7ee2d19cdcf5 admin admin] PATH_INFO: `/v3/users/086c7a256dca42779812847d46f52d29` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:45.370371 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18818f2a-5e40-4422-82f7-7ee2d19cdcf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=086c7a256dca42779812847d46f52d29)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:45.372623 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18818f2a-5e40-4422-82f7-7ee2d19cdcf5 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:45.442343 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-18818f2a-5e40-4422-82f7-7ee2d19cdcf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '086c7a256dca42779812847d46f52d29'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:45.455735 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-18818f2a-5e40-4422-82f7-7ee2d19cdcf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '086c7a256dca42779812847d46f52d29'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:45.471369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-18818f2a-5e40-4422-82f7-7ee2d19cdcf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '086c7a256dca42779812847d46f52d29'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:45.481236 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-18818f2a-5e40-4422-82f7-7ee2d19cdcf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '086c7a256dca42779812847d46f52d29'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:45.481955 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-18818f2a-5e40-4422-82f7-7ee2d19cdcf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '086c7a256dca42779812847d46f52d29'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:45.489645 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1410/2792] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:45 2022] DELETE /identity/v3/users/086c7a256dca42779812847d46f52d29 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:45.841266 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed166ab-1cca-4071-98ab-04e84364ea1d admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:45.843056 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0ed166ab-1cca-4071-98ab-04e84364ea1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:45.862680 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed166ab-1cca-4071-98ab-04e84364ea1d admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:45.932430 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6781c-4bcd-4c98-b7f2-069a67ba28d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:45.933046 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6781c-4bcd-4c98-b7f2-069a67ba28d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:45.933448 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6781c-4bcd-4c98-b7f2-069a67ba28d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:45.933804 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6781c-4bcd-4c98-b7f2-069a67ba28d0 admin admin] PATH_INFO: `/v3/projects/3ee1c50ec8704323b3867894c50692e1` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:45.935201 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6781c-4bcd-4c98-b7f2-069a67ba28d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee1c50ec8704323b3867894c50692e1)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:45.937370 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6781c-4bcd-4c98-b7f2-069a67ba28d0 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:45.995977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:46.001797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c7e6781c-4bcd-4c98-b7f2-069a67ba28d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee1c50ec8704323b3867894c50692e1', 'request_id': 'req-c7e6781c-4bcd-4c98-b7f2-069a67ba28d0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:46.009483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c7e6781c-4bcd-4c98-b7f2-069a67ba28d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee1c50ec8704323b3867894c50692e1', 'request_id': 'req-c7e6781c-4bcd-4c98-b7f2-069a67ba28d0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:46.024322 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c7e6781c-4bcd-4c98-b7f2-069a67ba28d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee1c50ec8704323b3867894c50692e1', 'request_id': 'req-c7e6781c-4bcd-4c98-b7f2-069a67ba28d0'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:46.038155 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c7e6781c-4bcd-4c98-b7f2-069a67ba28d0 admin admin] The token cache is being invalidate because project 3ee1c50ec8704323b3867894c50692e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:46.038439 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c7e6781c-4bcd-4c98-b7f2-069a67ba28d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:46.039152 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c7e6781c-4bcd-4c98-b7f2-069a67ba28d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:46.040708 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1383/2793] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:45 2022] DELETE /identity/v3/projects/3ee1c50ec8704323b3867894c50692e1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:46.047362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d2fb-7fcf-424e-80a7-d6358ccf3081 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:46.047641 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d2fb-7fcf-424e-80a7-d6358ccf3081 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:46.047914 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d2fb-7fcf-424e-80a7-d6358ccf3081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:46.069159 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-0583d2fb-7fcf-424e-80a7-d6358ccf3081 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:46.070459 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0583d2fb-7fcf-424e-80a7-d6358ccf3081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:46.087394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:46.150055 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1411/2794] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:46.159355 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3100d-e8de-4a78-90fd-70e48f499061 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:46.159780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3100d-e8de-4a78-90fd-70e48f499061 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:46.160095 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3100d-e8de-4a78-90fd-70e48f499061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:46.183213 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-12d3100d-e8de-4a78-90fd-70e48f499061 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:46.184372 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-12d3100d-e8de-4a78-90fd-70e48f499061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:46.198169 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1384/2795] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:46.206414 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d2fb-7fcf-424e-80a7-d6358ccf3081 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:46.223300 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583d2fb-7fcf-424e-80a7-d6358ccf3081 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:46.230740 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942efdc-37de-49f8-90e5-a173b8295585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:46.231660 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942efdc-37de-49f8-90e5-a173b8295585 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:46.232108 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942efdc-37de-49f8-90e5-a173b8295585 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:46.232553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942efdc-37de-49f8-90e5-a173b8295585 admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:46.233690 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942efdc-37de-49f8-90e5-a173b8295585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 00:00:46.234199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942efdc-37de-49f8-90e5-a173b8295585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:46.236965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942efdc-37de-49f8-90e5-a173b8295585 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:46.256554 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1412/2796] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Sep 13 00:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 00:00:46.263844 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3100d-e8de-4a78-90fd-70e48f499061 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:46.274933 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3100d-e8de-4a78-90fd-70e48f499061 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:46.280247 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945c74a-6037-4a84-95fd-6d0914b3c1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:46.280874 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945c74a-6037-4a84-95fd-6d0914b3c1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:46.281146 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945c74a-6037-4a84-95fd-6d0914b3c1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:46.281550 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945c74a-6037-4a84-95fd-6d0914b3c1d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:46.282099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945c74a-6037-4a84-95fd-6d0914b3c1d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:46.284051 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945c74a-6037-4a84-95fd-6d0914b3c1d3 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:46.316748 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1385/2797] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:46 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:46.323130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942efdc-37de-49f8-90e5-a173b8295585 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:46.340985 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942efdc-37de-49f8-90e5-a173b8295585 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:46.445844 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbf3c2-0068-4b17-96dd-55d3705ceeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:46.446759 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbf3c2-0068-4b17-96dd-55d3705ceeb4 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:46.447353 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbf3c2-0068-4b17-96dd-55d3705ceeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:46.447891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbf3c2-0068-4b17-96dd-55d3705ceeb4 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:46.451811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbf3c2-0068-4b17-96dd-55d3705ceeb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:46.453531 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbf3c2-0068-4b17-96dd-55d3705ceeb4 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:46.496842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1413/2798] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:46 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:46.502750 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945c74a-6037-4a84-95fd-6d0914b3c1d3 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:46.521661 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945c74a-6037-4a84-95fd-6d0914b3c1d3 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:46.531289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010678a-f482-492f-9633-e25bd6ad6724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:46.532365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010678a-f482-492f-9633-e25bd6ad6724 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:46.532868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010678a-f482-492f-9633-e25bd6ad6724 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:46.533172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010678a-f482-492f-9633-e25bd6ad6724 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:46.534732 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010678a-f482-492f-9633-e25bd6ad6724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:46.538324 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010678a-f482-492f-9633-e25bd6ad6724 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:46.560261 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1386/2799] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:46.567119 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbf3c2-0068-4b17-96dd-55d3705ceeb4 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:46.586822 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbf3c2-0068-4b17-96dd-55d3705ceeb4 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:46.595201 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfe9fc-cd5e-48bc-9cae-ec9b60e229b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:46.596043 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfe9fc-cd5e-48bc-9cae-ec9b60e229b3 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:46.596487 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfe9fc-cd5e-48bc-9cae-ec9b60e229b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:46.596829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfe9fc-cd5e-48bc-9cae-ec9b60e229b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:46.597725 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfe9fc-cd5e-48bc-9cae-ec9b60e229b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:46.600891 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfe9fc-cd5e-48bc-9cae-ec9b60e229b3 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:46.621257 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1414/2800] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:46.627021 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010678a-f482-492f-9633-e25bd6ad6724 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:46.644427 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010678a-f482-492f-9633-e25bd6ad6724 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:46.652142 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eda24-6ea1-492e-aaa5-49696e512d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:46.652842 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eda24-6ea1-492e-aaa5-49696e512d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:46.653118 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eda24-6ea1-492e-aaa5-49696e512d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:46.653425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0eda24-6ea1-492e-aaa5-49696e512d23 admin admin] PATH_INFO: `/v3/projects/edbec18f7d3f404793f0dda7acae0702/users/10b68e2d9e5c44da926a637b54b38968/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:46.678602 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0eda24-6ea1-492e-aaa5-49696e512d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edbec18f7d3f404793f0dda7acae0702, user_id=10b68e2d9e5c44da926a637b54b38968, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:46.681545 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0eda24-6ea1-492e-aaa5-49696e512d23 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:46.704217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1387/2801] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:46 2022] PUT /identity/v3/projects/edbec18f7d3f404793f0dda7acae0702/users/10b68e2d9e5c44da926a637b54b38968/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:46.705250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749855f-8247-422b-904e-efb88025a5c4 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:46.705932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749855f-8247-422b-904e-efb88025a5c4 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:46.706597 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749855f-8247-422b-904e-efb88025a5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:46.739344 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-0749855f-8247-422b-904e-efb88025a5c4 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:46.741206 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0749855f-8247-422b-904e-efb88025a5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:46.855917 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1415/2802] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:46.869240 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eda24-6ea1-492e-aaa5-49696e512d23 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:46.872150 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9c0eda24-6ea1-492e-aaa5-49696e512d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:46.980778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0eda24-6ea1-492e-aaa5-49696e512d23 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:46.987257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32fa47-2267-4092-b8f0-354b31f01867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:46.988297 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32fa47-2267-4092-b8f0-354b31f01867 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:46.988777 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32fa47-2267-4092-b8f0-354b31f01867 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:46.989613 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32fa47-2267-4092-b8f0-354b31f01867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:47.006300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32fa47-2267-4092-b8f0-354b31f01867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:47.009063 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32fa47-2267-4092-b8f0-354b31f01867 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:47.026354 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1388/2803] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:47.828192 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df81bd4-6de1-490b-bb83-4639ceef5383 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:47.828762 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df81bd4-6de1-490b-bb83-4639ceef5383 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:47.828892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df81bd4-6de1-490b-bb83-4639ceef5383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:47.877101 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-5df81bd4-6de1-490b-bb83-4639ceef5383 None None] MFA Rules not processed for user `10b68e2d9e5c44da926a637b54b38968`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:47.879649 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-5df81bd4-6de1-490b-bb83-4639ceef5383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:47.899008 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:47.977163 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1416/2804] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:47.981880 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32fa47-2267-4092-b8f0-354b31f01867 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:47.993742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32fa47-2267-4092-b8f0-354b31f01867 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:48.002277 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a10f44-c4f9-41e5-acfe-942d45daaad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:48.003797 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a10f44-c4f9-41e5-acfe-942d45daaad9 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:48.004084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a10f44-c4f9-41e5-acfe-942d45daaad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:48.004597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a10f44-c4f9-41e5-acfe-942d45daaad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:48.005389 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a10f44-c4f9-41e5-acfe-942d45daaad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:48.008034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a10f44-c4f9-41e5-acfe-942d45daaad9 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:48.048002 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1389/2805] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:47 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:48.049197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df81bd4-6de1-490b-bb83-4639ceef5383 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:48.067095 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df81bd4-6de1-490b-bb83-4639ceef5383 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:48.147529 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2850bcc-db9c-4e62-8e1c-b2a3cb59beba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:48.148733 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2850bcc-db9c-4e62-8e1c-b2a3cb59beba admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:48.149477 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2850bcc-db9c-4e62-8e1c-b2a3cb59beba admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:48.149948 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2850bcc-db9c-4e62-8e1c-b2a3cb59beba admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:48.151115 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2850bcc-db9c-4e62-8e1c-b2a3cb59beba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:48.154963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2850bcc-db9c-4e62-8e1c-b2a3cb59beba admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:48.189940 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1417/2806] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:48 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:48.194281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a10f44-c4f9-41e5-acfe-942d45daaad9 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:48.208527 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a10f44-c4f9-41e5-acfe-942d45daaad9 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:48.225103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db9efe-f9b4-4d62-9c86-0a2e860cd368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:48.226086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db9efe-f9b4-4d62-9c86-0a2e860cd368 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:48.226808 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db9efe-f9b4-4d62-9c86-0a2e860cd368 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:48.227540 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db9efe-f9b4-4d62-9c86-0a2e860cd368 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:48.228559 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db9efe-f9b4-4d62-9c86-0a2e860cd368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:48.230826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db9efe-f9b4-4d62-9c86-0a2e860cd368 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:48.246549 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1390/2807] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:48.251283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2850bcc-db9c-4e62-8e1c-b2a3cb59beba admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:48.264863 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2850bcc-db9c-4e62-8e1c-b2a3cb59beba admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:48.270996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e74f1-2ad2-4edd-8855-0c24efe02fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:48.271651 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e74f1-2ad2-4edd-8855-0c24efe02fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:48.272036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e74f1-2ad2-4edd-8855-0c24efe02fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:48.272185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e74f1-2ad2-4edd-8855-0c24efe02fdd admin admin] PATH_INFO: `/v3/projects/760b62d9691e4a618b379817a115908b/users/1e4cbc0e088441068156dd38f70dc46e/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:48.291163 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e74f1-2ad2-4edd-8855-0c24efe02fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=760b62d9691e4a618b379817a115908b, user_id=1e4cbc0e088441068156dd38f70dc46e, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:48.293926 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e74f1-2ad2-4edd-8855-0c24efe02fdd admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:48.311469 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1418/2808] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:48 2022] PUT /identity/v3/projects/760b62d9691e4a618b379817a115908b/users/1e4cbc0e088441068156dd38f70dc46e/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:48.316013 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db9efe-f9b4-4d62-9c86-0a2e860cd368 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:48.328846 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db9efe-f9b4-4d62-9c86-0a2e860cd368 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:48.363883 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:48.392884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3011d8-55be-4674-93fa-3484cade6061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:48.393717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3011d8-55be-4674-93fa-3484cade6061 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:48.393965 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3011d8-55be-4674-93fa-3484cade6061 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:48.394278 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3011d8-55be-4674-93fa-3484cade6061 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:48.394992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3011d8-55be-4674-93fa-3484cade6061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:48.396881 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3011d8-55be-4674-93fa-3484cade6061 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:48.411114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1391/2809] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:48.416974 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e74f1-2ad2-4edd-8855-0c24efe02fdd admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:48.434270 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e74f1-2ad2-4edd-8855-0c24efe02fdd admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:48.440380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01200a7b-f81d-42a3-b3c5-cc08a565ff35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:48.441191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200a7b-f81d-42a3-b3c5-cc08a565ff35 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:48.441626 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200a7b-f81d-42a3-b3c5-cc08a565ff35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:48.441839 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200a7b-f81d-42a3-b3c5-cc08a565ff35 admin admin] PATH_INFO: `/v3/projects/760b62d9691e4a618b379817a115908b/users/1e4cbc0e088441068156dd38f70dc46e/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:48.444377 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01200a7b-f81d-42a3-b3c5-cc08a565ff35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=760b62d9691e4a618b379817a115908b, user_id=1e4cbc0e088441068156dd38f70dc46e, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:48.447370 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01200a7b-f81d-42a3-b3c5-cc08a565ff35 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:48.460243 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1419/2810] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:48 2022] PUT /identity/v3/projects/760b62d9691e4a618b379817a115908b/users/1e4cbc0e088441068156dd38f70dc46e/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:48.822902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3011d8-55be-4674-93fa-3484cade6061 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:48.825469 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-9f3011d8-55be-4674-93fa-3484cade6061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:48.849363 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3011d8-55be-4674-93fa-3484cade6061 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:48.942877 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adbe83-cc4e-4cb8-ba2a-9f7775c1c441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:48.943639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adbe83-cc4e-4cb8-ba2a-9f7775c1c441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:48.943946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adbe83-cc4e-4cb8-ba2a-9f7775c1c441 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:48.944900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adbe83-cc4e-4cb8-ba2a-9f7775c1c441 admin admin] PATH_INFO: `/v3/users/fa06eb3edf86410da127b2626da5ec1d` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:48.946819 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adbe83-cc4e-4cb8-ba2a-9f7775c1c441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa06eb3edf86410da127b2626da5ec1d)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:48.951168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adbe83-cc4e-4cb8-ba2a-9f7775c1c441 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:49.035850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-10adbe83-cc4e-4cb8-ba2a-9f7775c1c441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa06eb3edf86410da127b2626da5ec1d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:49.036675 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-10adbe83-cc4e-4cb8-ba2a-9f7775c1c441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa06eb3edf86410da127b2626da5ec1d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:49.037537 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-10adbe83-cc4e-4cb8-ba2a-9f7775c1c441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa06eb3edf86410da127b2626da5ec1d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:49.054417 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-10adbe83-cc4e-4cb8-ba2a-9f7775c1c441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa06eb3edf86410da127b2626da5ec1d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:49.063146 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-10adbe83-cc4e-4cb8-ba2a-9f7775c1c441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa06eb3edf86410da127b2626da5ec1d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:49.081151 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1392/2811] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:48 2022] DELETE /identity/v3/users/fa06eb3edf86410da127b2626da5ec1d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:49.087031 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88131d8-3c2b-4add-8943-c7833621fc63 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:49.087664 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88131d8-3c2b-4add-8943-c7833621fc63 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:49.087821 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88131d8-3c2b-4add-8943-c7833621fc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:49.112118 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-d88131d8-3c2b-4add-8943-c7833621fc63 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:49.113765 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d88131d8-3c2b-4add-8943-c7833621fc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:49.192077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1420/2812] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:49.205051 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adbe83-cc4e-4cb8-ba2a-9f7775c1c441 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:49.206758 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-10adbe83-cc4e-4cb8-ba2a-9f7775c1c441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:49.290124 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adbe83-cc4e-4cb8-ba2a-9f7775c1c441 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:49.297674 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8ecba-57f2-447f-88de-a24d38fe87b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:49.298725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8ecba-57f2-447f-88de-a24d38fe87b9 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:49.299219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8ecba-57f2-447f-88de-a24d38fe87b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:49.299723 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8ecba-57f2-447f-88de-a24d38fe87b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:49.323038 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7d34-798e-447b-94b1-bedc1b12234b None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:49.323348 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7d34-798e-447b-94b1-bedc1b12234b None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:49.323619 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7d34-798e-447b-94b1-bedc1b12234b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:49.329068 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:49.335343 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8ecba-57f2-447f-88de-a24d38fe87b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:49.338532 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8ecba-57f2-447f-88de-a24d38fe87b9 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:49.362424 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1393/2813] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 00:00:49.370427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:49.395855 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-d77e7d34-798e-447b-94b1-bedc1b12234b None None] MFA Rules not processed for user `1e4cbc0e088441068156dd38f70dc46e`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:49.398167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d77e7d34-798e-447b-94b1-bedc1b12234b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:49.570736 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1421/2814] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:49.592331 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccea82-db6e-4bb9-a6f5-44220f17147d None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:49.593204 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccea82-db6e-4bb9-a6f5-44220f17147d None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:49.597013 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccea82-db6e-4bb9-a6f5-44220f17147d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:49.647223 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-eaccea82-db6e-4bb9-a6f5-44220f17147d None None] MFA Rules not processed for user `10b68e2d9e5c44da926a637b54b38968`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:49.648657 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-eaccea82-db6e-4bb9-a6f5-44220f17147d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:49.725182 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1394/2815] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:49.743635 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e7d34-798e-447b-94b1-bedc1b12234b None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:49.746815 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d77e7d34-798e-447b-94b1-bedc1b12234b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:49.774639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccea82-db6e-4bb9-a6f5-44220f17147d None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:49.776253 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-eaccea82-db6e-4bb9-a6f5-44220f17147d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:49.794007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccea82-db6e-4bb9-a6f5-44220f17147d None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:49.800716 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0029f24-0283-46a4-84d5-633a37058d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:49.801423 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0029f24-0283-46a4-84d5-633a37058d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:49.801706 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0029f24-0283-46a4-84d5-633a37058d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:49.801970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0029f24-0283-46a4-84d5-633a37058d62 admin admin] PATH_INFO: `/v3/projects/aa3c9f3c1e084f06b48e05cedecc7d97` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:49.803286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0029f24-0283-46a4-84d5-633a37058d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3c9f3c1e084f06b48e05cedecc7d97)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:49.805242 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0029f24-0283-46a4-84d5-633a37058d62 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:49.846730 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e7d34-798e-447b-94b1-bedc1b12234b None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:49.860216 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c0029f24-0283-46a4-84d5-633a37058d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3c9f3c1e084f06b48e05cedecc7d97', 'request_id': 'req-c0029f24-0283-46a4-84d5-633a37058d62'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:49.866828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c0029f24-0283-46a4-84d5-633a37058d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3c9f3c1e084f06b48e05cedecc7d97', 'request_id': 'req-c0029f24-0283-46a4-84d5-633a37058d62'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:49.875870 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c0029f24-0283-46a4-84d5-633a37058d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3c9f3c1e084f06b48e05cedecc7d97', 'request_id': 'req-c0029f24-0283-46a4-84d5-633a37058d62'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:49.889086 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c0029f24-0283-46a4-84d5-633a37058d62 admin admin] The token cache is being invalidate because project aa3c9f3c1e084f06b48e05cedecc7d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:49.889404 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c0029f24-0283-46a4-84d5-633a37058d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:49.890074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c0029f24-0283-46a4-84d5-633a37058d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:49.891733 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1395/2816] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:49 2022] DELETE /identity/v3/projects/aa3c9f3c1e084f06b48e05cedecc7d97 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:00:49.896187 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0029f24-0283-46a4-84d5-633a37058d62 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:49.897759 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c0029f24-0283-46a4-84d5-633a37058d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:49.918276 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d6c05-4c5c-4977-9161-6e71916adfa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:49.918934 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d6c05-4c5c-4977-9161-6e71916adfa4 service nova] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:49.919727 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d6c05-4c5c-4977-9161-6e71916adfa4 service nova] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:49.920036 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d6c05-4c5c-4977-9161-6e71916adfa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:49.922693 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-258d6c05-4c5c-4977-9161-6e71916adfa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:49.958457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:49.972514 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0029f24-0283-46a4-84d5-633a37058d62 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:49.978075 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a40ff-e237-46a3-818b-28078cee7694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:49.978726 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a40ff-e237-46a3-818b-28078cee7694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:49.979041 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a40ff-e237-46a3-818b-28078cee7694 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:49.979281 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a40ff-e237-46a3-818b-28078cee7694 admin admin] PATH_INFO: `/v3/users/71fd76a651a04f1793cc787cad7b5b34` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:49.980442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a40ff-e237-46a3-818b-28078cee7694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71fd76a651a04f1793cc787cad7b5b34)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:49.982471 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a40ff-e237-46a3-818b-28078cee7694 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:49.992658 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d6c05-4c5c-4977-9161-6e71916adfa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:49.994317 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d6c05-4c5c-4977-9161-6e71916adfa4 service nova] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:50.005143 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1422/2817] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:50.014457 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:50.040679 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-772a40ff-e237-46a3-818b-28078cee7694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71fd76a651a04f1793cc787cad7b5b34'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:50.042176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-772a40ff-e237-46a3-818b-28078cee7694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71fd76a651a04f1793cc787cad7b5b34'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:50.042862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-772a40ff-e237-46a3-818b-28078cee7694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71fd76a651a04f1793cc787cad7b5b34'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:50.062472 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-772a40ff-e237-46a3-818b-28078cee7694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71fd76a651a04f1793cc787cad7b5b34'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:50.076006 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-772a40ff-e237-46a3-818b-28078cee7694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71fd76a651a04f1793cc787cad7b5b34'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:50.095508 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1396/2818] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:49 2022] DELETE /identity/v3/users/71fd76a651a04f1793cc787cad7b5b34 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:50.295452 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d6c05-4c5c-4977-9161-6e71916adfa4 service nova] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:50.297851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-258d6c05-4c5c-4977-9161-6e71916adfa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:50.375764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d6c05-4c5c-4977-9161-6e71916adfa4 service nova] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:50.427918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a40ff-e237-46a3-818b-28078cee7694 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:50.431131 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-772a40ff-e237-46a3-818b-28078cee7694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:50.441191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ce0c1-a634-4453-b8c5-300512aedacd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:50.442631 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ce0c1-a634-4453-b8c5-300512aedacd service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:50.442913 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ce0c1-a634-4453-b8c5-300512aedacd service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:50.443192 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ce0c1-a634-4453-b8c5-300512aedacd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:50.445275 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-8c1ce0c1-a634-4453-b8c5-300512aedacd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:50.457107 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ce0c1-a634-4453-b8c5-300512aedacd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:50.458737 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ce0c1-a634-4453-b8c5-300512aedacd service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:50.470094 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1423/2819] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:50.526895 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a40ff-e237-46a3-818b-28078cee7694 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:50.532119 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578e743-534b-499e-bfb6-f8bdabd259a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:50.532774 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578e743-534b-499e-bfb6-f8bdabd259a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:50.533073 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578e743-534b-499e-bfb6-f8bdabd259a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:50.533363 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578e743-534b-499e-bfb6-f8bdabd259a9 admin admin] PATH_INFO: `/v3/projects/3a504e73a9aa44a798d3648854214c21` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:50.534573 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578e743-534b-499e-bfb6-f8bdabd259a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a504e73a9aa44a798d3648854214c21)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:50.536528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578e743-534b-499e-bfb6-f8bdabd259a9 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:50.592426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-1578e743-534b-499e-bfb6-f8bdabd259a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a504e73a9aa44a798d3648854214c21', 'request_id': 'req-1578e743-534b-499e-bfb6-f8bdabd259a9'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:50.599056 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-1578e743-534b-499e-bfb6-f8bdabd259a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a504e73a9aa44a798d3648854214c21', 'request_id': 'req-1578e743-534b-499e-bfb6-f8bdabd259a9'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:50.610068 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-1578e743-534b-499e-bfb6-f8bdabd259a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a504e73a9aa44a798d3648854214c21', 'request_id': 'req-1578e743-534b-499e-bfb6-f8bdabd259a9'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:50.628539 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-1578e743-534b-499e-bfb6-f8bdabd259a9 admin admin] The token cache is being invalidate because project 3a504e73a9aa44a798d3648854214c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:50.629213 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-1578e743-534b-499e-bfb6-f8bdabd259a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:50.630833 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-1578e743-534b-499e-bfb6-f8bdabd259a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:50.637825 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1397/2820] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:50 2022] DELETE /identity/v3/projects/3a504e73a9aa44a798d3648854214c21 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:50.641464 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62df4da-d22f-4f21-becd-9d802881710b None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:50.643135 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62df4da-d22f-4f21-becd-9d802881710b None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:50.643643 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62df4da-d22f-4f21-becd-9d802881710b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:50.684223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-d62df4da-d22f-4f21-becd-9d802881710b None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:50.685673 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d62df4da-d22f-4f21-becd-9d802881710b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:50.784258 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1424/2821] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:50.792495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41309d8d-44b6-4566-b12b-8000610d4154 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:50.792885 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41309d8d-44b6-4566-b12b-8000610d4154 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:50.793140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41309d8d-44b6-4566-b12b-8000610d4154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:50.819734 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-41309d8d-44b6-4566-b12b-8000610d4154 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:50.820987 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-41309d8d-44b6-4566-b12b-8000610d4154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:50.830442 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1398/2822] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:50.835038 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62df4da-d22f-4f21-becd-9d802881710b None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:50.847908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62df4da-d22f-4f21-becd-9d802881710b None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:50.857398 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf504f51-21b1-4a46-848e-30adfe1b0086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:50.858604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf504f51-21b1-4a46-848e-30adfe1b0086 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:50.859283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf504f51-21b1-4a46-848e-30adfe1b0086 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:50.859755 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf504f51-21b1-4a46-848e-30adfe1b0086 admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:50.860996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf504f51-21b1-4a46-848e-30adfe1b0086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 00:00:50.861607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf504f51-21b1-4a46-848e-30adfe1b0086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:50.864864 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf504f51-21b1-4a46-848e-30adfe1b0086 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:50.892089 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1425/2823] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Sep 13 00:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 00:00:50.894364 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41309d8d-44b6-4566-b12b-8000610d4154 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:50.923464 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41309d8d-44b6-4566-b12b-8000610d4154 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:50.932981 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5b908-fe9e-42f8-ad0b-ca1c6c361e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:50.934416 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5b908-fe9e-42f8-ad0b-ca1c6c361e59 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:50.934967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5b908-fe9e-42f8-ad0b-ca1c6c361e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:50.935460 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5b908-fe9e-42f8-ad0b-ca1c6c361e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:50.936759 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5b908-fe9e-42f8-ad0b-ca1c6c361e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:50.939618 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5b908-fe9e-42f8-ad0b-ca1c6c361e59 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:50.977372 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1399/2824] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:50 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:50.981023 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf504f51-21b1-4a46-848e-30adfe1b0086 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:50.994000 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf504f51-21b1-4a46-848e-30adfe1b0086 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:51.016274 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:51.076028 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9be13-5b58-498c-82aa-19c6e439489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:51.076750 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9be13-5b58-498c-82aa-19c6e439489d admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:51.077081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9be13-5b58-498c-82aa-19c6e439489d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:51.077403 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9be13-5b58-498c-82aa-19c6e439489d admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:51.078115 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9be13-5b58-498c-82aa-19c6e439489d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:51.080061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9be13-5b58-498c-82aa-19c6e439489d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:51.119609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1426/2825] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:50 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:51.121115 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5b908-fe9e-42f8-ad0b-ca1c6c361e59 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:51.129430 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:51.134778 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5b908-fe9e-42f8-ad0b-ca1c6c361e59 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:51.142633 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32610d0-dee3-44f8-852b-ab99f32aca4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:51.143771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32610d0-dee3-44f8-852b-ab99f32aca4a admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:51.144135 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32610d0-dee3-44f8-852b-ab99f32aca4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:51.144634 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32610d0-dee3-44f8-852b-ab99f32aca4a admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:51.145644 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32610d0-dee3-44f8-852b-ab99f32aca4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:51.147605 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32610d0-dee3-44f8-852b-ab99f32aca4a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:51.170461 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1400/2826] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:51.176061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9be13-5b58-498c-82aa-19c6e439489d admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:51.194462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9be13-5b58-498c-82aa-19c6e439489d admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:51.203654 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8d198-b8d9-46db-86e0-e2b58eb7de79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:51.204837 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8d198-b8d9-46db-86e0-e2b58eb7de79 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:51.205497 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8d198-b8d9-46db-86e0-e2b58eb7de79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:51.206013 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8d198-b8d9-46db-86e0-e2b58eb7de79 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:51.207203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8d198-b8d9-46db-86e0-e2b58eb7de79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:51.210881 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8d198-b8d9-46db-86e0-e2b58eb7de79 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:51.239392 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1427/2827] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:51.249037 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32610d0-dee3-44f8-852b-ab99f32aca4a admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:51.267773 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32610d0-dee3-44f8-852b-ab99f32aca4a admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:51.276315 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6b2de-68ae-4fa6-99de-569e858273ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:51.277502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6b2de-68ae-4fa6-99de-569e858273ea admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:51.277944 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6b2de-68ae-4fa6-99de-569e858273ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:51.278216 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6b2de-68ae-4fa6-99de-569e858273ea admin admin] PATH_INFO: `/v3/projects/1424a4b780494313ab7169c01041c03c/users/54cc5889eabb401586f349ab781280fe/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:51.295213 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6b2de-68ae-4fa6-99de-569e858273ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=1424a4b780494313ab7169c01041c03c, user_id=54cc5889eabb401586f349ab781280fe, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:51.298353 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6b2de-68ae-4fa6-99de-569e858273ea admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:51.315264 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1401/2828] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:51 2022] PUT /identity/v3/projects/1424a4b780494313ab7169c01041c03c/users/54cc5889eabb401586f349ab781280fe/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:51.328411 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9033de-eacc-4b96-8677-5de8376a0d2d None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:51.329269 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9033de-eacc-4b96-8677-5de8376a0d2d None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:51.329269 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9033de-eacc-4b96-8677-5de8376a0d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:51.365002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-cf9033de-eacc-4b96-8677-5de8376a0d2d None None] MFA Rules not processed for user `54cc5889eabb401586f349ab781280fe`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:51.366449 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-cf9033de-eacc-4b96-8677-5de8376a0d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:51.448584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1428/2829] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:51.459937 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6b2de-68ae-4fa6-99de-569e858273ea admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:51.463079 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-29c6b2de-68ae-4fa6-99de-569e858273ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:51.551794 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6b2de-68ae-4fa6-99de-569e858273ea admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:51.555781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a674aee-39ed-40d5-9bf2-d236ac7c40a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:51.556418 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a674aee-39ed-40d5-9bf2-d236ac7c40a4 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:51.556698 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a674aee-39ed-40d5-9bf2-d236ac7c40a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:51.556971 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a674aee-39ed-40d5-9bf2-d236ac7c40a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:51.568467 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a674aee-39ed-40d5-9bf2-d236ac7c40a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:51.570947 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a674aee-39ed-40d5-9bf2-d236ac7c40a4 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:51.588634 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1402/2830] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:53.066769 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9033de-eacc-4b96-8677-5de8376a0d2d None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:53.068309 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-cf9033de-eacc-4b96-8677-5de8376a0d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:53.184691 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9033de-eacc-4b96-8677-5de8376a0d2d None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:53.192825 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bef40a-5d42-40a7-9edc-9dc8ba652579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:53.193906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bef40a-5d42-40a7-9edc-9dc8ba652579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:53.194398 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bef40a-5d42-40a7-9edc-9dc8ba652579 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:53.194844 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bef40a-5d42-40a7-9edc-9dc8ba652579 admin admin] PATH_INFO: `/v3/users/92b7592905c347b59192f080bfde0243` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:53.196346 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bef40a-5d42-40a7-9edc-9dc8ba652579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b7592905c347b59192f080bfde0243)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:53.199598 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bef40a-5d42-40a7-9edc-9dc8ba652579 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:53.247045 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:53.285647 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c8bef40a-5d42-40a7-9edc-9dc8ba652579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b7592905c347b59192f080bfde0243'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:53.300919 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c8bef40a-5d42-40a7-9edc-9dc8ba652579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b7592905c347b59192f080bfde0243'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:53.324918 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c8bef40a-5d42-40a7-9edc-9dc8ba652579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b7592905c347b59192f080bfde0243'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:53.337984 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c8bef40a-5d42-40a7-9edc-9dc8ba652579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b7592905c347b59192f080bfde0243'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:53.339224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-c8bef40a-5d42-40a7-9edc-9dc8ba652579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b7592905c347b59192f080bfde0243'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:53.358100 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1429/2831] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:53 2022] DELETE /identity/v3/users/92b7592905c347b59192f080bfde0243 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:53.360690 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca0b7c-faee-43fa-8a4c-9b9ed360e8a0 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:53.361280 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca0b7c-faee-43fa-8a4c-9b9ed360e8a0 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:53.361752 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca0b7c-faee-43fa-8a4c-9b9ed360e8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:53.407874 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-28ca0b7c-faee-43fa-8a4c-9b9ed360e8a0 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:53.409217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-28ca0b7c-faee-43fa-8a4c-9b9ed360e8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:53.539260 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1403/2832] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:53.557693 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bef40a-5d42-40a7-9edc-9dc8ba652579 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:53.559473 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c8bef40a-5d42-40a7-9edc-9dc8ba652579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:53.672262 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bef40a-5d42-40a7-9edc-9dc8ba652579 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:53.679640 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6cecb-7a6a-4ec9-b6af-45c0bf9aa666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:53.680854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6cecb-7a6a-4ec9-b6af-45c0bf9aa666 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:53.681250 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6cecb-7a6a-4ec9-b6af-45c0bf9aa666 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:53.681835 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6cecb-7a6a-4ec9-b6af-45c0bf9aa666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:53.699329 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6cecb-7a6a-4ec9-b6af-45c0bf9aa666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:53.701518 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6cecb-7a6a-4ec9-b6af-45c0bf9aa666 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:53.720599 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1430/2833] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:54.182926 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca0b7c-faee-43fa-8a4c-9b9ed360e8a0 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:54.185229 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-28ca0b7c-faee-43fa-8a4c-9b9ed360e8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:54.209663 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca0b7c-faee-43fa-8a4c-9b9ed360e8a0 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:54.217958 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636ea24-9c2d-4c96-b6fb-03635ce8676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:54.219049 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636ea24-9c2d-4c96-b6fb-03635ce8676d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:54.219716 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636ea24-9c2d-4c96-b6fb-03635ce8676d admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:54.220414 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636ea24-9c2d-4c96-b6fb-03635ce8676d admin admin] PATH_INFO: `/v3/projects/1448bddb4d6641738ea97127c9cc8927` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:54.223118 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636ea24-9c2d-4c96-b6fb-03635ce8676d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1448bddb4d6641738ea97127c9cc8927)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:54.227250 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636ea24-9c2d-4c96-b6fb-03635ce8676d admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:54.292031 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a636ea24-9c2d-4c96-b6fb-03635ce8676d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1448bddb4d6641738ea97127c9cc8927', 'request_id': 'req-a636ea24-9c2d-4c96-b6fb-03635ce8676d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:54.300136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a636ea24-9c2d-4c96-b6fb-03635ce8676d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1448bddb4d6641738ea97127c9cc8927', 'request_id': 'req-a636ea24-9c2d-4c96-b6fb-03635ce8676d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:54.310199 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a636ea24-9c2d-4c96-b6fb-03635ce8676d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1448bddb4d6641738ea97127c9cc8927', 'request_id': 'req-a636ea24-9c2d-4c96-b6fb-03635ce8676d'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:54.313513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:54.331301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a636ea24-9c2d-4c96-b6fb-03635ce8676d admin admin] The token cache is being invalidate because project 1448bddb4d6641738ea97127c9cc8927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:54.331836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a636ea24-9c2d-4c96-b6fb-03635ce8676d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:54.333579 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a636ea24-9c2d-4c96-b6fb-03635ce8676d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:54.336322 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1404/2834] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:54 2022] DELETE /identity/v3/projects/1448bddb4d6641738ea97127c9cc8927 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:54.343729 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025de1b-b816-4d4b-bf3c-aac897d4c4fe None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:54.344847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025de1b-b816-4d4b-bf3c-aac897d4c4fe None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:54.345117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025de1b-b816-4d4b-bf3c-aac897d4c4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:54.371862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-8025de1b-b816-4d4b-bf3c-aac897d4c4fe None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:54.373991 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-8025de1b-b816-4d4b-bf3c-aac897d4c4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:54.465592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1431/2835] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:54.476962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff79bb-28e9-45d9-b170-8a3d241e8238 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:54.477946 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff79bb-28e9-45d9-b170-8a3d241e8238 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:54.478641 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff79bb-28e9-45d9-b170-8a3d241e8238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:54.508552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-66ff79bb-28e9-45d9-b170-8a3d241e8238 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:54.509985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-66ff79bb-28e9-45d9-b170-8a3d241e8238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:54.519349 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1405/2836] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:54.524516 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025de1b-b816-4d4b-bf3c-aac897d4c4fe None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:54.539956 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025de1b-b816-4d4b-bf3c-aac897d4c4fe None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:54.547628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76739b6-f452-4dc3-b02a-e8af24b6334e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:54.549223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76739b6-f452-4dc3-b02a-e8af24b6334e admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:54.549799 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76739b6-f452-4dc3-b02a-e8af24b6334e admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:54.550350 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76739b6-f452-4dc3-b02a-e8af24b6334e admin admin] PATH_INFO: `/v3/domains` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:54.551039 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76739b6-f452-4dc3-b02a-e8af24b6334e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 00:00:54.551344 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76739b6-f452-4dc3-b02a-e8af24b6334e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:54.553046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76739b6-f452-4dc3-b02a-e8af24b6334e admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:54.579045 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1432/2837] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Sep 13 00:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 00:00:54.582862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff79bb-28e9-45d9-b170-8a3d241e8238 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:54.595400 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff79bb-28e9-45d9-b170-8a3d241e8238 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:54.603852 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2764fe-d637-4e0b-ab74-b9b0c419840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:54.604615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2764fe-d637-4e0b-ab74-b9b0c419840a admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:54.605076 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2764fe-d637-4e0b-ab74-b9b0c419840a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:54.605595 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2764fe-d637-4e0b-ab74-b9b0c419840a admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:54.606412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2764fe-d637-4e0b-ab74-b9b0c419840a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:54.609415 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2764fe-d637-4e0b-ab74-b9b0c419840a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:54.647059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1406/2838] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:00:54 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:54.651073 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76739b6-f452-4dc3-b02a-e8af24b6334e admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:54.663511 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76739b6-f452-4dc3-b02a-e8af24b6334e admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:54.712472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:54.764223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887716ff-f689-455d-bb5e-dbad1bff3460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:54.765296 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887716ff-f689-455d-bb5e-dbad1bff3460 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:54.765962 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887716ff-f689-455d-bb5e-dbad1bff3460 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:54.766286 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887716ff-f689-455d-bb5e-dbad1bff3460 admin admin] PATH_INFO: `/v3/users` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:54.767774 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887716ff-f689-455d-bb5e-dbad1bff3460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:54.770005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887716ff-f689-455d-bb5e-dbad1bff3460 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:54.806714 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1433/2839] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:00:54 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:00:54.811478 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2764fe-d637-4e0b-ab74-b9b0c419840a admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:54.831032 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2764fe-d637-4e0b-ab74-b9b0c419840a admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:54.837627 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8206f2a-33ba-4ac0-821c-84fd644bc646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:54.838594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8206f2a-33ba-4ac0-821c-84fd644bc646 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:54.838874 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8206f2a-33ba-4ac0-821c-84fd644bc646 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:54.839151 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8206f2a-33ba-4ac0-821c-84fd644bc646 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:54.839822 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8206f2a-33ba-4ac0-821c-84fd644bc646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:54.841622 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8206f2a-33ba-4ac0-821c-84fd644bc646 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:54.854667 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1407/2840] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:00:54.859384 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887716ff-f689-455d-bb5e-dbad1bff3460 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:54.871734 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887716ff-f689-455d-bb5e-dbad1bff3460 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:54.878659 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd454d6-da0c-4e57-95ae-6487e3bcbf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:54.879609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd454d6-da0c-4e57-95ae-6487e3bcbf35 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:54.880061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd454d6-da0c-4e57-95ae-6487e3bcbf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:54.880744 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd454d6-da0c-4e57-95ae-6487e3bcbf35 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:54.893063 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd454d6-da0c-4e57-95ae-6487e3bcbf35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:54.895417 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd454d6-da0c-4e57-95ae-6487e3bcbf35 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:54.916221 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1434/2841] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:00:54.923396 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8206f2a-33ba-4ac0-821c-84fd644bc646 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:54.950491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8206f2a-33ba-4ac0-821c-84fd644bc646 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:54.960413 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ace67-9027-44a3-906b-86a6826e771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:54.961903 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ace67-9027-44a3-906b-86a6826e771c admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:54.962627 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ace67-9027-44a3-906b-86a6826e771c admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:54.963406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ace67-9027-44a3-906b-86a6826e771c admin admin] PATH_INFO: `/v3/projects/17b8a08b8e6045bd9609b8f5bba09e6e/users/6cc61dd768cc47828facbf027f913f58/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:55.005053 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ace67-9027-44a3-906b-86a6826e771c admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b8a08b8e6045bd9609b8f5bba09e6e, user_id=6cc61dd768cc47828facbf027f913f58, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:55.011140 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ace67-9027-44a3-906b-86a6826e771c admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:55.040000 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1408/2842] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:00:54 2022] PUT /identity/v3/projects/17b8a08b8e6045bd9609b8f5bba09e6e/users/6cc61dd768cc47828facbf027f913f58/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:55.060841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4fd46-47cc-47a3-afd8-c97b21632a2f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:55.061224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4fd46-47cc-47a3-afd8-c97b21632a2f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:55.061457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4fd46-47cc-47a3-afd8-c97b21632a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:55.109534 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-fbf4fd46-47cc-47a3-afd8-c97b21632a2f None None] MFA Rules not processed for user `6cc61dd768cc47828facbf027f913f58`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:55.111091 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-fbf4fd46-47cc-47a3-afd8-c97b21632a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:55.211077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1435/2843] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:55.228828 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ace67-9027-44a3-906b-86a6826e771c admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:55.232188 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-209ace67-9027-44a3-906b-86a6826e771c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:55.337841 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ace67-9027-44a3-906b-86a6826e771c admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:55.342043 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599179be-36df-49e3-9ba6-076197300ab2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:55.342717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599179be-36df-49e3-9ba6-076197300ab2 service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:55.342944 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599179be-36df-49e3-9ba6-076197300ab2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:55.343300 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599179be-36df-49e3-9ba6-076197300ab2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:55.352879 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599179be-36df-49e3-9ba6-076197300ab2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:55.354362 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599179be-36df-49e3-9ba6-076197300ab2 service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:55.365103 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1409/2844] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:56.944483 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59ceed-004a-422f-b934-562bc9f7d50c None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:56.945059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59ceed-004a-422f-b934-562bc9f7d50c None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:56.945059 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59ceed-004a-422f-b934-562bc9f7d50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:56.970810 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-dc59ceed-004a-422f-b934-562bc9f7d50c None None] MFA Rules not processed for user `6cc61dd768cc47828facbf027f913f58`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:56.972886 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-dc59ceed-004a-422f-b934-562bc9f7d50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:56.985130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1436/2845] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:00:57.632924 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599179be-36df-49e3-9ba6-076197300ab2 service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:57.633925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-599179be-36df-49e3-9ba6-076197300ab2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:57.754761 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599179be-36df-49e3-9ba6-076197300ab2 service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:57.760628 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0b1c5-4d1c-45dc-b056-7f25ee85c6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:57.761278 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0b1c5-4d1c-45dc-b056-7f25ee85c6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:57.761622 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0b1c5-4d1c-45dc-b056-7f25ee85c6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:57.761884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0b1c5-4d1c-45dc-b056-7f25ee85c6fa admin admin] PATH_INFO: `/v3/users/54cc5889eabb401586f349ab781280fe` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:57.763175 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0b1c5-4d1c-45dc-b056-7f25ee85c6fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=54cc5889eabb401586f349ab781280fe)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:57.765667 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0b1c5-4d1c-45dc-b056-7f25ee85c6fa admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:57.818373 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:57.831578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-69c0b1c5-4d1c-45dc-b056-7f25ee85c6fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54cc5889eabb401586f349ab781280fe'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:57.832396 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-69c0b1c5-4d1c-45dc-b056-7f25ee85c6fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54cc5889eabb401586f349ab781280fe'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:57.833759 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-69c0b1c5-4d1c-45dc-b056-7f25ee85c6fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54cc5889eabb401586f349ab781280fe'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:57.854520 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-69c0b1c5-4d1c-45dc-b056-7f25ee85c6fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54cc5889eabb401586f349ab781280fe'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:57.870134 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-69c0b1c5-4d1c-45dc-b056-7f25ee85c6fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54cc5889eabb401586f349ab781280fe'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:57.888365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1410/2846] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:00:57 2022] DELETE /identity/v3/users/54cc5889eabb401586f349ab781280fe => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:00:57.897187 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca45cfd-af7f-4d7a-8a79-5dc7b4dff98f None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:57.897187 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca45cfd-af7f-4d7a-8a79-5dc7b4dff98f None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:57.897187 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca45cfd-af7f-4d7a-8a79-5dc7b4dff98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:57.917351 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-aca45cfd-af7f-4d7a-8a79-5dc7b4dff98f None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:00:57.918609 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-aca45cfd-af7f-4d7a-8a79-5dc7b4dff98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:57.984316 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1437/2847] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:00:57.994547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0b1c5-4d1c-45dc-b056-7f25ee85c6fa admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:57.996029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-69c0b1c5-4d1c-45dc-b056-7f25ee85c6fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:58.062989 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0b1c5-4d1c-45dc-b056-7f25ee85c6fa admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:58.066766 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e7f49-a1f6-4d3e-8743-c4acbcc69e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:58.067396 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e7f49-a1f6-4d3e-8743-c4acbcc69e9b service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:58.067666 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e7f49-a1f6-4d3e-8743-c4acbcc69e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:58.067941 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e7f49-a1f6-4d3e-8743-c4acbcc69e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:58.077677 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e7f49-a1f6-4d3e-8743-c4acbcc69e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:58.079309 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e7f49-a1f6-4d3e-8743-c4acbcc69e9b service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:58.093435 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1411/2848] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:00:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:00:58.379696 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca45cfd-af7f-4d7a-8a79-5dc7b4dff98f None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:00:58.381186 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-aca45cfd-af7f-4d7a-8a79-5dc7b4dff98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:00:58.400620 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca45cfd-af7f-4d7a-8a79-5dc7b4dff98f None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:00:58.411056 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:00:58.411802 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:00:58.412085 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:00:58.412856 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab admin admin] PATH_INFO: `/v3/projects/1424a4b780494313ab7169c01041c03c` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:00:58.415289 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=1424a4b780494313ab7169c01041c03c)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:00:58.417431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:00:58.456373 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:58.473042 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1424a4b780494313ab7169c01041c03c', 'request_id': 'req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:58.483763 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1424a4b780494313ab7169c01041c03c', 'request_id': 'req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:58.489971 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1424a4b780494313ab7169c01041c03c', 'request_id': 'req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:58.502003 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab admin admin] The token cache is being invalidate because project 1424a4b780494313ab7169c01041c03c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:00:58.502382 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:58.503167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:00:58.517389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1438/2849] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:00:58 2022] DELETE /identity/v3/projects/1424a4b780494313ab7169c01041c03c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:01:02.727421 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e7f49-a1f6-4d3e-8743-c4acbcc69e9b service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:02.729634 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-731e7f49-a1f6-4d3e-8743-c4acbcc69e9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:02.845449 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e7f49-a1f6-4d3e-8743-c4acbcc69e9b service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:02.898291 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:02.921011 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc823e38-fd20-4dd2-9b2a-1eb00d5465bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:02.922164 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc823e38-fd20-4dd2-9b2a-1eb00d5465bb service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:02.922835 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc823e38-fd20-4dd2-9b2a-1eb00d5465bb service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:02.924047 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc823e38-fd20-4dd2-9b2a-1eb00d5465bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:02.925925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-fc823e38-fd20-4dd2-9b2a-1eb00d5465bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:03.029547 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc823e38-fd20-4dd2-9b2a-1eb00d5465bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:03.031216 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc823e38-fd20-4dd2-9b2a-1eb00d5465bb service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:03.041982 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1412/2850] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:01:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:01:08.498808 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=13,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:12.554440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:12.556188 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:12.676932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b670b-c323-4ee4-9794-5aefb6bf2bab admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:12.683495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342fc5e-7f4b-4384-8dfe-c6083ae01600 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4395ee0a00df41adacb55b4a8684786b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:12.684113 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342fc5e-7f4b-4384-8dfe-c6083ae01600 service placement] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:12.684391 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342fc5e-7f4b-4384-8dfe-c6083ae01600 service placement] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:12.684657 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342fc5e-7f4b-4384-8dfe-c6083ae01600 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:12.686723 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-7342fc5e-7f4b-4384-8dfe-c6083ae01600 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:12.699368 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342fc5e-7f4b-4384-8dfe-c6083ae01600 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:12.700385 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342fc5e-7f4b-4384-8dfe-c6083ae01600 service placement] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:12.711130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1439/2851] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:01:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:01:13.037098 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=39 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:13.992528 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa2837-ae9b-4599-a05d-0dbe6c75b252 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:13.992804 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa2837-ae9b-4599-a05d-0dbe6c75b252 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:13.993074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa2837-ae9b-4599-a05d-0dbe6c75b252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:14.022737 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-36fa2837-ae9b-4599-a05d-0dbe6c75b252 None None] MFA Rules not processed for user `e1f49820de264982aeec97fa0be3c290`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:14.023927 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-36fa2837-ae9b-4599-a05d-0dbe6c75b252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:14.087010 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1413/2852] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Sep 13 00:01:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:14.128789 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342fc5e-7f4b-4384-8dfe-c6083ae01600 service placement] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:14.130283 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-7342fc5e-7f4b-4384-8dfe-c6083ae01600 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:14.210460 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342fc5e-7f4b-4384-8dfe-c6083ae01600 service placement] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:14.215607 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b9496-0f2e-4394-a6bb-95e16e5a7332 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c45ae3144b4fe8ab4e921fda30164a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:14.216223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b9496-0f2e-4394-a6bb-95e16e5a7332 service swift] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:14.216503 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b9496-0f2e-4394-a6bb-95e16e5a7332 service swift] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:14.216774 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b9496-0f2e-4394-a6bb-95e16e5a7332 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:14.225214 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b9496-0f2e-4394-a6bb-95e16e5a7332 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:14.226843 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b9496-0f2e-4394-a6bb-95e16e5a7332 service swift] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:14.235504 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1440/2853] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Sep 13 00:01:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 00:01:14.785613 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5e8f3-eb8a-41f0-a0c9-73788139d7c9 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:14.785909 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5e8f3-eb8a-41f0-a0c9-73788139d7c9 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:14.786172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5e8f3-eb8a-41f0-a0c9-73788139d7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:14.808246 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-94d5e8f3-eb8a-41f0-a0c9-73788139d7c9 None None] MFA Rules not processed for user `e1f49820de264982aeec97fa0be3c290`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:14.809671 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-94d5e8f3-eb8a-41f0-a0c9-73788139d7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:14.820702 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1414/2854] 10.222.0.23 () {58 vars in 967 bytes} [Tue Sep 13 00:01:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:14.836326 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b9496-0f2e-4394-a6bb-95e16e5a7332 service swift] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:14.850050 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b9496-0f2e-4394-a6bb-95e16e5a7332 service swift] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:14.857273 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440162e-6f28-4eb2-8ad7-ffb4b29a2023 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c45ae3144b4fe8ab4e921fda30164a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:14.858431 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440162e-6f28-4eb2-8ad7-ffb4b29a2023 service swift] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:14.858932 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440162e-6f28-4eb2-8ad7-ffb4b29a2023 service swift] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:14.859475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440162e-6f28-4eb2-8ad7-ffb4b29a2023 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:14.877093 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440162e-6f28-4eb2-8ad7-ffb4b29a2023 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:14.877093 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440162e-6f28-4eb2-8ad7-ffb4b29a2023 service swift] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:14.884373 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1441/2855] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Sep 13 00:01:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 00:01:15.172350 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba9c7b-88ef-487e-ad60-3545c06b1460 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:15.172836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba9c7b-88ef-487e-ad60-3545c06b1460 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:15.172968 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba9c7b-88ef-487e-ad60-3545c06b1460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:15.193439 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-f8ba9c7b-88ef-487e-ad60-3545c06b1460 None None] MFA Rules not processed for user `e1f49820de264982aeec97fa0be3c290`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:15.194591 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f8ba9c7b-88ef-487e-ad60-3545c06b1460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:15.202226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1415/2856] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Sep 13 00:01:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:15.214430 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440162e-6f28-4eb2-8ad7-ffb4b29a2023 service swift] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:15.225999 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440162e-6f28-4eb2-8ad7-ffb4b29a2023 service swift] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:15.233828 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffaec1-513f-4923-84a6-e7b53fc5c6a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c45ae3144b4fe8ab4e921fda30164a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:15.235227 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffaec1-513f-4923-84a6-e7b53fc5c6a1 service swift] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:15.235568 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffaec1-513f-4923-84a6-e7b53fc5c6a1 service swift] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:15.235905 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffaec1-513f-4923-84a6-e7b53fc5c6a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:15.248159 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffaec1-513f-4923-84a6-e7b53fc5c6a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:15.250397 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffaec1-513f-4923-84a6-e7b53fc5c6a1 service swift] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:15.261278 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1442/2857] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Sep 13 00:01:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 00:01:15.617767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218d9fe-cd6d-4d5b-b008-f9e1abc38919 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:15.617985 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218d9fe-cd6d-4d5b-b008-f9e1abc38919 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:15.618252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218d9fe-cd6d-4d5b-b008-f9e1abc38919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:15.638664 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-1218d9fe-cd6d-4d5b-b008-f9e1abc38919 None None] MFA Rules not processed for user `e1f49820de264982aeec97fa0be3c290`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:15.639896 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-1218d9fe-cd6d-4d5b-b008-f9e1abc38919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:15.647574 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1416/2858] 10.222.0.23 () {58 vars in 967 bytes} [Tue Sep 13 00:01:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:15.661535 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffaec1-513f-4923-84a6-e7b53fc5c6a1 service swift] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:15.673315 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffaec1-513f-4923-84a6-e7b53fc5c6a1 service swift] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:15.678853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992b710-ffd3-477a-9b22-abffa07dc34d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c45ae3144b4fe8ab4e921fda30164a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:15.679465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992b710-ffd3-477a-9b22-abffa07dc34d service swift] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:15.679741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992b710-ffd3-477a-9b22-abffa07dc34d service swift] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:15.680011 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992b710-ffd3-477a-9b22-abffa07dc34d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:15.686929 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=100 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:15.689685 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992b710-ffd3-477a-9b22-abffa07dc34d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:15.691256 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992b710-ffd3-477a-9b22-abffa07dc34d service swift] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:15.700356 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1443/2859] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Sep 13 00:01:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 00:01:17.936426 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218d9fe-cd6d-4d5b-b008-f9e1abc38919 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:17.938089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-1218d9fe-cd6d-4d5b-b008-f9e1abc38919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:18.081446 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218d9fe-cd6d-4d5b-b008-f9e1abc38919 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:18.086578 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0146120-72d9-490d-9a42-b3f8897c7c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:18.087291 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0146120-72d9-490d-9a42-b3f8897c7c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:18.087543 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0146120-72d9-490d-9a42-b3f8897c7c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:18.087882 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0146120-72d9-490d-9a42-b3f8897c7c90 admin admin] PATH_INFO: `/v3/users/6cc61dd768cc47828facbf027f913f58` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:18.089234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0146120-72d9-490d-9a42-b3f8897c7c90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc61dd768cc47828facbf027f913f58)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:18.091279 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0146120-72d9-490d-9a42-b3f8897c7c90 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:18.145974 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:18.148829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c0146120-72d9-490d-9a42-b3f8897c7c90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc61dd768cc47828facbf027f913f58'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:18.150398 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c0146120-72d9-490d-9a42-b3f8897c7c90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc61dd768cc47828facbf027f913f58'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:18.151472 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c0146120-72d9-490d-9a42-b3f8897c7c90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc61dd768cc47828facbf027f913f58'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:18.168218 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c0146120-72d9-490d-9a42-b3f8897c7c90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc61dd768cc47828facbf027f913f58'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:18.176508 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-c0146120-72d9-490d-9a42-b3f8897c7c90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc61dd768cc47828facbf027f913f58'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:18.191458 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1417/2860] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:01:17 2022] DELETE /identity/v3/users/6cc61dd768cc47828facbf027f913f58 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:01:18.196129 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bff7e-03f0-4434-b573-831e7f6aba90 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:18.196665 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bff7e-03f0-4434-b573-831e7f6aba90 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:18.196665 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bff7e-03f0-4434-b573-831e7f6aba90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:18.226277 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-824bff7e-03f0-4434-b573-831e7f6aba90 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:18.228377 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-824bff7e-03f0-4434-b573-831e7f6aba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:18.297002 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1444/2861] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:18.310374 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0146120-72d9-490d-9a42-b3f8897c7c90 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:18.311992 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c0146120-72d9-490d-9a42-b3f8897c7c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:18.401085 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0146120-72d9-490d-9a42-b3f8897c7c90 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:18.405070 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d4a3f-a6f5-4638-a393-87dd46fa344b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:18.405725 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d4a3f-a6f5-4638-a393-87dd46fa344b service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:18.406109 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d4a3f-a6f5-4638-a393-87dd46fa344b service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:18.406432 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d4a3f-a6f5-4638-a393-87dd46fa344b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:18.417274 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d4a3f-a6f5-4638-a393-87dd46fa344b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:18.418821 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d4a3f-a6f5-4638-a393-87dd46fa344b service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:18.430284 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1418/2862] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:01:18.621272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bff7e-03f0-4434-b573-831e7f6aba90 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:18.623127 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-824bff7e-03f0-4434-b573-831e7f6aba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:18.637408 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bff7e-03f0-4434-b573-831e7f6aba90 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:18.643213 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90d49c-fe60-490a-83c0-cc4748f1b0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:18.644091 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90d49c-fe60-490a-83c0-cc4748f1b0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:18.644474 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90d49c-fe60-490a-83c0-cc4748f1b0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:18.644819 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90d49c-fe60-490a-83c0-cc4748f1b0bb admin admin] PATH_INFO: `/v3/projects/17b8a08b8e6045bd9609b8f5bba09e6e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:18.646241 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90d49c-fe60-490a-83c0-cc4748f1b0bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b8a08b8e6045bd9609b8f5bba09e6e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:18.649833 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90d49c-fe60-490a-83c0-cc4748f1b0bb admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:18.741435 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-fe90d49c-fe60-490a-83c0-cc4748f1b0bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b8a08b8e6045bd9609b8f5bba09e6e', 'request_id': 'req-fe90d49c-fe60-490a-83c0-cc4748f1b0bb'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:18.751640 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-fe90d49c-fe60-490a-83c0-cc4748f1b0bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b8a08b8e6045bd9609b8f5bba09e6e', 'request_id': 'req-fe90d49c-fe60-490a-83c0-cc4748f1b0bb'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:18.761218 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-fe90d49c-fe60-490a-83c0-cc4748f1b0bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b8a08b8e6045bd9609b8f5bba09e6e', 'request_id': 'req-fe90d49c-fe60-490a-83c0-cc4748f1b0bb'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:18.779983 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-fe90d49c-fe60-490a-83c0-cc4748f1b0bb admin admin] The token cache is being invalidate because project 17b8a08b8e6045bd9609b8f5bba09e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:01:18.780491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-fe90d49c-fe60-490a-83c0-cc4748f1b0bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:18.781823 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-fe90d49c-fe60-490a-83c0-cc4748f1b0bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:18.784566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1445/2863] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:01:18 2022] DELETE /identity/v3/projects/17b8a08b8e6045bd9609b8f5bba09e6e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:01:18.793372 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1baeba-3f6a-4b19-8df1-8d0b302883ae None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:18.794004 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1baeba-3f6a-4b19-8df1-8d0b302883ae None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:18.794491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1baeba-3f6a-4b19-8df1-8d0b302883ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:18.863742 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-4d1baeba-3f6a-4b19-8df1-8d0b302883ae None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:18.864900 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4d1baeba-3f6a-4b19-8df1-8d0b302883ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:18.934646 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1419/2864] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:18.944167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a1e32-a555-4c74-beed-d553a30c34bd None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:18.944505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a1e32-a555-4c74-beed-d553a30c34bd None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:18.944816 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a1e32-a555-4c74-beed-d553a30c34bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:18.967790 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-725a1e32-a555-4c74-beed-d553a30c34bd None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:18.969052 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-725a1e32-a555-4c74-beed-d553a30c34bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:18.978444 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1446/2865] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:18.983056 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1baeba-3f6a-4b19-8df1-8d0b302883ae None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:18.995065 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1baeba-3f6a-4b19-8df1-8d0b302883ae None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:19.002156 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8dc7d-b8d2-4da7-8ccd-af36c5955731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:19.002882 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8dc7d-b8d2-4da7-8ccd-af36c5955731 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:19.003252 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8dc7d-b8d2-4da7-8ccd-af36c5955731 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:19.003526 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8dc7d-b8d2-4da7-8ccd-af36c5955731 admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:19.004261 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8dc7d-b8d2-4da7-8ccd-af36c5955731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 00:01:19.004606 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8dc7d-b8d2-4da7-8ccd-af36c5955731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:19.007233 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8dc7d-b8d2-4da7-8ccd-af36c5955731 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:19.023555 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1420/2866] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Sep 13 00:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 00:01:19.028125 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a1e32-a555-4c74-beed-d553a30c34bd None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:19.038167 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a1e32-a555-4c74-beed-d553a30c34bd None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:19.043953 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7a3d9-fbe6-41b2-8a78-62a2ede40aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:19.044588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7a3d9-fbe6-41b2-8a78-62a2ede40aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:19.044860 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7a3d9-fbe6-41b2-8a78-62a2ede40aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:19.045125 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7a3d9-fbe6-41b2-8a78-62a2ede40aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:19.046200 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7a3d9-fbe6-41b2-8a78-62a2ede40aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:19.048472 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7a3d9-fbe6-41b2-8a78-62a2ede40aa6 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:19.080538 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1447/2867] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:01:19 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:01:19.084727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8dc7d-b8d2-4da7-8ccd-af36c5955731 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:19.097800 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8dc7d-b8d2-4da7-8ccd-af36c5955731 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:19.105800 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:19.189940 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92177c1-4f0c-4e8a-9db4-0fb806a5e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:19.190583 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92177c1-4f0c-4e8a-9db4-0fb806a5e573 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:19.190863 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92177c1-4f0c-4e8a-9db4-0fb806a5e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:19.191137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92177c1-4f0c-4e8a-9db4-0fb806a5e573 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:19.191798 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92177c1-4f0c-4e8a-9db4-0fb806a5e573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:19.193839 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92177c1-4f0c-4e8a-9db4-0fb806a5e573 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:19.219037 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1421/2868] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:01:19 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:01:19.223606 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7a3d9-fbe6-41b2-8a78-62a2ede40aa6 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:19.235718 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7a3d9-fbe6-41b2-8a78-62a2ede40aa6 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:19.241246 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b8c65-9b4a-49bb-89d2-33677717f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:19.241572 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b8c65-9b4a-49bb-89d2-33677717f3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:19.241853 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b8c65-9b4a-49bb-89d2-33677717f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:19.242124 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b8c65-9b4a-49bb-89d2-33677717f3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:19.242874 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b8c65-9b4a-49bb-89d2-33677717f3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:19.244495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b8c65-9b4a-49bb-89d2-33677717f3a5 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:19.256636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1448/2869] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:01:19.262588 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92177c1-4f0c-4e8a-9db4-0fb806a5e573 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:19.273502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92177c1-4f0c-4e8a-9db4-0fb806a5e573 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:19.278580 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe46f46-44b4-4741-9184-2efc3e89eba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:19.279211 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe46f46-44b4-4741-9184-2efc3e89eba5 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:19.279489 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe46f46-44b4-4741-9184-2efc3e89eba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:19.279757 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe46f46-44b4-4741-9184-2efc3e89eba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:19.280418 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe46f46-44b4-4741-9184-2efc3e89eba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:19.282158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe46f46-44b4-4741-9184-2efc3e89eba5 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:19.300158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1422/2870] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:01:19.306568 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b8c65-9b4a-49bb-89d2-33677717f3a5 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:19.317324 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b8c65-9b4a-49bb-89d2-33677717f3a5 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:19.322925 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cfe93-4359-4831-ac8a-69dd92e78697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:19.323652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cfe93-4359-4831-ac8a-69dd92e78697 admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:19.323951 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cfe93-4359-4831-ac8a-69dd92e78697 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:19.324211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cfe93-4359-4831-ac8a-69dd92e78697 admin admin] PATH_INFO: `/v3/projects/236b49ff2a8a4b7aaf201688cf76903d/users/6f924ea9b813410caa0cc9b04a87500f/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:19.343392 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cfe93-4359-4831-ac8a-69dd92e78697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=236b49ff2a8a4b7aaf201688cf76903d, user_id=6f924ea9b813410caa0cc9b04a87500f, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:19.349273 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cfe93-4359-4831-ac8a-69dd92e78697 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:19.371722 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1449/2871] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:01:19 2022] PUT /identity/v3/projects/236b49ff2a8a4b7aaf201688cf76903d/users/6f924ea9b813410caa0cc9b04a87500f/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:01:19.378046 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739191e1-180b-4f90-8acb-e66fd5ccb9d7 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:19.378477 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739191e1-180b-4f90-8acb-e66fd5ccb9d7 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:19.378853 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739191e1-180b-4f90-8acb-e66fd5ccb9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:19.400610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-739191e1-180b-4f90-8acb-e66fd5ccb9d7 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:19.402290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-739191e1-180b-4f90-8acb-e66fd5ccb9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:19.486029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1423/2872] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:19.499705 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cfe93-4359-4831-ac8a-69dd92e78697 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:19.501851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-e84cfe93-4359-4831-ac8a-69dd92e78697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:19.513712 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:19.570498 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cfe93-4359-4831-ac8a-69dd92e78697 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:19.575823 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce273d0-6d79-47ba-a502-44024bbc58a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:19.576910 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce273d0-6d79-47ba-a502-44024bbc58a2 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:19.577569 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce273d0-6d79-47ba-a502-44024bbc58a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:19.578040 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce273d0-6d79-47ba-a502-44024bbc58a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:19.593046 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce273d0-6d79-47ba-a502-44024bbc58a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:19.594553 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce273d0-6d79-47ba-a502-44024bbc58a2 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:19.609742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1450/2873] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 00:01:24.059781 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739191e1-180b-4f90-8acb-e66fd5ccb9d7 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:24.061929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-739191e1-180b-4f90-8acb-e66fd5ccb9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:24.079166 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739191e1-180b-4f90-8acb-e66fd5ccb9d7 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:24.084982 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf2c71-2bb3-480d-a0d4-7514d604b5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:24.085903 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf2c71-2bb3-480d-a0d4-7514d604b5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:24.086186 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf2c71-2bb3-480d-a0d4-7514d604b5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:24.089829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf2c71-2bb3-480d-a0d4-7514d604b5cf admin admin] PATH_INFO: `/v3/users/10b68e2d9e5c44da926a637b54b38968` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:24.089829 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf2c71-2bb3-480d-a0d4-7514d604b5cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b68e2d9e5c44da926a637b54b38968)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:24.091026 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf2c71-2bb3-480d-a0d4-7514d604b5cf admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:24.155918 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cdcf2c71-2bb3-480d-a0d4-7514d604b5cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b68e2d9e5c44da926a637b54b38968'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:24.156871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cdcf2c71-2bb3-480d-a0d4-7514d604b5cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b68e2d9e5c44da926a637b54b38968'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:24.157823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cdcf2c71-2bb3-480d-a0d4-7514d604b5cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b68e2d9e5c44da926a637b54b38968'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:24.174185 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cdcf2c71-2bb3-480d-a0d4-7514d604b5cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b68e2d9e5c44da926a637b54b38968'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:24.188922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cdcf2c71-2bb3-480d-a0d4-7514d604b5cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b68e2d9e5c44da926a637b54b38968'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:24.200499 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:24.210644 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1424/2874] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:01:24 2022] DELETE /identity/v3/users/10b68e2d9e5c44da926a637b54b38968 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:01:24.470273 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce273d0-6d79-47ba-a502-44024bbc58a2 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:24.483800 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce273d0-6d79-47ba-a502-44024bbc58a2 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:24.555517 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228997a1-4e7e-4b67-9739-a049c8fff7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:24.556195 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228997a1-4e7e-4b67-9739-a049c8fff7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:24.556475 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228997a1-4e7e-4b67-9739-a049c8fff7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:24.556907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228997a1-4e7e-4b67-9739-a049c8fff7c4 admin admin] PATH_INFO: `/v3/projects/edbec18f7d3f404793f0dda7acae0702` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:24.558439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228997a1-4e7e-4b67-9739-a049c8fff7c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edbec18f7d3f404793f0dda7acae0702)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:24.560635 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228997a1-4e7e-4b67-9739-a049c8fff7c4 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:24.595986 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e713c-8f32-4b12-9bb6-955677bc862e None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:24.596356 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e713c-8f32-4b12-9bb6-955677bc862e None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:24.596693 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e713c-8f32-4b12-9bb6-955677bc862e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:24.626919 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-228997a1-4e7e-4b67-9739-a049c8fff7c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edbec18f7d3f404793f0dda7acae0702', 'request_id': 'req-228997a1-4e7e-4b67-9739-a049c8fff7c4'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:24.636793 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-4b8e713c-8f32-4b12-9bb6-955677bc862e None None] MFA Rules not processed for user `6f924ea9b813410caa0cc9b04a87500f`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:24.638073 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4b8e713c-8f32-4b12-9bb6-955677bc862e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:24.639342 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-228997a1-4e7e-4b67-9739-a049c8fff7c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edbec18f7d3f404793f0dda7acae0702', 'request_id': 'req-228997a1-4e7e-4b67-9739-a049c8fff7c4'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:24.645476 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-228997a1-4e7e-4b67-9739-a049c8fff7c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edbec18f7d3f404793f0dda7acae0702', 'request_id': 'req-228997a1-4e7e-4b67-9739-a049c8fff7c4'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:24.657746 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-228997a1-4e7e-4b67-9739-a049c8fff7c4 admin admin] The token cache is being invalidate because project edbec18f7d3f404793f0dda7acae0702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:01:24.658037 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-228997a1-4e7e-4b67-9739-a049c8fff7c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:24.658687 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-228997a1-4e7e-4b67-9739-a049c8fff7c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:24.660198 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1451/2875] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:01:24 2022] DELETE /identity/v3/projects/edbec18f7d3f404793f0dda7acae0702 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:01:24.664163 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228997a1-4e7e-4b67-9739-a049c8fff7c4 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:24.665647 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-228997a1-4e7e-4b67-9739-a049c8fff7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:24.710921 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1425/2876] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:01:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:01:24.713542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:24.715894 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e713c-8f32-4b12-9bb6-955677bc862e None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:24.717240 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4b8e713c-8f32-4b12-9bb6-955677bc862e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:24.745715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228997a1-4e7e-4b67-9739-a049c8fff7c4 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:24.752206 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4be9a9-1079-4fec-b776-83c466a38825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:24.752813 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4be9a9-1079-4fec-b776-83c466a38825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:24.753823 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4be9a9-1079-4fec-b776-83c466a38825 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:24.754105 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4be9a9-1079-4fec-b776-83c466a38825 admin admin] PATH_INFO: `/v3/users/1e4cbc0e088441068156dd38f70dc46e` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:24.755519 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4be9a9-1079-4fec-b776-83c466a38825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4cbc0e088441068156dd38f70dc46e)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:24.757567 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4be9a9-1079-4fec-b776-83c466a38825 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:24.791369 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e713c-8f32-4b12-9bb6-955677bc862e None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:24.796909 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd13196-9191-4e95-a677-42d69ee50fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:24.797550 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd13196-9191-4e95-a677-42d69ee50fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:24.797835 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd13196-9191-4e95-a677-42d69ee50fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:24.798146 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd13196-9191-4e95-a677-42d69ee50fe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:24.798850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd13196-9191-4e95-a677-42d69ee50fe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:24.800763 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd13196-9191-4e95-a677-42d69ee50fe7 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:24.811925 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-0b4be9a9-1079-4fec-b776-83c466a38825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4cbc0e088441068156dd38f70dc46e'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:24.819950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-0b4be9a9-1079-4fec-b776-83c466a38825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4cbc0e088441068156dd38f70dc46e'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:24.833217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1426/2877] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:01:24 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:01:24.833511 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-0b4be9a9-1079-4fec-b776-83c466a38825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4cbc0e088441068156dd38f70dc46e'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:24.834597 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd13196-9191-4e95-a677-42d69ee50fe7 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:24.844462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-0b4be9a9-1079-4fec-b776-83c466a38825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4cbc0e088441068156dd38f70dc46e'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:24.845479 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-0b4be9a9-1079-4fec-b776-83c466a38825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4cbc0e088441068156dd38f70dc46e'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:24.855906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1452/2878] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:01:24 2022] DELETE /identity/v3/users/1e4cbc0e088441068156dd38f70dc46e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:01:24.907269 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd13196-9191-4e95-a677-42d69ee50fe7 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:24.926401 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:24.972908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf926a-f91e-4c17-94e8-32802483c1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:24.973687 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf926a-f91e-4c17-94e8-32802483c1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:24.974030 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf926a-f91e-4c17-94e8-32802483c1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:24.974363 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf926a-f91e-4c17-94e8-32802483c1a5 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:24.975078 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf926a-f91e-4c17-94e8-32802483c1a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:24.977099 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf926a-f91e-4c17-94e8-32802483c1a5 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:25.007997 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1427/2879] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:01:24 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:01:25.010009 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4be9a9-1079-4fec-b776-83c466a38825 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:25.011462 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-0b4be9a9-1079-4fec-b776-83c466a38825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:25.035015 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4be9a9-1079-4fec-b776-83c466a38825 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:25.043077 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81325303-74b6-4f2f-bb20-d72e8d4e432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:25.043800 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81325303-74b6-4f2f-bb20-d72e8d4e432f admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:25.044130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81325303-74b6-4f2f-bb20-d72e8d4e432f admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:25.044505 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81325303-74b6-4f2f-bb20-d72e8d4e432f admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:25.045318 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81325303-74b6-4f2f-bb20-d72e8d4e432f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:25.047605 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81325303-74b6-4f2f-bb20-d72e8d4e432f admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:25.065111 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1453/2880] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:01:25.065974 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf926a-f91e-4c17-94e8-32802483c1a5 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:25.068501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-babf926a-f91e-4c17-94e8-32802483c1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:25.069285 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81325303-74b6-4f2f-bb20-d72e8d4e432f admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:25.083965 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81325303-74b6-4f2f-bb20-d72e8d4e432f admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:25.090171 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf926a-f91e-4c17-94e8-32802483c1a5 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:25.094372 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbf9f7-2d6b-44e0-acd2-df9e5fcd28ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:25.095838 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbf9f7-2d6b-44e0-acd2-df9e5fcd28ea admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:25.096280 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbf9f7-2d6b-44e0-acd2-df9e5fcd28ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:25.096495 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76f73d-0e73-438b-bf3b-08d503e07bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:25.097653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbf9f7-2d6b-44e0-acd2-df9e5fcd28ea admin admin] PATH_INFO: `/v3/projects/8097b3c62b01476b81a672aa7595b052/users/f7be2776ed4f4e0b99d67f26ef15f4ea/roles/440092230f024959a90e846ab29c6367` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:25.101784 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76f73d-0e73-438b-bf3b-08d503e07bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:25.102586 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76f73d-0e73-438b-bf3b-08d503e07bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:25.103219 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76f73d-0e73-438b-bf3b-08d503e07bb4 admin admin] PATH_INFO: `/v3/projects/760b62d9691e4a618b379817a115908b` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:25.104754 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76f73d-0e73-438b-bf3b-08d503e07bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=760b62d9691e4a618b379817a115908b)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:25.110863 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76f73d-0e73-438b-bf3b-08d503e07bb4 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:25.124177 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbf9f7-2d6b-44e0-acd2-df9e5fcd28ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8097b3c62b01476b81a672aa7595b052, user_id=f7be2776ed4f4e0b99d67f26ef15f4ea, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:25.128185 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbf9f7-2d6b-44e0-acd2-df9e5fcd28ea admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:25.147063 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1454/2881] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:01:25 2022] PUT /identity/v3/projects/8097b3c62b01476b81a672aa7595b052/users/f7be2776ed4f4e0b99d67f26ef15f4ea/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:01:25.151457 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbf9f7-2d6b-44e0-acd2-df9e5fcd28ea admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:25.186774 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cb76f73d-0e73-438b-bf3b-08d503e07bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760b62d9691e4a618b379817a115908b', 'request_id': 'req-cb76f73d-0e73-438b-bf3b-08d503e07bb4'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:25.193513 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cb76f73d-0e73-438b-bf3b-08d503e07bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760b62d9691e4a618b379817a115908b', 'request_id': 'req-cb76f73d-0e73-438b-bf3b-08d503e07bb4'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:25.203425 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cb76f73d-0e73-438b-bf3b-08d503e07bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760b62d9691e4a618b379817a115908b', 'request_id': 'req-cb76f73d-0e73-438b-bf3b-08d503e07bb4'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:25.223598 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cb76f73d-0e73-438b-bf3b-08d503e07bb4 admin admin] The token cache is being invalidate because project 760b62d9691e4a618b379817a115908b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:01:25.223884 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cb76f73d-0e73-438b-bf3b-08d503e07bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:25.224559 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-cb76f73d-0e73-438b-bf3b-08d503e07bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:25.229747 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1428/2882] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:01:25 2022] DELETE /identity/v3/projects/760b62d9691e4a618b379817a115908b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:01:25.231307 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1762a5e-0272-4045-bc6d-5475e9ff3ab4 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:25.231590 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1762a5e-0272-4045-bc6d-5475e9ff3ab4 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:25.231858 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1762a5e-0272-4045-bc6d-5475e9ff3ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:25.255527 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-b1762a5e-0272-4045-bc6d-5475e9ff3ab4 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:25.256818 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-b1762a5e-0272-4045-bc6d-5475e9ff3ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:25.260173 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbf9f7-2d6b-44e0-acd2-df9e5fcd28ea admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:25.305334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:25.340142 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1429/2883] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:25.354603 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e6f7c-8f5e-4b70-be4d-32a11e3e6abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:25.355260 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e6f7c-8f5e-4b70-be4d-32a11e3e6abb admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:25.355537 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e6f7c-8f5e-4b70-be4d-32a11e3e6abb admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:25.355806 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e6f7c-8f5e-4b70-be4d-32a11e3e6abb admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:25.356484 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e6f7c-8f5e-4b70-be4d-32a11e3e6abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:25.358332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e6f7c-8f5e-4b70-be4d-32a11e3e6abb admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:25.383120 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1762a5e-0272-4045-bc6d-5475e9ff3ab4 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:25.383674 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1455/2884] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:01:25.385569 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-b1762a5e-0272-4045-bc6d-5475e9ff3ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:25.403012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1762a5e-0272-4045-bc6d-5475e9ff3ab4 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:25.409925 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d324f3e-0982-4cbd-b64f-1f272b0c8c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:25.410332 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eccb5b-5bdf-4a95-8442-ad99bad59c64 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:25.410620 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d324f3e-0982-4cbd-b64f-1f272b0c8c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:25.410901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d324f3e-0982-4cbd-b64f-1f272b0c8c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:25.411176 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d324f3e-0982-4cbd-b64f-1f272b0c8c93 admin admin] PATH_INFO: `/v3/projects/8097b3c62b01476b81a672aa7595b052/users/f7be2776ed4f4e0b99d67f26ef15f4ea/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:25.411364 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eccb5b-5bdf-4a95-8442-ad99bad59c64 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:25.411805 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eccb5b-5bdf-4a95-8442-ad99bad59c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:25.413202 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d324f3e-0982-4cbd-b64f-1f272b0c8c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8097b3c62b01476b81a672aa7595b052, user_id=f7be2776ed4f4e0b99d67f26ef15f4ea, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:25.415953 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d324f3e-0982-4cbd-b64f-1f272b0c8c93 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:25.433391 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1430/2885] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:01:25 2022] PUT /identity/v3/projects/8097b3c62b01476b81a672aa7595b052/users/f7be2776ed4f4e0b99d67f26ef15f4ea/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:01:25.445616 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-c2eccb5b-5bdf-4a95-8442-ad99bad59c64 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:25.447492 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-c2eccb5b-5bdf-4a95-8442-ad99bad59c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:25.530224 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1456/2886] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:25.534983 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d324f3e-0982-4cbd-b64f-1f272b0c8c93 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:25.551869 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d324f3e-0982-4cbd-b64f-1f272b0c8c93 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:25.559299 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f64302-fbb5-4c66-9d5e-d96931d669be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:25.559836 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f64302-fbb5-4c66-9d5e-d96931d669be admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:25.560276 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f64302-fbb5-4c66-9d5e-d96931d669be admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:25.561089 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f64302-fbb5-4c66-9d5e-d96931d669be admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:25.561803 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f64302-fbb5-4c66-9d5e-d96931d669be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 00:01:25.562163 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f64302-fbb5-4c66-9d5e-d96931d669be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:25.563999 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f64302-fbb5-4c66-9d5e-d96931d669be admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:25.579379 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1431/2887] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Sep 13 00:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 00:01:25.584196 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eccb5b-5bdf-4a95-8442-ad99bad59c64 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:25.594766 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eccb5b-5bdf-4a95-8442-ad99bad59c64 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:25.601334 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f649243-f556-49cd-aaab-8a362cd5ec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:25.602005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f649243-f556-49cd-aaab-8a362cd5ec38 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:25.602445 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f649243-f556-49cd-aaab-8a362cd5ec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:25.602721 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f649243-f556-49cd-aaab-8a362cd5ec38 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:25.603845 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f649243-f556-49cd-aaab-8a362cd5ec38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:25.606173 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f649243-f556-49cd-aaab-8a362cd5ec38 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:25.645389 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1457/2888] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:01:25 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:01:25.649249 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f64302-fbb5-4c66-9d5e-d96931d669be admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:25.661320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f64302-fbb5-4c66-9d5e-d96931d669be admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:25.669136 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:25.743245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1348ee-a95a-493c-a2fc-6befcf4cd1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:25.743956 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1348ee-a95a-493c-a2fc-6befcf4cd1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:25.744296 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1348ee-a95a-493c-a2fc-6befcf4cd1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:25.744629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1348ee-a95a-493c-a2fc-6befcf4cd1a2 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:25.745459 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1348ee-a95a-493c-a2fc-6befcf4cd1a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:25.747493 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1348ee-a95a-493c-a2fc-6befcf4cd1a2 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:25.774451 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1432/2889] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:01:25 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:01:25.776286 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f649243-f556-49cd-aaab-8a362cd5ec38 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:25.788808 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f649243-f556-49cd-aaab-8a362cd5ec38 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:25.793644 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00220025-7308-4415-a79d-6565d8b1b0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:25.794290 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00220025-7308-4415-a79d-6565d8b1b0db admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:25.795741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00220025-7308-4415-a79d-6565d8b1b0db admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:25.795741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00220025-7308-4415-a79d-6565d8b1b0db admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:25.796829 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00220025-7308-4415-a79d-6565d8b1b0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:25.798899 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00220025-7308-4415-a79d-6565d8b1b0db admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:25.813272 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1458/2890] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:01:25.820901 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1348ee-a95a-493c-a2fc-6befcf4cd1a2 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:25.842172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1348ee-a95a-493c-a2fc-6befcf4cd1a2 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:25.848320 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27d520-804f-4368-b690-07a511f42101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:25.848962 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27d520-804f-4368-b690-07a511f42101 admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:25.849234 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27d520-804f-4368-b690-07a511f42101 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:25.849850 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27d520-804f-4368-b690-07a511f42101 admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:25.850301 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27d520-804f-4368-b690-07a511f42101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:25.852050 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27d520-804f-4368-b690-07a511f42101 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:25.868407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1433/2891] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:01:25.870591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00220025-7308-4415-a79d-6565d8b1b0db admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:25.882486 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00220025-7308-4415-a79d-6565d8b1b0db admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:25.888039 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba793a9d-7a21-43ec-8c72-4da163a052fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:25.888745 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba793a9d-7a21-43ec-8c72-4da163a052fa admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:25.889586 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba793a9d-7a21-43ec-8c72-4da163a052fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:25.889586 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba793a9d-7a21-43ec-8c72-4da163a052fa admin admin] PATH_INFO: `/v3/projects/a0a0608cb9bc46e590504ef9e41c7c2a/users/3bf7b3c9e769450ca2927c0b5b08aacb/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:25.905854 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba793a9d-7a21-43ec-8c72-4da163a052fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a0608cb9bc46e590504ef9e41c7c2a, user_id=3bf7b3c9e769450ca2927c0b5b08aacb, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:25.908566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba793a9d-7a21-43ec-8c72-4da163a052fa admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:25.925724 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1459/2892] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:01:25 2022] PUT /identity/v3/projects/a0a0608cb9bc46e590504ef9e41c7c2a/users/3bf7b3c9e769450ca2927c0b5b08aacb/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:01:25.936148 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e45306-c967-445c-ad84-495c8ec3967a None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:25.936502 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e45306-c967-445c-ad84-495c8ec3967a None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:25.936783 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e45306-c967-445c-ad84-495c8ec3967a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:25.969385 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-b5e45306-c967-445c-ad84-495c8ec3967a None None] MFA Rules not processed for user `3bf7b3c9e769450ca2927c0b5b08aacb`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:25.970661 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-b5e45306-c967-445c-ad84-495c8ec3967a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:26.057822 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1434/2893] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:01:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:26.070230 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba793a9d-7a21-43ec-8c72-4da163a052fa admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:26.072362 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ba793a9d-7a21-43ec-8c72-4da163a052fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:26.168087 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba793a9d-7a21-43ec-8c72-4da163a052fa admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:26.173751 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4690b-5504-44bd-9dde-155c31f2399d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:26.174703 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4690b-5504-44bd-9dde-155c31f2399d service cinder] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:26.175086 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4690b-5504-44bd-9dde-155c31f2399d service cinder] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:26.175851 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4690b-5504-44bd-9dde-155c31f2399d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:26.183206 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:26.186383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4690b-5504-44bd-9dde-155c31f2399d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:26.187908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4690b-5504-44bd-9dde-155c31f2399d service cinder] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:26.201223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1460/2894] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:01:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:01:26.222365 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e45306-c967-445c-ad84-495c8ec3967a None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:26.294838 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e45306-c967-445c-ad84-495c8ec3967a None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:26.300012 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c3276-ee35-420a-b4b0-9a2e73b75231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:26.300729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c3276-ee35-420a-b4b0-9a2e73b75231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:26.301005 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c3276-ee35-420a-b4b0-9a2e73b75231 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:26.301272 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c3276-ee35-420a-b4b0-9a2e73b75231 admin admin] PATH_INFO: `/v3/users/3bf7b3c9e769450ca2927c0b5b08aacb` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:26.302728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c3276-ee35-420a-b4b0-9a2e73b75231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf7b3c9e769450ca2927c0b5b08aacb)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:26.304641 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c3276-ee35-420a-b4b0-9a2e73b75231 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:26.324257 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:26.363059 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ce6c3276-ee35-420a-b4b0-9a2e73b75231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf7b3c9e769450ca2927c0b5b08aacb'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:26.363975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ce6c3276-ee35-420a-b4b0-9a2e73b75231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf7b3c9e769450ca2927c0b5b08aacb'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:26.364552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ce6c3276-ee35-420a-b4b0-9a2e73b75231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf7b3c9e769450ca2927c0b5b08aacb'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:26.377916 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ce6c3276-ee35-420a-b4b0-9a2e73b75231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf7b3c9e769450ca2927c0b5b08aacb'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:26.386347 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-ce6c3276-ee35-420a-b4b0-9a2e73b75231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf7b3c9e769450ca2927c0b5b08aacb'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:26.413823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1435/2895] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:01:26 2022] DELETE /identity/v3/users/3bf7b3c9e769450ca2927c0b5b08aacb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:01:26.419261 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fa7d2-1558-417c-acd3-0826fe0d7496 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:26.419556 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fa7d2-1558-417c-acd3-0826fe0d7496 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:26.419989 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fa7d2-1558-417c-acd3-0826fe0d7496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:26.454755 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-fa7fa7d2-1558-417c-acd3-0826fe0d7496 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:26.456116 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-fa7fa7d2-1558-417c-acd3-0826fe0d7496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:26.528784 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1461/2896] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:26.539776 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c3276-ee35-420a-b4b0-9a2e73b75231 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:26.541771 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-ce6c3276-ee35-420a-b4b0-9a2e73b75231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:26.617329 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c3276-ee35-420a-b4b0-9a2e73b75231 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:26.620975 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109be784-0256-4e5e-a8c1-b87e32a6cfa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:26.621801 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109be784-0256-4e5e-a8c1-b87e32a6cfa1 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:26.621926 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109be784-0256-4e5e-a8c1-b87e32a6cfa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:26.622172 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109be784-0256-4e5e-a8c1-b87e32a6cfa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:26.632772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109be784-0256-4e5e-a8c1-b87e32a6cfa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:26.634318 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109be784-0256-4e5e-a8c1-b87e32a6cfa1 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:26.645387 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1436/2897] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:01:27.008892 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fa7d2-1558-417c-acd3-0826fe0d7496 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:27.011626 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-fa7fa7d2-1558-417c-acd3-0826fe0d7496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:27.027440 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fa7d2-1558-417c-acd3-0826fe0d7496 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:27.034215 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80123afd-dce2-4385-8028-39ba66f7b2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:27.034921 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80123afd-dce2-4385-8028-39ba66f7b2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:27.035164 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80123afd-dce2-4385-8028-39ba66f7b2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:27.035491 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80123afd-dce2-4385-8028-39ba66f7b2dc admin admin] PATH_INFO: `/v3/projects/a0a0608cb9bc46e590504ef9e41c7c2a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:27.036685 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80123afd-dce2-4385-8028-39ba66f7b2dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0a0608cb9bc46e590504ef9e41c7c2a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:27.039014 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80123afd-dce2-4385-8028-39ba66f7b2dc admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:27.146087 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-80123afd-dce2-4385-8028-39ba66f7b2dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0a0608cb9bc46e590504ef9e41c7c2a', 'request_id': 'req-80123afd-dce2-4385-8028-39ba66f7b2dc'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:27.160436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-80123afd-dce2-4385-8028-39ba66f7b2dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0a0608cb9bc46e590504ef9e41c7c2a', 'request_id': 'req-80123afd-dce2-4385-8028-39ba66f7b2dc'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:27.171860 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-80123afd-dce2-4385-8028-39ba66f7b2dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0a0608cb9bc46e590504ef9e41c7c2a', 'request_id': 'req-80123afd-dce2-4385-8028-39ba66f7b2dc'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:27.202468 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-80123afd-dce2-4385-8028-39ba66f7b2dc admin admin] The token cache is being invalidate because project a0a0608cb9bc46e590504ef9e41c7c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:01:27.204414 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-80123afd-dce2-4385-8028-39ba66f7b2dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:27.207655 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-80123afd-dce2-4385-8028-39ba66f7b2dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:27.212345 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1462/2898] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:01:27 2022] DELETE /identity/v3/projects/a0a0608cb9bc46e590504ef9e41c7c2a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:01:27.223685 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11495bff-7b58-4caf-85b6-47a74accae53 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:27.229943 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11495bff-7b58-4caf-85b6-47a74accae53 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:27.234352 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11495bff-7b58-4caf-85b6-47a74accae53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:27.284929 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-11495bff-7b58-4caf-85b6-47a74accae53 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:27.286930 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-11495bff-7b58-4caf-85b6-47a74accae53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:27.397582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1437/2899] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:27.408479 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187efa53-7436-4b5c-a1dc-3454358a225c None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:27.408778 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187efa53-7436-4b5c-a1dc-3454358a225c None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:27.409480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187efa53-7436-4b5c-a1dc-3454358a225c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:27.450480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-187efa53-7436-4b5c-a1dc-3454358a225c None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:27.452142 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-187efa53-7436-4b5c-a1dc-3454358a225c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:27.471215 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1463/2900] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:27.476376 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11495bff-7b58-4caf-85b6-47a74accae53 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:27.488822 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11495bff-7b58-4caf-85b6-47a74accae53 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:27.495016 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66313a2c-57cd-426d-a050-4da58b41e3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:27.496516 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66313a2c-57cd-426d-a050-4da58b41e3db admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:27.498001 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66313a2c-57cd-426d-a050-4da58b41e3db admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:27.498504 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66313a2c-57cd-426d-a050-4da58b41e3db admin admin] PATH_INFO: `/v3/domains` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:27.499392 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66313a2c-57cd-426d-a050-4da58b41e3db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87848) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 00:01:27.500038 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66313a2c-57cd-426d-a050-4da58b41e3db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:27.502208 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66313a2c-57cd-426d-a050-4da58b41e3db admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:27.522253 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1438/2901] 10.222.0.23 () {58 vars in 1153 bytes} [Tue Sep 13 00:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 00:01:27.523436 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187efa53-7436-4b5c-a1dc-3454358a225c None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:27.535427 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187efa53-7436-4b5c-a1dc-3454358a225c None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:27.542718 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54517d8c-35e4-4951-80a9-67ea86b1fe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:27.543437 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54517d8c-35e4-4951-80a9-67ea86b1fe9d admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:27.543801 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54517d8c-35e4-4951-80a9-67ea86b1fe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:27.544324 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54517d8c-35e4-4951-80a9-67ea86b1fe9d admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:27.545144 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54517d8c-35e4-4951-80a9-67ea86b1fe9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:27.547915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54517d8c-35e4-4951-80a9-67ea86b1fe9d admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:27.590717 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1464/2902] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:01:27 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:01:27.595489 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66313a2c-57cd-426d-a050-4da58b41e3db admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:27.606672 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66313a2c-57cd-426d-a050-4da58b41e3db admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:27.631063 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:27.685672 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d419d5-dfd5-4f8a-aa41-6c9cb1feacf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:27.686396 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d419d5-dfd5-4f8a-aa41-6c9cb1feacf1 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:27.686617 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d419d5-dfd5-4f8a-aa41-6c9cb1feacf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:27.686729 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d419d5-dfd5-4f8a-aa41-6c9cb1feacf1 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:27.687536 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d419d5-dfd5-4f8a-aa41-6c9cb1feacf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:27.689647 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d419d5-dfd5-4f8a-aa41-6c9cb1feacf1 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:27.713380 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1439/2903] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:01:27 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:01:27.717223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54517d8c-35e4-4951-80a9-67ea86b1fe9d admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:27.728341 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54517d8c-35e4-4951-80a9-67ea86b1fe9d admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:27.734489 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b8d9d-a3b5-4815-b237-1ff8c25449b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:27.735226 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b8d9d-a3b5-4815-b237-1ff8c25449b1 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:27.735569 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b8d9d-a3b5-4815-b237-1ff8c25449b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:27.735908 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b8d9d-a3b5-4815-b237-1ff8c25449b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:27.736640 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b8d9d-a3b5-4815-b237-1ff8c25449b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:27.738369 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b8d9d-a3b5-4815-b237-1ff8c25449b1 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:27.749978 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1465/2904] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 00:01:27.754356 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d419d5-dfd5-4f8a-aa41-6c9cb1feacf1 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:27.765933 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d419d5-dfd5-4f8a-aa41-6c9cb1feacf1 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:27.771826 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c377b2-4e4c-41c1-a3f0-53baf1549f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:27.772857 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c377b2-4e4c-41c1-a3f0-53baf1549f9a admin admin] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:27.773259 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c377b2-4e4c-41c1-a3f0-53baf1549f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:27.774609 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c377b2-4e4c-41c1-a3f0-53baf1549f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:27.774609 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c377b2-4e4c-41c1-a3f0-53baf1549f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:27.776392 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c377b2-4e4c-41c1-a3f0-53baf1549f9a admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:27.798973 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1440/2905] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:01:27.803602 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b8d9d-a3b5-4815-b237-1ff8c25449b1 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:27.816084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b8d9d-a3b5-4815-b237-1ff8c25449b1 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:27.822202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80741ab0-0fc2-448f-baa2-1b7cc5b791da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:27.822906 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80741ab0-0fc2-448f-baa2-1b7cc5b791da admin admin] REQUEST_METHOD: `PUT` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:27.823175 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80741ab0-0fc2-448f-baa2-1b7cc5b791da admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:27.823455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80741ab0-0fc2-448f-baa2-1b7cc5b791da admin admin] PATH_INFO: `/v3/projects/bdfa25d0c410405fae5c1cf4fe6bf8c7/users/302e4ae8ef30473ab03282356465af94/roles/c770dd0c3bc540c3a48b0393d192b17a` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:27.843638 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80741ab0-0fc2-448f-baa2-1b7cc5b791da admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdfa25d0c410405fae5c1cf4fe6bf8c7, user_id=302e4ae8ef30473ab03282356465af94, role_id=c770dd0c3bc540c3a48b0393d192b17a)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:27.846153 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80741ab0-0fc2-448f-baa2-1b7cc5b791da admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:27.876027 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1466/2906] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:01:27 2022] PUT /identity/v3/projects/bdfa25d0c410405fae5c1cf4fe6bf8c7/users/302e4ae8ef30473ab03282356465af94/roles/c770dd0c3bc540c3a48b0393d192b17a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:01:27.888642 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1aed60-1a9a-410d-a51f-b23f1b4a0a63 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:27.888961 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1aed60-1a9a-410d-a51f-b23f1b4a0a63 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:27.889229 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1aed60-1a9a-410d-a51f-b23f1b4a0a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:27.936034 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-0e1aed60-1a9a-410d-a51f-b23f1b4a0a63 None None] MFA Rules not processed for user `302e4ae8ef30473ab03282356465af94`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:27.939197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0e1aed60-1a9a-410d-a51f-b23f1b4a0a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:28.080556 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1441/2907] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:01:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:01:28.086520 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80741ab0-0fc2-448f-baa2-1b7cc5b791da admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:28.120253 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:28.224165 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80741ab0-0fc2-448f-baa2-1b7cc5b791da admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:28.251367 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ec8ca-c151-4df9-be26-40efb0d25752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:28.252197 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ec8ca-c151-4df9-be26-40efb0d25752 admin admin] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:28.252583 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ec8ca-c151-4df9-be26-40efb0d25752 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:28.253005 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ec8ca-c151-4df9-be26-40efb0d25752 admin admin] PATH_INFO: `/v3/projects` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:28.253822 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ec8ca-c151-4df9-be26-40efb0d25752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:28.255874 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ec8ca-c151-4df9-be26-40efb0d25752 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:28.319980 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1467/2908] 10.222.0.23 () {60 vars in 1153 bytes} [Tue Sep 13 00:01:28 2022] POST /identity/v3/projects => generated 375 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 00:01:28.324952 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1aed60-1a9a-410d-a51f-b23f1b4a0a63 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:28.353847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1aed60-1a9a-410d-a51f-b23f1b4a0a63 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:28.476606 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca723b-1267-429b-af79-edace7b565d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:28.477412 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca723b-1267-429b-af79-edace7b565d0 admin admin] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:28.477799 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca723b-1267-429b-af79-edace7b565d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:28.478009 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca723b-1267-429b-af79-edace7b565d0 admin admin] PATH_INFO: `/v3/users` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:28.478643 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca723b-1267-429b-af79-edace7b565d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:28.480645 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca723b-1267-429b-af79-edace7b565d0 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:28.521405 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1442/2909] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Sep 13 00:01:28 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 00:01:28.525586 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ec8ca-c151-4df9-be26-40efb0d25752 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:28.548955 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ec8ca-c151-4df9-be26-40efb0d25752 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:28.560426 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49a51b-ef3b-49e8-a012-e3ab19ab2f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:28.561217 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49a51b-ef3b-49e8-a012-e3ab19ab2f54 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:28.561535 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49a51b-ef3b-49e8-a012-e3ab19ab2f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:28.561807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49a51b-ef3b-49e8-a012-e3ab19ab2f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:28.563211 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49a51b-ef3b-49e8-a012-e3ab19ab2f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:28.564950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49a51b-ef3b-49e8-a012-e3ab19ab2f54 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:28.595633 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1468/2910] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:01:28.599526 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca723b-1267-429b-af79-edace7b565d0 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:28.614202 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca723b-1267-429b-af79-edace7b565d0 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:28.620169 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cedd53-25ee-467e-b8fa-def12fed8bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:28.621036 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cedd53-25ee-467e-b8fa-def12fed8bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:28.621868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cedd53-25ee-467e-b8fa-def12fed8bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:28.622248 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cedd53-25ee-467e-b8fa-def12fed8bd2 admin admin] PATH_INFO: `/v3/projects/72bc550f4303480fbf02d69899b98a37/users/672db663ab584be3bd68ae9e8e3e6fac/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:28.646501 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cedd53-25ee-467e-b8fa-def12fed8bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bc550f4303480fbf02d69899b98a37, user_id=672db663ab584be3bd68ae9e8e3e6fac, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:28.649226 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cedd53-25ee-467e-b8fa-def12fed8bd2 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:28.662551 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:28.678652 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1443/2911] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:01:28 2022] PUT /identity/v3/projects/72bc550f4303480fbf02d69899b98a37/users/672db663ab584be3bd68ae9e8e3e6fac/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:01:28.679760 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49a51b-ef3b-49e8-a012-e3ab19ab2f54 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:28.694029 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49a51b-ef3b-49e8-a012-e3ab19ab2f54 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:28.787708 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8d648-3368-4ff4-b78d-a382c35b5345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:28.788679 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8d648-3368-4ff4-b78d-a382c35b5345 admin admin] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:28.788959 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8d648-3368-4ff4-b78d-a382c35b5345 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:28.789439 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8d648-3368-4ff4-b78d-a382c35b5345 admin admin] PATH_INFO: `/v3/roles` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:28.790282 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8d648-3368-4ff4-b78d-a382c35b5345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:28.792168 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8d648-3368-4ff4-b78d-a382c35b5345 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:28.805510 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1469/2912] 10.222.0.23 () {58 vars in 1122 bytes} [Tue Sep 13 00:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 00:01:28.809977 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cedd53-25ee-467e-b8fa-def12fed8bd2 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:28.824022 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cedd53-25ee-467e-b8fa-def12fed8bd2 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:28.830594 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f8400-8ff3-47c1-8dd0-c8533e756ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:28.831731 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f8400-8ff3-47c1-8dd0-c8533e756ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:28.832180 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f8400-8ff3-47c1-8dd0-c8533e756ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:28.837970 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f8400-8ff3-47c1-8dd0-c8533e756ad6 admin admin] PATH_INFO: `/v3/projects/72bc550f4303480fbf02d69899b98a37/users/672db663ab584be3bd68ae9e8e3e6fac/roles/440092230f024959a90e846ab29c6367` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:28.841028 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f8400-8ff3-47c1-8dd0-c8533e756ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bc550f4303480fbf02d69899b98a37, user_id=672db663ab584be3bd68ae9e8e3e6fac, role_id=440092230f024959a90e846ab29c6367)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:28.845074 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f8400-8ff3-47c1-8dd0-c8533e756ad6 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:28.859697 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1444/2913] 10.222.0.23 () {60 vars in 1483 bytes} [Tue Sep 13 00:01:28 2022] PUT /identity/v3/projects/72bc550f4303480fbf02d69899b98a37/users/672db663ab584be3bd68ae9e8e3e6fac/roles/440092230f024959a90e846ab29c6367 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:01:28.870404 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0adc6-da70-4f20-85bc-ec3b070d65d7 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:28.870697 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0adc6-da70-4f20-85bc-ec3b070d65d7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:28.870979 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0adc6-da70-4f20-85bc-ec3b070d65d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:28.933960 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-8db0adc6-da70-4f20-85bc-ec3b070d65d7 None None] MFA Rules not processed for user `672db663ab584be3bd68ae9e8e3e6fac`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:28.935741 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-8db0adc6-da70-4f20-85bc-ec3b070d65d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:29.073693 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1470/2914] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:01:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:29.088951 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f8400-8ff3-47c1-8dd0-c8533e756ad6 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:29.091909 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-6b5f8400-8ff3-47c1-8dd0-c8533e756ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:29.259311 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f8400-8ff3-47c1-8dd0-c8533e756ad6 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:29.265555 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506354ce-7bdb-450d-8f1b-e6371be419df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51d2d1c76c3040dd9e57f83c3860e8fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:29.266198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506354ce-7bdb-450d-8f1b-e6371be419df service cinder] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:29.266474 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506354ce-7bdb-450d-8f1b-e6371be419df service cinder] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:29.267308 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506354ce-7bdb-450d-8f1b-e6371be419df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:29.400907 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506354ce-7bdb-450d-8f1b-e6371be419df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:29.402618 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506354ce-7bdb-450d-8f1b-e6371be419df service cinder] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:29.428941 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1445/2915] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:01:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:01:30.805133 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c4c46-ea76-44fb-b420-1e8447748fab None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:30.805752 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c4c46-ea76-44fb-b420-1e8447748fab None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:30.806230 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c4c46-ea76-44fb-b420-1e8447748fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:30.849756 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:30.862764 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-be1c4c46-ea76-44fb-b420-1e8447748fab None None] MFA Rules not processed for user `f7be2776ed4f4e0b99d67f26ef15f4ea`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:30.864084 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-be1c4c46-ea76-44fb-b420-1e8447748fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:30.972528 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1471/2916] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:01:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:30.992193 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506354ce-7bdb-450d-8f1b-e6371be419df service cinder] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:30.996315 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-506354ce-7bdb-450d-8f1b-e6371be419df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:31.139084 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506354ce-7bdb-450d-8f1b-e6371be419df service cinder] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:31.150231 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b6105-e1e1-4034-9615-393c6eb65384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:31.151526 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b6105-e1e1-4034-9615-393c6eb65384 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:31.151762 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b6105-e1e1-4034-9615-393c6eb65384 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:31.152154 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b6105-e1e1-4034-9615-393c6eb65384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:31.156718 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-e92b6105-e1e1-4034-9615-393c6eb65384 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:31.198862 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:31.256800 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b6105-e1e1-4034-9615-393c6eb65384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:31.258403 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b6105-e1e1-4034-9615-393c6eb65384 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:31.271158 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1446/2917] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:01:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 00:01:32.473954 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c4c46-ea76-44fb-b420-1e8447748fab None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:32.505676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee88871-ab5e-4c4a-9923-68982e6cdc79 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:32.506899 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee88871-ab5e-4c4a-9923-68982e6cdc79 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:32.507289 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee88871-ab5e-4c4a-9923-68982e6cdc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:32.528998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-8ee88871-ab5e-4c4a-9923-68982e6cdc79 None None] MFA Rules not processed for user `6f924ea9b813410caa0cc9b04a87500f`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:32.530283 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-8ee88871-ab5e-4c4a-9923-68982e6cdc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:32.541499 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1447/2918] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:01:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:32.582715 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c4c46-ea76-44fb-b420-1e8447748fab None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:32.592909 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb19f45-2da5-43eb-a9e9-6a854a1c48ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:32.593862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb19f45-2da5-43eb-a9e9-6a854a1c48ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:32.593987 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb19f45-2da5-43eb-a9e9-6a854a1c48ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:32.594647 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb19f45-2da5-43eb-a9e9-6a854a1c48ff admin admin] PATH_INFO: `/v3/users/302e4ae8ef30473ab03282356465af94` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:32.596398 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb19f45-2da5-43eb-a9e9-6a854a1c48ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=302e4ae8ef30473ab03282356465af94)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:32.599299 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb19f45-2da5-43eb-a9e9-6a854a1c48ff admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:32.682237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-6cb19f45-2da5-43eb-a9e9-6a854a1c48ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302e4ae8ef30473ab03282356465af94'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:32.691663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-6cb19f45-2da5-43eb-a9e9-6a854a1c48ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302e4ae8ef30473ab03282356465af94'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:32.709823 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-6cb19f45-2da5-43eb-a9e9-6a854a1c48ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302e4ae8ef30473ab03282356465af94'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:32.722248 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-6cb19f45-2da5-43eb-a9e9-6a854a1c48ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302e4ae8ef30473ab03282356465af94'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:32.723455 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-6cb19f45-2da5-43eb-a9e9-6a854a1c48ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302e4ae8ef30473ab03282356465af94'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:32.734393 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1472/2919] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:01:32 2022] DELETE /identity/v3/users/302e4ae8ef30473ab03282356465af94 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:01:32.741071 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d68b7-1d2b-43c0-9b51-1cf694977492 None None] REQUEST_METHOD: `POST` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:32.741717 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d68b7-1d2b-43c0-9b51-1cf694977492 None None] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:32.742105 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d68b7-1d2b-43c0-9b51-1cf694977492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:32.777108 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.auth.core [None req-206d68b7-1d2b-43c0-9b51-1cf694977492 None None] MFA Rules not processed for user `5b7b370e89cd4d279855f8c68c6540e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87848) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:32.778963 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-206d68b7-1d2b-43c0-9b51-1cf694977492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:32.853294 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1448/2920] 10.222.0.23 () {58 vars in 958 bytes} [Tue Sep 13 00:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 00:01:32.867064 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb19f45-2da5-43eb-a9e9-6a854a1c48ff admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:32.869456 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6cb19f45-2da5-43eb-a9e9-6a854a1c48ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:32.900640 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:32.960466 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb19f45-2da5-43eb-a9e9-6a854a1c48ff admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:32.964611 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908f5a1-b2b2-4a82-bbcd-66770b4359d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:32.965380 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908f5a1-b2b2-4a82-bbcd-66770b4359d6 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:32.965850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908f5a1-b2b2-4a82-bbcd-66770b4359d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:32.966433 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908f5a1-b2b2-4a82-bbcd-66770b4359d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:32.977790 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908f5a1-b2b2-4a82-bbcd-66770b4359d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:32.979592 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908f5a1-b2b2-4a82-bbcd-66770b4359d6 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:32.992307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1473/2921] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:01:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:01:33.378383 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d68b7-1d2b-43c0-9b51-1cf694977492 None None] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:33.379847 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-206d68b7-1d2b-43c0-9b51-1cf694977492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:33.400902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d68b7-1d2b-43c0-9b51-1cf694977492 None None] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:33.410290 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:33.413637 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:33.414029 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:33.414419 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1 admin admin] PATH_INFO: `/v3/projects/bdfa25d0c410405fae5c1cf4fe6bf8c7` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:33.416461 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdfa25d0c410405fae5c1cf4fe6bf8c7)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:33.419033 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:33.495834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdfa25d0c410405fae5c1cf4fe6bf8c7', 'request_id': 'req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:33.503485 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdfa25d0c410405fae5c1cf4fe6bf8c7', 'request_id': 'req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:33.519203 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdfa25d0c410405fae5c1cf4fe6bf8c7', 'request_id': 'req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:33.535927 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1 admin admin] The token cache is being invalidate because project bdfa25d0c410405fae5c1cf4fe6bf8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:01:33.536214 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:33.536915 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:33.538728 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1449/2922] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:01:33 2022] DELETE /identity/v3/projects/bdfa25d0c410405fae5c1cf4fe6bf8c7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:01:33.544841 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908f5a1-b2b2-4a82-bbcd-66770b4359d6 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:33.555653 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908f5a1-b2b2-4a82-bbcd-66770b4359d6 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:33.635566 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1815145-ecf2-4d36-ab53-d39bbed6e741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:33.636568 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1815145-ecf2-4d36-ab53-d39bbed6e741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:33.636850 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1815145-ecf2-4d36-ab53-d39bbed6e741 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:33.637104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1815145-ecf2-4d36-ab53-d39bbed6e741 admin admin] PATH_INFO: `/v3/users/672db663ab584be3bd68ae9e8e3e6fac` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:33.638335 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1815145-ecf2-4d36-ab53-d39bbed6e741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=672db663ab584be3bd68ae9e8e3e6fac)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:33.641292 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1815145-ecf2-4d36-ab53-d39bbed6e741 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:33.717559 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b1815145-ecf2-4d36-ab53-d39bbed6e741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672db663ab584be3bd68ae9e8e3e6fac'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:33.726130 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b1815145-ecf2-4d36-ab53-d39bbed6e741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672db663ab584be3bd68ae9e8e3e6fac'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:33.744279 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b1815145-ecf2-4d36-ab53-d39bbed6e741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672db663ab584be3bd68ae9e8e3e6fac'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:33.759081 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b1815145-ecf2-4d36-ab53-d39bbed6e741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672db663ab584be3bd68ae9e8e3e6fac'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:33.759847 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-b1815145-ecf2-4d36-ab53-d39bbed6e741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672db663ab584be3bd68ae9e8e3e6fac'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:33.767092 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1474/2923] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:01:33 2022] DELETE /identity/v3/users/672db663ab584be3bd68ae9e8e3e6fac => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:01:34.129302 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:34.131076 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:34.146615 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33ec23-2079-4b41-82b9-cdf2955aa0d1 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:34.190673 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:34.231518 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f627c-e490-461c-b766-e8729153d965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:34.232483 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f627c-e490-461c-b766-e8729153d965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:34.232767 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f627c-e490-461c-b766-e8729153d965 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:34.233040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f627c-e490-461c-b766-e8729153d965 admin admin] PATH_INFO: `/v3/projects/72bc550f4303480fbf02d69899b98a37` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:34.234406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f627c-e490-461c-b766-e8729153d965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72bc550f4303480fbf02d69899b98a37)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:34.236407 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f627c-e490-461c-b766-e8729153d965 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:34.304608 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a95f627c-e490-461c-b766-e8729153d965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72bc550f4303480fbf02d69899b98a37', 'request_id': 'req-a95f627c-e490-461c-b766-e8729153d965'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:34.313512 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a95f627c-e490-461c-b766-e8729153d965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72bc550f4303480fbf02d69899b98a37', 'request_id': 'req-a95f627c-e490-461c-b766-e8729153d965'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:34.321738 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a95f627c-e490-461c-b766-e8729153d965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72bc550f4303480fbf02d69899b98a37', 'request_id': 'req-a95f627c-e490-461c-b766-e8729153d965'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:34.336519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a95f627c-e490-461c-b766-e8729153d965 admin admin] The token cache is being invalidate because project 72bc550f4303480fbf02d69899b98a37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:01:34.336519 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a95f627c-e490-461c-b766-e8729153d965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:34.336908 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-a95f627c-e490-461c-b766-e8729153d965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:34.338476 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1450/2924] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:01:34 2022] DELETE /identity/v3/projects/72bc550f4303480fbf02d69899b98a37 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:01:43.763234 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=72,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:44.340100 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:49.859086 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884b466-5497-4167-926a-f4489a3e1be7 None None] REQUEST_METHOD: `POST` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:49.859945 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884b466-5497-4167-926a-f4489a3e1be7 None None] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:49.860226 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884b466-5497-4167-926a-f4489a3e1be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:49.882183 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.auth.core [None req-d884b466-5497-4167-926a-f4489a3e1be7 None None] MFA Rules not processed for user `e1f49820de264982aeec97fa0be3c290`. Rule list: `[]` (Enabled: `True`). {{(pid=87847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 00:01:49.883446 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d884b466-5497-4167-926a-f4489a3e1be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:49.958604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1475/2925] 10.222.0.23 () {58 vars in 967 bytes} [Tue Sep 13 00:01:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 00:01:49.978007 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f627c-e490-461c-b766-e8729153d965 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:49.979610 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-a95f627c-e490-461c-b766-e8729153d965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:50.060450 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f627c-e490-461c-b766-e8729153d965 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:50.066210 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324f5d5-717e-41cc-bd0c-59267a05c015 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43c45ae3144b4fe8ab4e921fda30164a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:50.067037 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f5d5-717e-41cc-bd0c-59267a05c015 service swift] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:50.067286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f5d5-717e-41cc-bd0c-59267a05c015 service swift] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:50.067661 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f5d5-717e-41cc-bd0c-59267a05c015 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:50.077967 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324f5d5-717e-41cc-bd0c-59267a05c015 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:50.079607 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324f5d5-717e-41cc-bd0c-59267a05c015 service swift] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:50.089356 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1451/2926] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Sep 13 00:01:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 00:01:58.153789 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884b466-5497-4167-926a-f4489a3e1be7 None None] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:58.156109 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d884b466-5497-4167-926a-f4489a3e1be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:58.236214 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884b466-5497-4167-926a-f4489a3e1be7 None None] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:58.249222 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc453b-a558-45d4-97da-26640f5a9c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:58.249913 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc453b-a558-45d4-97da-26640f5a9c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:58.250191 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc453b-a558-45d4-97da-26640f5a9c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:58.250465 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc453b-a558-45d4-97da-26640f5a9c33 admin admin] PATH_INFO: `/v3/users/4020e53710354715b9c8a21d08618834` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:58.251671 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc453b-a558-45d4-97da-26640f5a9c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4020e53710354715b9c8a21d08618834)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:58.253744 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc453b-a558-45d4-97da-26640f5a9c33 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:58.305935 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-31cc453b-a558-45d4-97da-26640f5a9c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4020e53710354715b9c8a21d08618834'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:58.313080 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-31cc453b-a558-45d4-97da-26640f5a9c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4020e53710354715b9c8a21d08618834'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:58.326743 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-31cc453b-a558-45d4-97da-26640f5a9c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4020e53710354715b9c8a21d08618834'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:58.334807 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-31cc453b-a558-45d4-97da-26640f5a9c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4020e53710354715b9c8a21d08618834'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:58.335888 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-31cc453b-a558-45d4-97da-26640f5a9c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4020e53710354715b9c8a21d08618834'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:58.342229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1476/2927] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:01:58 2022] DELETE /identity/v3/users/4020e53710354715b9c8a21d08618834 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:01:58.433784 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324f5d5-717e-41cc-bd0c-59267a05c015 service swift] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:58.436217 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f324f5d5-717e-41cc-bd0c-59267a05c015 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:58.508137 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324f5d5-717e-41cc-bd0c-59267a05c015 service swift] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:58.541555 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc453b-a558-45d4-97da-26640f5a9c33 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:58.543148 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-31cc453b-a558-45d4-97da-26640f5a9c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:58.563590 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449c7ff-69d0-4224-a87d-c98b59b3c516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:58.564197 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449c7ff-69d0-4224-a87d-c98b59b3c516 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:58.564552 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449c7ff-69d0-4224-a87d-c98b59b3c516 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:58.564827 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449c7ff-69d0-4224-a87d-c98b59b3c516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:58.566868 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-f449c7ff-69d0-4224-a87d-c98b59b3c516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:58.583520 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:58.628207 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc453b-a558-45d4-97da-26640f5a9c33 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:58.632945 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:58.633629 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:58.633913 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:58.634194 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4 admin admin] PATH_INFO: `/v3/projects/2a00b5186a78428f82fe12d67213a216` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:58.634343 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=100 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:58.635862 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a00b5186a78428f82fe12d67213a216)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:58.636915 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449c7ff-69d0-4224-a87d-c98b59b3c516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:58.637994 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:58.638936 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449c7ff-69d0-4224-a87d-c98b59b3c516 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:58.649582 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1452/2928] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:01:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:01:58.690237 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a00b5186a78428f82fe12d67213a216', 'request_id': 'req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:58.700652 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a00b5186a78428f82fe12d67213a216', 'request_id': 'req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:58.707056 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a00b5186a78428f82fe12d67213a216', 'request_id': 'req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:58.724635 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4 admin admin] The token cache is being invalidate because project 2a00b5186a78428f82fe12d67213a216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:01:58.725138 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:58.725963 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:58.728229 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1477/2929] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:01:58 2022] DELETE /identity/v3/projects/2a00b5186a78428f82fe12d67213a216 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 00:01:58.733866 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449c7ff-69d0-4224-a87d-c98b59b3c516 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:58.750503 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449c7ff-69d0-4224-a87d-c98b59b3c516 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:58.817022 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b00f0-0f04-4e1c-b878-b744246050b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:58.817650 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b00f0-0f04-4e1c-b878-b744246050b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:58.817931 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b00f0-0f04-4e1c-b878-b744246050b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:58.818198 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b00f0-0f04-4e1c-b878-b744246050b7 admin admin] PATH_INFO: `/v3/users/45df91959e6b4a7091c6092cf6a6f4e9` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:58.819522 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b00f0-0f04-4e1c-b878-b744246050b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45df91959e6b4a7091c6092cf6a6f4e9)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:58.821612 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b00f0-0f04-4e1c-b878-b744246050b7 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:58.880994 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-913b00f0-0f04-4e1c-b878-b744246050b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45df91959e6b4a7091c6092cf6a6f4e9'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:58.881727 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-913b00f0-0f04-4e1c-b878-b744246050b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45df91959e6b4a7091c6092cf6a6f4e9'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:58.882386 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-913b00f0-0f04-4e1c-b878-b744246050b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45df91959e6b4a7091c6092cf6a6f4e9'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:58.895991 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-913b00f0-0f04-4e1c-b878-b744246050b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45df91959e6b4a7091c6092cf6a6f4e9'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:58.904073 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-913b00f0-0f04-4e1c-b878-b744246050b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45df91959e6b4a7091c6092cf6a6f4e9'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:58.920042 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1453/2930] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:01:58 2022] DELETE /identity/v3/users/45df91959e6b4a7091c6092cf6a6f4e9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:01:59.195645 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:01:59.195645 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:01:59.213615 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1143f-8d22-4703-a1db-8e0d5fbe75b4 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:01:59.300685 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9397323-d6a1-4481-a312-dd8b8ead35dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:01:59.301770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9397323-d6a1-4481-a312-dd8b8ead35dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:01:59.302263 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9397323-d6a1-4481-a312-dd8b8ead35dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:01:59.302636 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9397323-d6a1-4481-a312-dd8b8ead35dc admin admin] PATH_INFO: `/v3/projects/6e9db264fb1348f3bdde0aeb6d263b60` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:01:59.305028 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9397323-d6a1-4481-a312-dd8b8ead35dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9db264fb1348f3bdde0aeb6d263b60)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:01:59.308584 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9397323-d6a1-4481-a312-dd8b8ead35dc admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:01:59.384450 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d9397323-d6a1-4481-a312-dd8b8ead35dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9db264fb1348f3bdde0aeb6d263b60', 'request_id': 'req-d9397323-d6a1-4481-a312-dd8b8ead35dc'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:59.394754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d9397323-d6a1-4481-a312-dd8b8ead35dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9db264fb1348f3bdde0aeb6d263b60', 'request_id': 'req-d9397323-d6a1-4481-a312-dd8b8ead35dc'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:59.396840 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:59.407801 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d9397323-d6a1-4481-a312-dd8b8ead35dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9db264fb1348f3bdde0aeb6d263b60', 'request_id': 'req-d9397323-d6a1-4481-a312-dd8b8ead35dc'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:59.428634 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d9397323-d6a1-4481-a312-dd8b8ead35dc admin admin] The token cache is being invalidate because project 6e9db264fb1348f3bdde0aeb6d263b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:01:59.428950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d9397323-d6a1-4481-a312-dd8b8ead35dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:59.430030 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-d9397323-d6a1-4481-a312-dd8b8ead35dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:01:59.449379 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1478/2931] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:01:59 2022] DELETE /identity/v3/projects/6e9db264fb1348f3bdde0aeb6d263b60 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:02:08.915907 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:02:09.424203 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:DELETE=2,keystone:SELECT=5 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:03:50.143511 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b00f0-0f04-4e1c-b878-b744246050b7 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:03:50.145800 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-913b00f0-0f04-4e1c-b878-b744246050b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:03:50.214683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b00f0-0f04-4e1c-b878-b744246050b7 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:03:50.265777 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055cf3b-2208-432d-98f0-4c7e1c2433e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:03:50.266393 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055cf3b-2208-432d-98f0-4c7e1c2433e7 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:03:50.266670 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055cf3b-2208-432d-98f0-4c7e1c2433e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:03:50.266940 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055cf3b-2208-432d-98f0-4c7e1c2433e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:03:50.268837 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4055cf3b-2208-432d-98f0-4c7e1c2433e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:03:50.349203 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055cf3b-2208-432d-98f0-4c7e1c2433e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:03:50.351385 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055cf3b-2208-432d-98f0-4c7e1c2433e7 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:03:50.365050 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1454/2932] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:03:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:03:51.566243 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9397323-d6a1-4481-a312-dd8b8ead35dc admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:03:51.568314 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-d9397323-d6a1-4481-a312-dd8b8ead35dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:03:51.585199 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9397323-d6a1-4481-a312-dd8b8ead35dc admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:03:51.589694 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ee9c6-b059-452e-9133-8aaa46d4caf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:03:51.590314 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ee9c6-b059-452e-9133-8aaa46d4caf7 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:03:51.590588 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ee9c6-b059-452e-9133-8aaa46d4caf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:03:51.590876 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ee9c6-b059-452e-9133-8aaa46d4caf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:03:51.592950 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ef0ee9c6-b059-452e-9133-8aaa46d4caf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:03:51.608518 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ee9c6-b059-452e-9133-8aaa46d4caf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:03:51.609988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ee9c6-b059-452e-9133-8aaa46d4caf7 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:03:51.621591 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1479/2933] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:03:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:04:00.271196 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055cf3b-2208-432d-98f0-4c7e1c2433e7 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:04:00.272939 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-4055cf3b-2208-432d-98f0-4c7e1c2433e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:04:00.285389 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055cf3b-2208-432d-98f0-4c7e1c2433e7 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:04:00.290040 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482015e-2979-4701-89e0-744e8694c9d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:04:00.290676 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482015e-2979-4701-89e0-744e8694c9d1 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:04:00.290980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482015e-2979-4701-89e0-744e8694c9d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:04:00.291242 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482015e-2979-4701-89e0-744e8694c9d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:04:00.293784 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-8482015e-2979-4701-89e0-744e8694c9d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:04:00.305371 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482015e-2979-4701-89e0-744e8694c9d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:04:00.306845 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482015e-2979-4701-89e0-744e8694c9d1 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:04:00.317286 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1455/2934] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:04:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:04:01.616295 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=6 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:04:03.898223 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ee9c6-b059-452e-9133-8aaa46d4caf7 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:04:03.908202 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ee9c6-b059-452e-9133-8aaa46d4caf7 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:04:03.913147 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73a991-2ed3-4131-9102-7b5c2b141d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:04:03.913147 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73a991-2ed3-4131-9102-7b5c2b141d84 service neutron] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:04:03.913743 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73a991-2ed3-4131-9102-7b5c2b141d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:04:03.914979 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73a991-2ed3-4131-9102-7b5c2b141d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:04:03.916676 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ae73a991-2ed3-4131-9102-7b5c2b141d84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:04:03.933613 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73a991-2ed3-4131-9102-7b5c2b141d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:04:03.936483 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73a991-2ed3-4131-9102-7b5c2b141d84 service neutron] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:04:03.952628 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1480/2935] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:04:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:04:04.066275 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482015e-2979-4701-89e0-744e8694c9d1 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:04:04.078787 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482015e-2979-4701-89e0-744e8694c9d1 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:04:04.083916 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ef1fc-deeb-4903-bcd4-2f458099eee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5814ac53752455697e050944b6d32b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:04:04.084549 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ef1fc-deeb-4903-bcd4-2f458099eee8 service neutron] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:04:04.084823 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ef1fc-deeb-4903-bcd4-2f458099eee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:04:04.085087 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ef1fc-deeb-4903-bcd4-2f458099eee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:04:04.087265 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-866ef1fc-deeb-4903-bcd4-2f458099eee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:04:04.103121 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ef1fc-deeb-4903-bcd4-2f458099eee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:04:04.104629 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ef1fc-deeb-4903-bcd4-2f458099eee8 service neutron] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:04:04.117772 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1456/2936] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:04:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:04:04.181483 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73a991-2ed3-4131-9102-7b5c2b141d84 service neutron] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:04:04.182977 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-ae73a991-2ed3-4131-9102-7b5c2b141d84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:04:04.260604 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73a991-2ed3-4131-9102-7b5c2b141d84 service neutron] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:04:04.265886 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9214c7-9e63-4bba-8819-ae4c8b4b08fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4395ee0a00df41adacb55b4a8684786b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:04:04.266513 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9214c7-9e63-4bba-8819-ae4c8b4b08fc service placement] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:04:04.266801 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9214c7-9e63-4bba-8819-ae4c8b4b08fc service placement] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:04:04.267067 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9214c7-9e63-4bba-8819-ae4c8b4b08fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:04:04.268996 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-dd9214c7-9e63-4bba-8819-ae4c8b4b08fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:04:04.281480 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9214c7-9e63-4bba-8819-ae4c8b4b08fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:04:04.283118 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9214c7-9e63-4bba-8819-ae4c8b4b08fc service placement] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:04:04.294383 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1481/2937] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:04:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:04:14.112253 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=86 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:04:14.289377 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=38 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:05:19.409232 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ef1fc-deeb-4903-bcd4-2f458099eee8 service neutron] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:05:19.411712 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-866ef1fc-deeb-4903-bcd4-2f458099eee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:05:19.432114 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ef1fc-deeb-4903-bcd4-2f458099eee8 service neutron] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:05:19.438559 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcb20a-f4b8-4103-9a7c-e48e18920699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a87e18c89ff419f8e428e376d33462c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:05:19.439492 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcb20a-f4b8-4103-9a7c-e48e18920699 service nova] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:05:19.439969 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcb20a-f4b8-4103-9a7c-e48e18920699 service nova] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:05:19.440431 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcb20a-f4b8-4103-9a7c-e48e18920699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:05:19.442452 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-c7fcb20a-f4b8-4103-9a7c-e48e18920699 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:05:19.456791 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fcb20a-f4b8-4103-9a7c-e48e18920699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:05:19.459128 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fcb20a-f4b8-4103-9a7c-e48e18920699 service nova] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:05:19.472871 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1457/2938] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:05:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:05:27.558481 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9214c7-9e63-4bba-8819-ae4c8b4b08fc service placement] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:05:27.565117 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-dd9214c7-9e63-4bba-8819-ae4c8b4b08fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:05:27.586791 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9214c7-9e63-4bba-8819-ae4c8b4b08fc service placement] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:05:27.593519 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd35e42-76f0-40f6-9af0-46ce1e8b1e61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4395ee0a00df41adacb55b4a8684786b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:05:27.594307 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd35e42-76f0-40f6-9af0-46ce1e8b1e61 service placement] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:05:27.594842 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd35e42-76f0-40f6-9af0-46ce1e8b1e61 service placement] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:05:27.595155 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd35e42-76f0-40f6-9af0-46ce1e8b1e61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:05:27.597025 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6dd35e42-76f0-40f6-9af0-46ce1e8b1e61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:05:27.622920 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd35e42-76f0-40f6-9af0-46ce1e8b1e61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:05:27.624907 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd35e42-76f0-40f6-9af0-46ce1e8b1e61 service placement] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:05:27.636414 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1482/2939] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:05:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:05:29.466342 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=6 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:05:30.594049 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcb20a-f4b8-4103-9a7c-e48e18920699 service nova] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:05:30.616902 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fcb20a-f4b8-4103-9a7c-e48e18920699 service nova] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:05:30.623254 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa43c3-d91f-4ecd-92ce-b6c1a94a91d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4395ee0a00df41adacb55b4a8684786b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:05:30.623920 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa43c3-d91f-4ecd-92ce-b6c1a94a91d3 service placement] REQUEST_METHOD: `GET` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:05:30.624245 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa43c3-d91f-4ecd-92ce-b6c1a94a91d3 service placement] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:05:30.624491 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa43c3-d91f-4ecd-92ce-b6c1a94a91d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:05:30.626980 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-0bfa43c3-d91f-4ecd-92ce-b6c1a94a91d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:05:30.650167 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa43c3-d91f-4ecd-92ce-b6c1a94a91d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:05:30.653473 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa43c3-d91f-4ecd-92ce-b6c1a94a91d3 service placement] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:05:30.676247 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1458/2940] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:05:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:05:30.957416 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd35e42-76f0-40f6-9af0-46ce1e8b1e61 service placement] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:05:30.959178 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-6dd35e42-76f0-40f6-9af0-46ce1e8b1e61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:05:31.033328 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd35e42-76f0-40f6-9af0-46ce1e8b1e61 service placement] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:05:31.038099 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0fe43-0684-440e-93a4-77af04a16550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:05:31.038754 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0fe43-0684-440e-93a4-77af04a16550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:05:31.039035 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0fe43-0684-440e-93a4-77af04a16550 admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:05:31.039308 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0fe43-0684-440e-93a4-77af04a16550 admin admin] PATH_INFO: `/v3/users/6f924ea9b813410caa0cc9b04a87500f` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:05:31.040832 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0fe43-0684-440e-93a4-77af04a16550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f924ea9b813410caa0cc9b04a87500f)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:05:31.042816 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0fe43-0684-440e-93a4-77af04a16550 admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:05:31.096377 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-65e0fe43-0684-440e-93a4-77af04a16550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f924ea9b813410caa0cc9b04a87500f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:31.104998 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-65e0fe43-0684-440e-93a4-77af04a16550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f924ea9b813410caa0cc9b04a87500f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:31.119945 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-65e0fe43-0684-440e-93a4-77af04a16550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f924ea9b813410caa0cc9b04a87500f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:31.130968 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-65e0fe43-0684-440e-93a4-77af04a16550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f924ea9b813410caa0cc9b04a87500f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:31.131742 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-65e0fe43-0684-440e-93a4-77af04a16550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f924ea9b813410caa0cc9b04a87500f'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:31.138890 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1483/2941] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:05:30 2022] DELETE /identity/v3/users/6f924ea9b813410caa0cc9b04a87500f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:05:31.323774 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa43c3-d91f-4ecd-92ce-b6c1a94a91d3 service placement] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:05:31.335139 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa43c3-d91f-4ecd-92ce-b6c1a94a91d3 service placement] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:05:31.403073 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd1b98-5aa0-4645-aaef-4285933ba357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:05:31.403834 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd1b98-5aa0-4645-aaef-4285933ba357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:05:31.404116 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd1b98-5aa0-4645-aaef-4285933ba357 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:05:31.404385 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd1b98-5aa0-4645-aaef-4285933ba357 admin admin] PATH_INFO: `/v3/projects/236b49ff2a8a4b7aaf201688cf76903d` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:05:31.405667 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd1b98-5aa0-4645-aaef-4285933ba357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=236b49ff2a8a4b7aaf201688cf76903d)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:05:31.407639 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd1b98-5aa0-4645-aaef-4285933ba357 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:05:31.477995 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-71dd1b98-5aa0-4645-aaef-4285933ba357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '236b49ff2a8a4b7aaf201688cf76903d', 'request_id': 'req-71dd1b98-5aa0-4645-aaef-4285933ba357'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:31.486982 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-71dd1b98-5aa0-4645-aaef-4285933ba357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '236b49ff2a8a4b7aaf201688cf76903d', 'request_id': 'req-71dd1b98-5aa0-4645-aaef-4285933ba357'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:31.500441 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-71dd1b98-5aa0-4645-aaef-4285933ba357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '236b49ff2a8a4b7aaf201688cf76903d', 'request_id': 'req-71dd1b98-5aa0-4645-aaef-4285933ba357'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:31.513941 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-71dd1b98-5aa0-4645-aaef-4285933ba357 admin admin] The token cache is being invalidate because project 236b49ff2a8a4b7aaf201688cf76903d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:05:31.514241 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-71dd1b98-5aa0-4645-aaef-4285933ba357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:31.514951 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-71dd1b98-5aa0-4645-aaef-4285933ba357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:31.516541 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1459/2942] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:05:31 2022] DELETE /identity/v3/projects/236b49ff2a8a4b7aaf201688cf76903d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:05:31.521377 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0fe43-0684-440e-93a4-77af04a16550 admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:05:31.523061 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-65e0fe43-0684-440e-93a4-77af04a16550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:05:31.538372 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0fe43-0684-440e-93a4-77af04a16550 admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:05:31.604301 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329a068-2b09-4ef8-8bc0-ca69be62838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:05:31.604988 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a068-2b09-4ef8-8bc0-ca69be62838e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:05:31.605271 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a068-2b09-4ef8-8bc0-ca69be62838e admin admin] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:05:31.605577 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329a068-2b09-4ef8-8bc0-ca69be62838e admin admin] PATH_INFO: `/v3/users/f7be2776ed4f4e0b99d67f26ef15f4ea` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:05:31.606974 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329a068-2b09-4ef8-8bc0-ca69be62838e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7be2776ed4f4e0b99d67f26ef15f4ea)` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:05:31.608976 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329a068-2b09-4ef8-8bc0-ca69be62838e admin admin] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:05:31.614915 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:05:31.658104 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4329a068-2b09-4ef8-8bc0-ca69be62838e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7be2776ed4f4e0b99d67f26ef15f4ea'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:31.665770 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4329a068-2b09-4ef8-8bc0-ca69be62838e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7be2776ed4f4e0b99d67f26ef15f4ea'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:31.679993 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4329a068-2b09-4ef8-8bc0-ca69be62838e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7be2776ed4f4e0b99d67f26ef15f4ea'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:31.689865 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4329a068-2b09-4ef8-8bc0-ca69be62838e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7be2776ed4f4e0b99d67f26ef15f4ea'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:31.690542 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.notifications [None req-4329a068-2b09-4ef8-8bc0-ca69be62838e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7be2776ed4f4e0b99d67f26ef15f4ea'} {{(pid=87847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:31.697495 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1484/2943] 10.222.0.23 () {58 vars in 1224 bytes} [Tue Sep 13 00:05:31 2022] DELETE /identity/v3/users/f7be2776ed4f4e0b99d67f26ef15f4ea => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:05:31.888933 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd1b98-5aa0-4645-aaef-4285933ba357 admin admin] Authenticating user token {{(pid=87848) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:05:31.890521 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.fernet_utils [None req-71dd1b98-5aa0-4645-aaef-4285933ba357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87848) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:05:31.904490 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd1b98-5aa0-4645-aaef-4285933ba357 admin admin] Validating token access rules against request {{(pid=87848) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:05:31.969780 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252acc4a-7fef-444d-92b8-80ae6b456745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b7b370e89cd4d279855f8c68c6540e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f4013b4b7a749e88ad00a53390dd085', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87848) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:05:31.970406 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252acc4a-7fef-444d-92b8-80ae6b456745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:05:31.970683 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252acc4a-7fef-444d-92b8-80ae6b456745 admin admin] SCRIPT_NAME: `/identity` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:05:31.970922 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252acc4a-7fef-444d-92b8-80ae6b456745 admin admin] PATH_INFO: `/v3/projects/8097b3c62b01476b81a672aa7595b052` {{(pid=87848) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:05:31.972063 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252acc4a-7fef-444d-92b8-80ae6b456745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8097b3c62b01476b81a672aa7595b052)` {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:05:31.974039 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252acc4a-7fef-444d-92b8-80ae6b456745 admin admin] RBAC: Authorization granted {{(pid=87848) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:05:31.996466 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:05:32.035168 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-252acc4a-7fef-444d-92b8-80ae6b456745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8097b3c62b01476b81a672aa7595b052', 'request_id': 'req-252acc4a-7fef-444d-92b8-80ae6b456745'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:32.041957 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-252acc4a-7fef-444d-92b8-80ae6b456745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8097b3c62b01476b81a672aa7595b052', 'request_id': 'req-252acc4a-7fef-444d-92b8-80ae6b456745'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:32.051481 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-252acc4a-7fef-444d-92b8-80ae6b456745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8097b3c62b01476b81a672aa7595b052', 'request_id': 'req-252acc4a-7fef-444d-92b8-80ae6b456745'} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:32.063709 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-252acc4a-7fef-444d-92b8-80ae6b456745 admin admin] The token cache is being invalidate because project 8097b3c62b01476b81a672aa7595b052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87848) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 00:05:32.063998 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-252acc4a-7fef-444d-92b8-80ae6b456745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:32.064653 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG keystone.notifications [None req-252acc4a-7fef-444d-92b8-80ae6b456745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87848) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 00:05:32.066209 dv-cinder-820027-26-smb devstack@keystone.service[87848]: [pid: 87848|app: 0|req: 1460/2944] 10.222.0.23 () {58 vars in 1233 bytes} [Tue Sep 13 00:05:31 2022] DELETE /identity/v3/projects/8097b3c62b01476b81a672aa7595b052 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 00:05:41.693370 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:05:42.060427 dv-cinder-820027-26-smb devstack@keystone.service[87848]: DEBUG dbcounter [-] [87848] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87848) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:07:13.811155 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329a068-2b09-4ef8-8bc0-ca69be62838e admin admin] Authenticating user token {{(pid=87847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 00:07:13.812758 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-4329a068-2b09-4ef8-8bc0-ca69be62838e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:07:13.890004 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329a068-2b09-4ef8-8bc0-ca69be62838e admin admin] Validating token access rules against request {{(pid=87847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 00:07:13.969663 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e3849-dc08-409a-886e-8f67ad1c2e61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4395ee0a00df41adacb55b4a8684786b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21118e9e4fa94603b2c0880dd0d5f5ba', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 00:07:13.970284 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e3849-dc08-409a-886e-8f67ad1c2e61 service placement] REQUEST_METHOD: `GET` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 00:07:13.970560 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e3849-dc08-409a-886e-8f67ad1c2e61 service placement] SCRIPT_NAME: `/identity` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 00:07:13.970819 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e3849-dc08-409a-886e-8f67ad1c2e61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 00:07:13.972894 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.fernet_utils [None req-7d8e3849-dc08-409a-886e-8f67ad1c2e61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 00:07:13.984902 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e3849-dc08-409a-886e-8f67ad1c2e61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 00:07:13.986536 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e3849-dc08-409a-886e-8f67ad1c2e61 service placement] RBAC: Authorization granted {{(pid=87847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 00:07:13.996811 dv-cinder-820027-26-smb devstack@keystone.service[87847]: [pid: 87847|app: 0|req: 1485/2945] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Sep 13 00:07:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 00:07:23.992394 dv-cinder-820027-26-smb devstack@keystone.service[87847]: DEBUG dbcounter [-] [87847] Writing DB stats keystone:SELECT=58 {{(pid=87847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}